Take a measurement first.
From rear of flap skin along through the tooling holes to the front of the spar. What is that? My first set of flaps were 3/16 too long because I built them based on a measurement I got from another website that was incorrect, but made sense at the time. For the next set I clamped and taped the top skin to the bottom while I had the bottom skeleton clamped to the wing. The aileron was already mounted and a string line stretched from one side of the wing stand to the other, parallel to the aileron trailing edge. I adjusted the top flap skin until it matched exactly all along the run and match drilled through a few ribs to secure the position.
That was how I did it the 2nd time. I think the RV4 and RV6 flap are the same.
So the question for you is do you have 10.5 inches as the answer to the measurement? My first flaps were built to a different measurement of 11.25 from trailing edge along the bottom to the forward edge of the flap skin. That was 3/16 too much on my setup. By the way, Vans advised me to look the other way and said that's why flaps are down so much on the ground, to hide that mismatch. Ha ha, but I wasn't laughing.
I think you can squeeze 1/8 or so with your situation, but you soon get into edge distance issues with the flap brace riveting, and skin-to hinge eye interference with full deflection. One respected builder here suggested I consider moving the ailerons back 1/8 inch by putting a spacer under the mounts. I didn't do that but it was an interesting option.