Myron,
Most likely you did not get the machine countersink deep enough to accept the dimple. The strength of those two parts is in a critical area and depends on the two parts being riveted together without a gap. So, my suggestion is to drill them out, make yourself a little go/no go gauage using scrap aluminum out of several different thicknesses of material. Drill and dimple all the normal hole sizes, #30, #40, #19 etc in each thickness. When it comes time to set your countersink start small and work up to the correct size a few detents at a time until your guage fits in the countersink enough to allow the metal to sit flush but no so much to allow the dimple to wiggle in the countersink. Make sense?
Look straight into the two parts, if you can see light, you need to correct them. If it's only on the very edge, then I still think your countersinks are not deep enough or are not uniformly deep enough. One tip, make sure you keep the countersink cages clean after each cut, chips will allow the depth to shallow as they gather under the snap ring inside the cage which will not allow the cutter to fully go to the set depth.