I've had precious little success removing chatter marks from a countersink with the fluted cutters that Rick mentioned. I
have had some success using the single-flute variety, similar to these:
http://www.cleavelandtoolstore.com/p...sp?number=CCSF
I've heard that there are also some 100-degree countersinks out there made with PermaGrit (but a cursory search didn't reveal any at Avery or Cleveland).
Given a choice - meaning that if all three styles were readily avilable in the tool box - for this operation, I'd reach for the PermaGrit cutter first, the single-flute countersink (or de-burr) second and the multi-flute variety last.
As an alternative, I'd make a new hole in the guide block, clamp it
securely in place, lube it up and use high RPM & very low tool pressure / feed speed to clean up the chatter. Then final-size the hole and countersink.