You can get deburring bits from Avery and Cleaveland (and others). It's essentially a countersink bit but it comes to a sharp point instead of a pilot. Avery has a deburring kit, I think, that has a couple of bits, a handle, an extension and the cordless drill attachment....maybe I'm wrong about the kit, but they certainly have all of the pieces.
That bent thingy you have doesn't work very well for drilled holes...it's better on lightening holes, edge of sheets, etc...