I run a mill file down the edge to smooth it out.
Then (usually) I'll swipe each side of the edge with one of these. (But it's really not necessary - just habit.)
http://www.averytools.com/pc-74-43-r...burr-tool.aspx
Then I put a 1" Scotchbrite wheel on a die grinder and run it down the edge. I like to try and get a groove worn into the wheel and let the aluminum ride inside the groove.
Usually you can crank up the PSI and wear a groove pretty quickly, then back off to a lower PSI and the groove will hold up without wearing too quickly.
End result is a smooth edge and the effort involved is pretty minimal. Assuming you're dealing with mainly straight edges, you can have the entire part deburred in less than 2 minutes.
Give it a shot and see how it works for you... You'll find your own method though; everyone does. This is just the one that works best and quickest for me.
Phil