Well, there is the old rule "Never rivet anything until you HAVE to...."
I may have removed mine once or twice late in the game - it's hard to remember why - or predict why you might. Then again, you can probably work around it if you have to - or drill it out if you have to.
Paul