Rivets are shear fasteners, not tension fasteners. As such, the holes have to be sized properly, but the rivet expands when it is driven to fill the hole. As a result, the hole does not need to be more accurate than what a drill can achieve.
Bolts, however, are primarily tension fasteners. In airplanes, however, they are many times used as both tension and shear fasteners at the same time. Since they don't expand when driven, because they aren't driven, they need very precise holes to make sure that the shank of the bolt is in contact with the edge of the hole in the stackup of materials being fastened together so that they can properly perform the shear function. As a result, a reamer is required to get the proper hole precision.
There is no problem with using a reamer for rivet holes, it just isn't necessary. On the other hand, bolts in airframes should be in holes made with reamers.
Make sense?
Tim