This takes alittle finesse. Something is pinching the bearing. The bearings should have a little drag, but not be "frozen". I would start over, drill out the rivets and take a look at the mating parts again.
There was a thread sometime ago about this giving some tips on riveting without pinching the bearings.