CherryMax rivets are way different from the commercial LP series pop-rivets.
Textron has a grip range of about 1/16 total for each rivet length.
The full specifications are here....
http://www.textronfasteningsystems.c...42-5M-1003.pdf
Page 8 is a good example of grip lengths,
and there is a definite maximum and minimum grip length.
Vans reply was wrong in this case. I would calculate the thickness that you riveted, and check what rivet you used. If you have really good eyesight up close....

...you can read the grip length that is stamped on the head.
If you put in the wrong length, I personally would not rely on the "pull it with pliers" test, but would replace them.
This is a case of using good parts without looking at the manufacturers data sheets....
Let us know what you found out.....
UPDATE -- factoid
The Textron data sheet specifies (rather clearly) that the holes should be deburred, but have a
sharp edge.
No use of a countersinking tool to bevel the hole edges.
The appropriate deburring tool probably would be a scotchbrite pad.
gil in Tucson