Depends on how strong the f/g needs to be to support what is attached with the rivet. I have used them in several areas. Vans even calls for an backing strip when rivetting on the cabin top on a 10.
Use a backing strip and when you apply the piece also bond with epoxy and micro balloons. This will help lock the rivets down and minimize the chances of the rivets wearing the glass.
Wouldn't it be beneficial to do a washer on both sides for the rivet to hold to? seems like fixing only one side would allow for it to happen to the other?