Although it sounds like you're opposed to using spacers, that's what I did. It wasn't much work and the results came out great.
Before (notice dished in areas at rivets):
Rivets drilled out and shim thickness determined (0.032 on top, then down to 0.025 and 0.016):
Shims drying on the priming rack (I made a few extras):
After shimming and re-riveting (used a half length longer rivet than original):
Good luck!