Yep, it's definitely the pants themselves. With them off, the leg fairings are still on and it flies straight with the leg fairings held in alignment by the upper intersection fairings and the rectangular shape of the legs themselves. Like you said, getting the plane up off the wheels with the gear hanging down will be the best way to figure out the exact fiberglass surgery to do to the wheelpants themselves.