No problem at all. Just be sure to use aircraft grade RTV. Some RTVs react corrosively with aluminum. It should indicate on the tube if it is safe on aluminum.
An alternative that I'm using on some of my thin bulkheads is to replace the plastic bushings with rubber grommets. They hold in much more firmly and provide a firmer hold (and provide cushioning) for the tubing or wiring. They can be ordered from Spruce in many inner and outer diameters.