Yeah, it'll be fine, the stem clamps the steerer and the top nut will keep everything in place anyway.
Kens idea is a good one as it will help the stem maintain a nice round shape, but there are no real safety issues running it like it is to be honest.