To chime in, I've had this occur before. Culture flipped a planet, and all ships at that planet left, but a different civ's freighter was stuck there and wouldn't let me in without destroying their ship (and declaring war) over several turns. It was fine with me, as I wanted to war that civ anyway, so I ended up destroying the freighter... but certainly a bug.