So the title is the problem.
Specifically, I had 2 pawns inside that can't be ejected so I tried to demolish it but the demolition bar just keeps refreshing. So yep, that's it.
I tried melee attacking it but the hp drops to zero but still persists. It is repairable too, from zero to full hp.