They could have just cast Vaan and Penelo aside after Bhujerba events, since Vaan proved to be too careless for exposing their identity. The resistance needed all help they could find but should have alocated Vaan to smaller tasks, keep working in Rabanastre under Old Dalan or something. But for the course of events to follow the main plot as it went, the group should have had a better reason to keep Vaan like an exceptional combat capability or unique role such as Balthier strategy or Fran knowledge. Honestly, deep inside they just wanted the fun guy to tag along

He may be useless to the Story perhaps but hes the strongest character in your party if build right so yea :D

One thought though, if it wasn't for Vaan Balthier and Fran would have taken the stone and probably not run into Amelia. Meaning She would have been captured. He may be irrelevant to the plot but without him the plot would have stopped in the first 3 hours of game play.