Well, since you love them, you need to side with the NCR, form an alliance with them, and then the Followers' influence will grow, while in independent Vegas they will be bogged down at the Fort and forever tormented by their inability to effectively help people.
What factions would there be in a post-apocalyptic HeroesWorld?