This loose organization of vagabonds and wanderers is the place where a lot of martial artists end up. Their focus on fighting and rivalries leaves many people unprepared and unwilling to deal with modern day issues like mortgages, credit, and nine-to-five jobs. The Beggar fraternity is a group of mutual support for deadbeats, basically.
They're not all bad though. The Beggars do earn a bit of respect (and money) by occasionally driving away criminal gangs or otherwise helping out people in trouble. They may be broke and easy-going but they're not evil.