All you had to do was follow the yelling, in a clearing not far from town you find four scantily clad women arguing.
Fighter:
Crossing her arms under her chest, unknowingly showing off their size,
"For the last time, we aren't seducing the bandit chief."
Dark Elf:
Rolling her eyes,
"I'm not saying we sleep with him, or that you could, just that I could distract him with my charms while you lot kill him."
Mage:
Blushing at the thought of seducing anyone,
"That's not necessary, I know some illustration magic, I could conjure a dog doing backflips, that's distracting, right?"
Paladin:
Breathing heavy and blushing,
"Me, seducing a big burly man? I bet he had such big and rugged hands, that his calluses would be so rough against my soft skin."
The only bandits in the area are the ones you were hired to remove, they may be crazy, but the women do seem capable, and five warriors are more likely to win than just you.