With two people it works, but isn't balanced, and with more than 3 people you'll have some crazy randomness, also unbalanced. For larger parties,...
My current policy is to only put them in there if they've been my avatar... he's up next : )