I agree with the opinions to leave things be. Throwing more "judges" at the problem just muddies the waters and makes the process more drawn out. "Maybe" pick a few contributors to use as sounding boards or tie breakers when/if you guys get stuck but, other then that I think you have been doing a good job.
Did you ever think the site would get this big when you started it?
Mark