Evaluating judging performances and ongoing training/testing
As with the procedure for choosing and originally training judges, the amount of ongoing training or scrutiny they receive varies pretty substantially from state to state. Generally speaking, there is no requirement for judges to be tested regularly or be forced to undergo regular training.
In New Jersey at least, training is made available to judges. There are both mandatory and optional seminars, and judge performances are reviewed after events. Nick Lembo details the procedure in New Jersey:
A post event analysis is typically made of officiating decisions. You have to continually evaluate your officials. Judge performance is rated after each event and also is reviewed on an annual basis when licenses are to be renewed. As an aside, MMADecisions.com is a useful tool to track judging scores.
Training is a key component. Attending ABC reviewed training courses and athletic commission seminars can be beneficial. Training is a big slice of the pie, but definitely not the entire pie. You could take several training courses and still not perform well under the pressure of a live event. We donít want the best test-taker, this agency wants the individual who can perform best under fire.
I like to continually train by providing videos of a round in an actual contest. I like to show specific fights and talk about whatís going on in that fight. I like to show fights that feature a contestant utilizing an active threatening guard and that you should be able to score points from the bottom; rounds that are clear 10-8's; rounds that are lively and highly competitive, and rounds where hardly anything happens.
There is a lack of cohesion among states in terms of the scrutiny they place their officials under and the standards they are expected to meet, both in training and in practice. Rob Hinds finds this problematic:
That's one of the major challenges with officiating; training is only sometimes required, and sometimes it'll be required, but once you're trained it could be five or ten years before you get trained again, or you may never get trained again. One of the challenges we're seeing with experienced officials is that they haven't been updated on the sport or the rules in years.
More than the system, more than the rules, more than anything else; itís the officials at different levels not being on the same page. In baseball, umpires strike zones may be a little bit difference, but ultimately, there's a guideline there. With combat sports, there's no specific guidelines anywhere.
Exactly how fights should be scored is perhaps the most controversial aspect of judging. Thereís little agreement about it among fans, and that extends all the way up to officials. The guidelines provided by the ABC about what constitutes a 10-10, 10-9 or 10-8 rounds are pretty threadbare, and itís left up to the people training the judges to fill in the gaps. While the ABC reviews and signs off on the materials and tests the trainers use, there will still be some inconsistencies between individuals. Worse, because some judges receive their assignment after establishing themselves as boxing judges, their view on how to score a round will be completely different from someone who received specific training. Rob Hinds had this to say:
The written unified rules that you see on the ABC website, not only are they outdated and not updated, but itís a blanket statement. You donít see any other rulebook in any other sport that doesnít have great detail about everything. What the ABC does, is they recommend those general rules, and then itís up to us, the trainers, to go out there and train the officials on the details, like the definition of a 10-8 round, and going into more detail about what a 10-10 round really looks like, and all of those things.
Itís a great disservice for nobody to explain to the fighters exactly what's expected of them with a 10-9 round, or a 10-8 round. You have somebody like a Rich Franklin, who will tell you, ĎMy whole career, nobody has ever explained to me what the difference between a 10-9 and a 10-8 round is. Everybody has an opinion on it, but hardly anybody has the true definition of it.í
Nick Lembo made the point that fighters and their trainers are allowed, at least in New Jersey, to ask to see the official score card for fights and to have the scores explained. He also noted that the ABC is currently looking into providing a better definition of a 10-8 round:
Fighters and trainers should already be very familiar with the scoring system and criteria. If they are not, they should become familiar with such. After the fight, fight camps can ask for the official score card and an explanation of the scoring. Prior to the fight, fight camps can question the selection of the judges or file a protest. The ABC is currently working on the possibility of providing judges with an improved definition of a 10-8 round.
The definition provided by Nick Lembo of a 10-8 was very similar to, but not exactly the same as, the definition provided to us by Rob Hinds. While Rob was very specific about a 10-8 round generally requiring one fighter to dominate the other for the majority of the time, e.g. more than three minutes of the round, Lemboís detailed definition did not specifically focus on the time, but on the dominance and impact of one fighter over the other during the round as a whole.
The fact there are differences such as this even among some of the most educated and high level officials in the sport suggests to me that an improved definition of a 10-8 round is really something of a necessity at this point.
We've established that some of the problems in judging are systemic; the lack of a truly unified recruitment and training program, and the differences between states in the quality of training and support they are capable of providing. Sometimes though, the problem is just that a judge doesn't have the knowledge required to accurately evaluate the outcome of a mixed martial arts bout. What happens then?
As with almost everything, the exact procedures vary from state to state. Nick Lembo explains New Jersey's procedure:
There are judges that we have never used, or stopped using either temporarily or permanently.
[If a judge is under performing] we have compelled required training and forced additional shadowing. There will always be controversial calls in combat sports, as well as in non-combat sports, no matter what scoring methods are utilized. We also need to understand the difference between variance of opinion in closely contested fights versus incorrect judging. I do believe that you have to replace judges who are no longer capable of providing quality scores on a consistent basis. The selection of judges needs to be closely scrutinized. We owe it to the fighters to put the best qualified judges out there.
Half Point System & Other Fixes
There have been a few things suggested to help improve the issues surrounding judging in MMA. One of the largest problems, in my opinion, is the huge variability in a 10-9 round. A 10-9 round encompasses everything from one fighter landing a couple more punches than the other, to a fighter landing dozens more punches and threatening with offensive grappling for much of the round. To combat that, Doc Hamilton proposed a half point system, which I feel would help improve the situation in fights like this.
Nick Lembo gives his opinion on the half point system:
First, I must open by stating that I do not think that any scoring system can achieve perfection. Any system needs to be applied by individuals who are subjectively interpreting the action and applying what they see to that system. There will always be controversial and even regrettable calls in sport no matter what scoring systems are in place.
For the half point system, I believe that the trials done were sufficient in scope. I don't believe that a switch to that particular system would be a prudent move at this juncture. I'm not in favor of putting in a system that's even more difficult to figure out. Let's focus on getting the 10-10, 10-9, 10-8 and 10-7 right and see how that works before we start with half points and having to debate was that a 10-9.5?, or was that a 10-10?. Was that a 10-8 or a 10-7.5 ? The half point system just makes it more complicated. The key right now is to get a consistent application of a 10-8 round where warranted.
There are other commission representatives that are very experienced in MMA. Jeff Mullen of Tennessee was a UFC Judge for some very historic contests. Andy Foster of California has significant cage time experience and practical training knowledge. Bernie Profato of Ohio oversees more MMA bouts on an annual basis than anyone in the nation. Keith Kizer has long standing experience overseeing the highest profile and most closely scrutinized contests ever held in the sport. We all seem to be on the same page on this subject matter.
Rob Hinds felt that while the half point system would be useful in limited circumstances, the other problems surrounding judging would overwhelm any improvement they may bring:
Would something like a half point system be helpful? Yes. If that closes the gap between a close round versus a clear round versus a partially dominant round versus a completely dominant round, whether itís 10-9.5, or 10-8.5, whatever that looks like, that would be helpful.
What it ultimately comes down to, is the proper training of the criteria, and the proper training in assessing what is a completely dominant and damaging round. I think that has more play than the numbers system, but that half point numbers system is helpful.
Nick Lembo brought up another potential improvement he would like to see:
Sometimes I wonder if judges should be in noise proof rooms watching without sound on high definition big screen televisions, because high level televised promotions usually give you the perfect angles while sitting cage side may provide obstructed or limited viewpoints.