senior judge told Jackson with large fields of sometimes unknown skater, it is best to attend all the practices, find out who is good and who isn't, and to put skaters into groups, such as skater A has a skill of 10th to 15th. With large field's, that was a way of separating the various skills when one had adequate time, while during a competition, there is a very limited time to make many numerical judgements.
Here's the description from Jackson's book:
He came with me to the practices, analyzed the skaters, and explained to me the manner in which to put the skaters into groups based on what we saw at the practice. This method of judging is quite common, and begins to set in the minds of judges just how the event will come out. It's very sefl-fulfilling, and this is how it works:
Based on the practices, of which one is encouraged to get to as many as possible, a judge begins to set a ranking of how the skaters will likely come out. Skaters are assigned to A, B, C, and D groups, based on how well they perform, and thedifficulty they are executing, in practice. As the week progresses, and more practices allow for further analyzing, pluses and minuses are added. Between practices, while in the judges' hospitality rooms, and at the cocktail parties held during the week, this "grouping" is discussed, with a general consensus reached even before any of the skaters has taken officially to the ice. This is commonly known as "chatter."
Of course, when the actual skating takes place, the judge must judge what is skated, and these groups just give a general guideline to help the judge get through the event. At least that was the argument made by Steve. It seemed to smack of prejudging in every sense, and gave plenty of opportunity for powerful judges to lobby less powerful judges to push up or push down a certain skater.
Here's a similar description by Canadian judge Frances Dafoe in Debbi Wilkes's book
Ice Time, published in 1994:
Frannie says she has to do homework to familiarize herself with the program, the music and the kind of skater she is seeing, as well as to guard against a one-shot wonder. "You'll never see me in the arena the day of the competition and rarely the day before. I go a couple of days in advance, have my look, then get away from skating, so that when I go back I've got fresh eyes. The level of their basic skating ability is what I look at. I put them in units of A, B, C, and D. Those skaters can move up and down or all over the place, but i also have to leave enough space that if somebody from the A unit falls all over the ice and moves down to a C and somebody from a C unit is absolutely brilliant and moves up to the a, there's a spread to take care of all these eventualities. All you'll see on my sheet is 'A-AB-C?-maybe D.' What it does is familiarize my own head with the level of skating ability. I know those programs so well that I know the difficulty of the elements. The top skaters have the most difficult elements. The only thing I'm looking at is the difficulty. I'll make notes of what the elements are and where the critical breakdown factors could occur. Those are their futures out there and you want to make damn sure you know what they're doing."
Used honestly and responsibly, watching practices to note what skills each of the competitors are showing and getting an idea of how many skaters to expect in the top (medal contender), high-middle, low-middle, and bottom skill ranges for that competition would be more useful under 6.0 scoring than having all the judges see all the skaters for the very first time during the competition (except the ones they happened to know already from their home countries or home clubs or other previous competitions). At least you wouldn't get a situation of a judge expecting a lower or wider overall general skill level in the event than proves to be the case and marking the first couple of skaters so high or so close to each other that there's not enough room in the numbers for that judge to rank the rest of the skaters in the order the judge thinks they deserve.
Used carelessly, it could result in well-meaning judges inadvertently closing their minds to the possibility of skaters performing much differently in competition than in practice and marking what they expected to see rather than what's actually put in front of them during the competition.
Used dishonestly . . . well, no need for judges to even watch the competition if they've made up their minds beforehand.
Still, judges are human beings, and it's human nature to see what you expect to see. I think the 6.0 system was more vulnerable to that problem than IJS, but I don't think it can be avoided entirely as long as human perceptions of quality are at the heart of the scoring process.
^ one of the things Cop promised to fix was the supposed disadvantage of skating early. So far it has failed in that regard. (IMO)
Has it improved that problem at all? Made it worse? Stayed exactly the same? I guess we'd have to do some sort of large-scale statistical to know whether there's been a change one way or another.
Certainly there are examples, under both judging systems, of skaters skating early and receiving lower scores than expected or than comparable performances in later groups. There are also examples under both judging systems of comparatively unknown skaters skating early and earning scores or placements just about what they would have earned in the same field with a different skate order.
Mirai Nagasu in the short program at 2007 Junior Worlds, her first international, is one classic example.
http://www.isuresults.com/results/wjc2007/SEG002.HTM
Possibly her actual scores would have been higher if she had skated in the second half of the draw instead of 24th out of 52, but the placement probably would have been the same.