Are judges able to "rank" skaters while they are judging? | Page 2 | Golden Skate

Are judges able to "rank" skaters while they are judging?

janetfan

Match Penalty
Joined
May 15, 2009
The COP hasn't caught on at all in pop culture that I can see. I liked it a lot at first, when a lot of surprise winners came from behind, but now I'm not so sure.

I just checked this out because I thought it was an example of 6.0 judging from a film.

http://www.youtube.com/watch?v=HdNO0sV99ac&feature=related

Turns out it is about gymnastics, sort of, but the reference to the low score from a certain judge sure feels like figure skating. :)
 
Last edited:
Joined
Jun 21, 2003
In the longer term, it may be feasible to alleviate this bottleneck through a form of machine scoring, using digital motion capture technology and software.

When that happens I think we will all be surprised and embarrassed at the number of actual degrees of air rotation in a "triple" jump. :yes: Also at how many edge calls are missed. In general, at how badly everyone does everything. ;)

And, too, I wonder if committed skating fans shouldn't be careful what they wish for; sure, these developments might make skaters and general audiences happier, but I sometimes muse that we skating fans are a masochistic lot, and would feel positively deflated without controversial calls to parse endlessly. :laugh:

That's one thing I don't think we need to worry about. :laugh: When I watch a tennis match on TV I am constantly wuzrobbing the computerized line-calling technology. After a close call they show a purported picture of the ball landing clearly out.

Balony! That's a computer-generated virtual cartoon of a wholly imaginary flattened sphere crossing a line that exists only in the software's tangle of 0's and 1's. :cool:
 

Violet Bliss

Record Breaker
Joined
Nov 19, 2010
Competitions are about ranking. In figure skating, it's the methodology employed that is debated. The 6.0 system, of course, was strictly about ranking. There were, however, several inherent problems:

1. Inaccuracy - It's impossible for judges to remember clearly the relative merits of each of the 25 programs performed over several hours.

2. Rigidity - The ordinals were marked with fixed numbers with little room for later insertions so that much prejudging happened necessarily to leave anticipated room for later performers.

3. Easy implementation of pre-decision - The simple ranking of skaters made it easy to place any skater exactly where a judge wished to regardless of performance, because of

4. Lack of accountability - No breakdown of scoring or explanation of how the ranking was arrived at by the judges was required or offered. It was all subjective. The judges ranked the skaters according to how much they liked each one.

CoP instead measures each element and each component of each performance with points and lets the ranking happen according to the total points of each performance. There are base values as well as guideline and bullets for the more subjective GOEs and, with averages of a whole panel, the system strives to achieve a relatively fair and accountable scoring. Manipulation for total points is too complicated and difficult. The major problem and cause of debates with the CoP system lie with the PCS. (There has not been any questioning of TES scores on the CoP Scoring On Olympic Jumps thread.) Ironically that is because of its similarity with the 6.0 system. A ceiling for each component's mark makes PCS somewhat of an ordinal system again. Unlike TES, PCS may be relatively scored, comparing each skater to the others. So we are back to the problems with 6.0, except for rigidity and needing to leave room for later insertion, since marks are not simple place holders and non-repeatable.

6.0 being strictly ordinal makes it impossible to compare programs from different competitions. CoP offers such comparisons even if imperfect. Though program requirements and BVs from different seasons may differ, adjustments may be made for comparison purposes, much like economic comparisons that are inflation adjusted.
 

Krislite

Medalist
Joined
Sep 22, 2010
Completely agree with this.

-As far as the "artistic" components of PCS are concerned, which are by definition analogue in nature, they are potentially amenable to accuracy (eg comparative ranking), but are resistant to fine precision (that is to say, better by how much?). This will always be true.

-In practice, the "technical" components face similar issues (due to the real-time, high speed nature of many elements, and the very subtle and fine-grained distinctions that need to be made by human beings in the heat of the moment). In principle, however, and in contrast to the artistic aspect, the technical components should be susceptible to higher degrees of quantification and measurement than is currently the case.

Measurement: the bottleneck is the limitations of human perception. A strictly quantitative measure of rotation (3, or 2.75) is used for a triple-jump, for example, but the measuring device is the human eye and the human brain, which works qualitatively. Even with the aid of slow-motion, it's not always clear-cut. In the longer term, it may be feasible to alleviate this bottleneck through a form of machine scoring, using digital motion capture technology and software.

Quantification: As a consequence of such developments, it's possible to envision more strictly quantified definitions of many, if not all, technical elements, including jumps, spins, spirals, speed, deep edging, etc., as well as GOE bullets (speed, height, ice coverage, flexibility, et al). The current definitions, which are often neither completely fish nor fowl, are necessarily the way they are because they need to be applied by human beings using imperfect tools of measurement.

-The issues with going digital: Institutional conservatism, inertia and politics, for one. And the not inconsiderable cost and effort involved, for another. But I'm of the view that all sports will be going down this road eventually, although some of them may not yet know it. At some point, though (IMHO), such technologies will be sufficiently established in the wider sporting world, and the costs will have come down so significantly, that figure skating will find it difficult to hold out, given the benefits that it offers to such a technically opaque sport.

And, too, I wonder if committed skating fans shouldn't be careful what they wish for; sure, these developments might make skaters and general audiences happier, but I sometimes muse that we skating fans are a masochistic lot, and would feel positively deflated without controversial calls to parse endlessly. :laugh:

It's entirely possible (though highly impractical at the moment) to have motion capture system in place with numerous high-speed cameras positioned around and above the rink, all controlled by a supercomputer measuring every possible aspect of a skater's technical skills. Such a system wouldn't even have to use an aggregate points system in place like CoP at all, since by its precise measurements it could rank jump for jump, spin for spin, which was higher, faster, more revolutions, etc. If we could somehow manage to agree on how to weigh each element in a program relative to others, and of course on the proper reward/penalty for the quality of execution, then such a system could be perfectly accurate in either an ordinal or cardinal scoring method. Either way, the technical marks could never be disputed.

But that would never eliminate contested results because figure skating by its nature requires judgment of a program's artistic merits. I am of the opinion that because such judgment relies on a person's own emotional reaction and aesthetic tastes, that such artistic marks will always have some element of subjectivity. As such, figure skating fans need not worry that they would no longer be able to bicker and fight over controversial calls.
 
Last edited:

seniorita

Record Breaker
Joined
Jun 3, 2008
chances are in the 6.0 system or any system had Plushenko gotten anything but first place his nose would have been severely bent out of joint and he would have demanded his platinum medal just the same. :sheesh:
I really wont interfere in the conversation but many fans (and posters here) and some other skaters like Joubert and Lambiel -who have a small nose btw:biggrin:- have talked about holes in the new system and have expressed some judging about it. We are all used to judge anything in fs and CoP except for leaving the skaters do the same as we do all day.
 
Joined
Aug 16, 2009
As long as human beings judge skating, there are going to be problems and disagreements. But having humans judge skating is the price we pay for having humans as skaters, and for having skating at all. It's not track and field, and it never will be. Besides, isn't it fun to fulminate about who wuzrobbed? I'm still doing that over Torvill and Dean in 1994. And Usova and Zhulin the same year, same medal, same event. (Figure that one out!)
 
Joined
Jun 21, 2003
IMHO there is an unresolvable mismatch between the fundamental premise of the CoP and the heart and soul of the sport that it aspires to evaluate. Quality is not quantity.

To me, the ISU does not have a clear vision for where it wants the CoP to go. Instead, every year they look with chagrin over their shoulders to the previous season and say, "Well, we don't want that to happen again. We'd better raise (or lower) the values of quads, we'd better change they way we call and penalize under-rotations and wrong-edge take-offs, we'd better readjust the relative responsibilities of the judges and the technical panel.

Under 6.0, if you ask the Azerbaijan judge why he gave Tara a 5.9 and Michelle a 5.8, he will say, "They were both superb, but in my opinion Tara skated with greater zest and elan." OK, the guy's an idiot :), but if you are not prepared to accept that explanation then figure skating is not for you.

Now ask that same judge why he gave a skater a CoP score of 6.25 in interpretation -- without referring to the performances of any other skaters, just going by the CoP rule book.Will he say that the skater hit the right musical notes 76% of the time (75% of the time gets only a 6.00)?

Figure skating is not a measured sport. We are trying to fit a round peg into a square hole.
 

ImaginaryPogue

Record Breaker
Joined
Jun 3, 2009
For what it's worth, I tend to agree with Mathman. Of course, figure skating wasn't for me under 6.0. I'm glad it is now.
 
Joined
Jul 11, 2003
When I watch a tennis match on TV I am constantly wuzrobbing the computerized line-calling technology. After a close call they show a purported picture of the ball landing clearly out.

Balony! That's a computer-generated virtual cartoon of a wholly imaginary flattened sphere crossing a line that exists only in the software's tangle of 0's and 1's. :cool:
But you wouldn't dare question it if the ISU included the landing of jumps to be computerized for wrong edge takeoffs on the Jumbo Thon. I believe the Tech Panel has the sole privilege of watching this action for the scoring of competitions. That cartoon showing is how the Tech Panels sees the Wets, and the URs. Is that ok? Should the public see it too?
 
Joined
Jul 11, 2003
I really wont interfere in the conversation but many fans (and posters here) and some other skaters like Joubert and Lambiel -who have a small nose btw:biggrin:- have talked about holes in the new system and have expressed some judging about it. We are all used to judge anything in fs and CoP except for leaving the skaters do the same as we do all day.
But there are fans who see the CoP as divinely written. It's best to ignore that group.:rolleye:
 
Joined
Jul 11, 2003
For what it's worth, I tend to agree with Mathman. Of course, figure skating wasn't for me under 6.0. I'm glad it is now.
Not everyone thinks that way, but you are entitled to your beliefs.

My beliefs of the CoP

1. It kind of ended Collusion in figure skating
2. It answers many questions by searching the Protocols.

My disbeliefs in the CoP

1. The system is still 80% opinion and not quantifiable.
2. The system has discontinued base values for certain elements without reason.
3. The system has ignored the need for a separate Elements segment.
4. The Short Program is a test of nothing, but it is scored in the manner of the LP.
5. The Free Skate was replaced by a very restricted Long Program.

I don't know the group who arrived at individual base values. Difficult to believe they were skaters.
 
Last edited:
Joined
Jun 21, 2003
Of course, figure skating wasn't for me under 6.0. I'm glad it is now.

:) Actually, in spite of everything, I am not really against the CoP. It is an attenpt to paint a veneer of objectivity over a subjective endeavor.

An ill-fitting coat, in my opinion. But when the wind blows, better than no coat at all.
 
Joined
Jun 21, 2003
what is zest and elan?

The opposite of bleh. (OT, I just figured out how to do accents: élan :) Jessica Dubé :) )

Michelle lost due to Azerbaijan judge then? :disapp:

I was just kidding. Actually, the judges who voted against Michelle were the usual suspects: Russia, Ukraine, and France, along with Australia, Austria and Hungary. (Hey, that's cheating. Weren't Austria and Hungary one country way back then?)

Poland voted for Michelle. I think they were mad at the Lipinski and Brozyniak (Tara's mom) families for leaving Poland. :)
 
Joined
Aug 16, 2009
The only one I remember voting for Michelle was Germany's judge, Jan Hoffmann, who skated for East Germany in 1980's Olympics (and was the 1980 World Champion, I think). He supported Oksana Baiul in 1994, so plainly artistry appealed to him.
 
Joined
Jun 21, 2003
1. It kind of ended Collusion in figure skating.

I don't see how the CoP does anything to discourage collusion. If a bunch of judges want to get together and say, let's all give high scores to this guy and low scores to that guy -- how does that CoP prevent them from carrying out their plan? Get the technical specialist in on the game, and your hand is even stronger.
 

janetfan

Match Penalty
Joined
May 15, 2009
I don't see how the CoP does anything to discourage collusion. If a bunch of judges want to get together and say, let's all give high scores to this guy and low scores to that guy -- how does that CoP prevent them from carrying out their plan? Get the technical specialist in on the game, and your hand is even stronger.

It is easier to manipulate scoring under CoP than it was under 6.0.
It is also harder to get caught which is why the CoP and the anonymous judging was brought in along with the tech panel.

ISU has made it clear that politics and cheating will be tolerated. What they don't want at any cost is to get caught again at the Olympics.

Even a small child can see there is a lack of accountabilty in skating today.

If that is taking skating forward as a legitimate sport then I am the Shah of Iran. :sheesh:
 
Joined
Jul 11, 2003
I don't see how the CoP does anything to discourage collusion. If a bunch of judges want to get together and say, let's all give high scores to this guy and low scores to that guy -- how does that CoP prevent them from carrying out their plan? Get the technical specialist in on the game, and your hand is even stronger.
I wrote "kind of", and left it open for some anti N.Americans to gang up when they learn how to do it. However, I have not noticed that since 6.0 was disgraced in 2002 Olympics. However if you believe CoP does not discourage collusion, can you give examples?

Also can you tell me how to make the French Accents on an English keyboard.
 

ImaginaryPogue

Record Breaker
Joined
Jun 3, 2009
It is easier to manipulate scoring under CoP than it was under 6.0.
It is also harder to get caught which is why the CoP and the anonymous judging was brought in along with the tech panel.

ISU has made it clear that politics and cheating will be tolerated. What they don't want at any cost is to get caught again at the Olympics.

Even a small child can see there is a lack of accountabilty in skating today.

If that is taking skating forward as a legitimate sport then I am the Shah of Iran. :sheesh:

I'd argue it's harder to manipulate scoring, particularly with the technical panel.
 

janetfan

Match Penalty
Joined
May 15, 2009
I'd argue it's harder to manipulate scoring, particularly with the technical panel.

Morozov has spoken out quite clearly against your POV.

He said it used to take 4-5 and now it only takes one.

Orser said as much when he was coaching Yuna.

Carroll got into a loud shouting match last year at Natls blasting the US tech panel for favoritism.

Mishin claimed there was a N. American conspiracy against Plushenko last season.

Why should I beleive you as opposed to leading players in the skating world?
 
Last edited:
Top