Fan Proposal: The New 10.0 System | Golden Skate

Fan Proposal: The New 10.0 System

draqq

FigureSkatingPhenom
Record Breaker
Joined
May 10, 2010
Mao88 asked in an earlier thread: "If you could change one thing about figure skating, what would it be?"

Now, there are plenty of things I would change, like removing the anonymity of judges, having multiple judges marks for technical levels, and condensing the program components. But if I had to pick, it would be how marks are reported to the public. Many viewers outside of figure skating (and some that are on the inside) have little idea how to interpret these marks, and the current system condenses all the unbiased and biased marks together into one number that makes it seem as though there is no bias at all.

The New 10.0 System

Instead, I propose a new 10.0-scaled system, which doesn't change anything about the current CoP system except how it's reported to the public. The technical marks and program component marks are both reported on a 10.0 scale. This way, any changes made to the CoP system can be easily reflected by this proposed 10.0 system.

Let's take an example. Out of randomness, I chose Akiko Suzuki's SP from last year's Grand Prix Final, available at http://www.isuresults.com/results/gpf1112/gpf1112_Ladies_SP_Scores.pdf.

What's reported to the public is the following:

TES 31.08
PCS 30.22
Total 61.30

It's short and sweet, but hardly insightful and not that viewer-friendly. They would need to delve into the protocols (how many people actually do) to make sense of it all. Instead, my proposed 10.00 system turns the marks into this:

Base Value 7.1
TES 7.9 7.6 7.5 7.6 7.5 8.1 7.7 8.0 7.6
PES 7.8 6.9 7.3 7.9 7.4 7.6 7.1 8.0 7.5
Total 61.30

Figure skating audiences understand the scaled 10.0-scale system instinctively, and this makes each judges' mark extremely clear. We may not know the names of each judge, but we can clearly see if there's bias in the marks, particularly between Judge 2 who gave a 6.9 in PES and Judge 8 who gave a 8.0 in PES.

I imagine that all the TES and PES marks to be said aloud, whereas the base value and total are shown but not said. This can certainly be revised.

The total score mark has been left untouched, because ultimately that's what determines the placement of each skater at the most precise level.

How it's done:

To make this system work, there needs to be a set standard for the highest score. The world record for the technical mark in the ladies short program is a 44.70, set by Yuna Kim at the 2010 Olympics. Since we haven't seen a technical score like that in a while (and to make this example easy), let's just say that the world record is a flat 40.00.

Essentially, all that happens is that every mark is scaled to this world record. How this "world record" is chosen can be debated, but ultimately it doesn't matter as much, so long as it's relatively high.

First, let's take Judge 1 as an example, where we take the judge's GOE into full account on an individual basis:

The base value is 28.6. So in proportion to the 40.0 mark, the base value is reported as a 7.1.

ElementJudge 1 GOEPoints
3F+2T-1-0.7
3Lz00
FCSp42+1
2A1+0.5
CCoSp41+0.5
SlSt32+1
LSp42+1
Total Points+3.3
Subtotal31.9 (out of 40.0)
Reported7.9 (out of 10.0)

Taken on its own, Judge 1 would have given Akiko Suzuki a 31.9 in TES. So in proportion to the 40.00 scale, that's a 7.9 out of 10.

If a ladies skater receives a mark that's 40.0 or higher from a judge in the SP, then we see those shiny 10.0 marks shown. There's no mark higher than a 10.0 that's shown on screen or said aloud, even if the skater earns indeed a 10.3 on the scale.

However, this 10.3 still counts and exists in the background, ultimately effecting the Total Score. So just in case we have two skaters that earn a 10.0, the difference will still be reflected in what's reported.

Why use the 10.0 scale and not 6.0 scale?

The main reason is that the judges already use the 10.0 scale for PCS. Using a 6.0 scale to report it would be unnecessarily complicated. The 10.0 system also makes it look different from the original 6.0 system, to make it clear that we're not going back to that system (though of course the 10.0 scale has been used in professional skating).

So, whew! What do you guys and gals think?
 
Last edited:
Joined
Mar 11, 2011
You have some very interesting and carefully thought-out ideas! It could serve very well the general public, but a little bit complicated to see it right through, though; you have to calculate scores once more. Another thing; setting the current WR as its golden standard might be troubling since while we can say overall judging tendancy can be said to be agreable with each other, still there exists different standard and set of judges throughout each and every competition. That's why figure skating is not a record driven sport like swimming or track sports while it does have record keeping system. If we could sort this problem out, I think your ideas have genuinely valid and ideal points! :respec:
 

FSGMT

Record Breaker
Joined
Sep 10, 2012
This is a very good idea, but I think these are the good and the not-so-good things:
1) it could certainly help people "new" to this sport in understanding the judging system better: they could, at first, watch the marks and then learn how to read the details, the 6.0 was perfectly understandable for anyone, this could be a "compromise" solution between the easiness need and the required accuracy in judging;
2) the reasons you give for choosing this instead of the 6.0 system;
3) I think it doesn't solve the IJS problems, except that, making the marks public, the judges would fear giving so biased marks;
4) and there is the problem of setting the "world record" score because the BVs of the elements keep changing.
Anyway, it can be discussed, excellent idea! :yes::clap::bow:
 
Last edited:

draqq

FigureSkatingPhenom
Record Breaker
Joined
May 10, 2010
This is a very good idea, but I think these are the good and the not-so-good things:
1) it could certainly help people "new" to this sport in understanding the judging system better: they could, at first, watch the marks and then learn how to read the details, the 6.0 was perfectly understandable for anyone, this could be a "compromise" solution between the easiness need and the required accuracy in judging;
2) the reasons you give for choosing this instead of the 6.0 system;
3) I think it doesn't solve the IJS problems, except that, making the marks public, the judges would fear giving so biased marks;
4) and there is the problem of setting the "world record" score because the BVs of the elements keep changing.
Anyway, it can be discussed, excellent idea! :yes::clap::bow:

Thanks for the feedback!

Yeah, this system wouldn't solve all of the problems of the IJS (and there are several). But I'm glad you got the gist of it - a good compromise between judging accuracy and audience understanding.

As for the "world record" score being used as the benchmark, I think that the world record could be adjusted to reflect the changes. So we could take Yuna Kim's Olympic SP and rescore it based on any changes made in the GOE and the base value (with appropriate restrictions). Whatever the "world record" would be, it should probably be changed only after a particular season is over.
 

draqq

FigureSkatingPhenom
Record Breaker
Joined
May 10, 2010
You have some very interesting and carefully thought-out ideas! It could serve very well the general public, but a little bit complicated to see it right through, though; you have to calculate scores once more. Another thing; setting the current WR as its golden standard might be troubling since while we can say overall judging tendancy can be said to be agreable with each other, still there exists different standard and set of judges throughout each and every competition. That's why figure skating is not a record driven sport like swimming or track sports while it does have record keeping system. If we could sort this problem out, I think your ideas have genuinely valid and ideal points! :respec:

Glad you like the idea!

I understand the point of this making the calculation more complicated, and we know the CoP system is already drowning in tabulations. Luckily, the conversion isn't difficult for a computer, and the end result would be better for the audience and I suppose the judges as well to know where they fit compared to other judges.

I echo your concerns about the world record being used. I'm thinking something like 95% of the world record would be a good ballpark place to set it, just so people can achieve the 10.0 mark at various competitions with different judges but have it still be difficult to attain.

Maybe just as a test run, I'll see if I can use this system on the upcoming TEB event (as soon as the protocols are live).
 

FSGMT

Record Breaker
Joined
Sep 10, 2012
Glad you like the idea!

I understand the point of this making the calculation more complicated, and we know the CoP system is already drowning in tabulations. Luckily, the conversion isn't difficult for a computer, and the end result would be better for the audience and I suppose the judges as well to know where they fit compared to other judges.

I echo your concerns about the world record being used. I'm thinking something like 95% of the world record would be a good ballpark place to set it, just so people can achieve the 10.0 mark at various competitions with different judges but have it still be difficult to attain.

Maybe just as a test run, I'll see if I can use this system on the upcoming TEB event (as soon as the protocols are live).
Wonderful idea! I'll be waiting for this :agree:
 
Joined
Jun 21, 2003
Instead of a 10-point scale, what would you think of a 6.0 scale? The judges scores could be reported out like this:

TES: 5.7 5.7 5.5 5.8 5.6 5.7 5.6 5.6 5.7
PCS: 5.7 5.6 5.8 5.8 5.8 5.7 5.8 5.7 5.7

Current rank: 3rd
 
Joined
Mar 11, 2011
Maybe just as a test run, I'll see if I can use this system on the upcoming TEB event (as soon as the protocols are live).

You totally should! I think it'll be fun and once you get used to it, everybody would ease into this :D

Mathman, draqq mentions the reason to use 10.0 scale instead of 6.0 scale in his/her ideas:)

Why use the 10.0 scale and not 6.0 scale?

The main reason is that the judges already use the 10.0 scale for PCS. Using a 6.0 scale to report it would be unnecessarily complicated. The 10.0 system also makes it look different from the original 6.0 system, to make it clear that we're not going back to that system (though of course the 10.0 scale has been used in professional skating).
 

gkelly

Record Breaker
Joined
Jul 26, 2003
Interesting proposal, but it seems designed more with casual audiences in mind than what would actually be meaningful to the sport itself. I also wonder how much it's influenced by gymnastics scoring.

The base value is 28.6. So in proportion to the 40.0 mark, the base value is reported as a 7.1.

This is where you lose me.

There is a lot of detail that goes into setting the base value of the program -- the base value and the actual calls for each element. (Planned program content is irrelevant -- it only matters what the skater actually executes, although in occasional confusing situations

Knowing what the skater got credit for executing is the most valuable aspect of IJS for the skaters themselves and for anyone else who is trying to follow the technical details of the sport. Sure, it may be uninteresting and confusing to nonskaters, but if you do want to change how you report the details to nonskaters who aren't interested in learning the details, please leave the details in place for the people who do care and who are actually affected by those details. Please do not do away with the detailed protocols that give this information. They are much more useful everyone within the sport itself.

Having set values for each element that's known in advance for the whole season (although there are some changes to the scale of values each year) is also important. I don't think you're trying to get rid of it, but just to hide it from the public.

What you're proposing is to dumb down the base values as determined by the tech panel for purposes of reporting to the general public. Fair enough. I have no idea how gymnastics judges arrive at base values for routines, for example, and I can sit back and enjoy watching and get a general sense of who had a harder program without knowing the details.

You're also proposing to condense the columns of each judge's GOE added to the tech-panel-determined base mark for each skater into one score reported to public, paired with what I think is an average of each judge's five program component scores for each skater, to arrive at one technical score and one components score from each judge for each skater.

If indeed judges continue awarding separate scores for separate components, it's useful to the skaters themselves and to others who care about the details to see that broken down on the detailed protocol.

But for reporting to casual fans who are never going to look at the protocols anyway, seeing the base+GOE and average PCS from each judge for each skater gives more information than just the average total of the whole panel, which is currently all that's reported in the Kiss&Cry.

Yes, you can see which judges scored each skater higher or lower, which is interesting. It doesn't tell you what the judges' reasoning was, or give any idea who was wrong or right or biased or cheating or legitimately in the minority -- all that would be pure speculation, as it was under 6.0.

Looking at (non-anonymous) detailed protocols gives a better idea about why or where judges were marking skaters up or down, although we still can't actually read their minds.

I'm not sure what the value is of scaling the technical scores to a world record program. It will have to be recalibrated every time someone breaks the record. What happens if one skater breaks the record during a competition and earns a technical score that exceeds 10.0, and then another skater does an even harder program even better later in the same competition? Will scores greater than 10.0 be allowed? Or will those two best technical skaters be tied even though one clearly performed more/better and the whole point of competition is to distinguish between them?

Of course, if the point is just to let casual audiences know how these performances stand up compared to past performances and the 10.0 scale scores don't actually count toward the final result, then have fun, but make it clear to those casual viewers that that's all those numbers mean.
 

Mao88

Record Breaker
Joined
Mar 9, 2011
The New 10.0 System

[/U][/I]

Instead of a 10-point scale, what would you think of a 6.0 scale? The judges scores could be reported out like this:

TES: 5.7 5.7 5.5 5.8 5.6 5.7 5.6 5.6 5.7
PCS: 5.7 5.6 5.8 5.8 5.8 5.7 5.8 5.7 5.7

Current rank: 3rd

I think this is best proposal I have seen. A brilliant idea (whether as a 6.0 system or a 10.0 system). I hope someone within the ISU sees this and takes note
 
Last edited:

drivingmissdaisy

Record Breaker
Joined
Feb 17, 2010
I like the simplicity of 10.0, but you lost me when skaters can get higher than 10.0 but that score is not shown to the audience. That could cause more confusion because if someone had 10.3 but the audience didn't know that then when the LP score is factored in and that 0.3 makes a difference in placement, people are going to wonder why.

What I do like about COP is that there is no cap on the TES. It bothered me when skaters would get 6.0 for programs that clearly had imperfections, such as Irina's terrific GPF skate in 2000. Now there is no "perfect" and skaters are marked on more quantifiable measures.
 

draqq

FigureSkatingPhenom
Record Breaker
Joined
May 10, 2010
Interesting proposal, but it seems designed more with casual audiences in mind than what would actually be meaningful to the sport itself. I also wonder how much it's influenced by gymnastics scoring.



This is where you lose me.

There is a lot of detail that goes into setting the base value of the program -- the base value and the actual calls for each element. (Planned program content is irrelevant -- it only matters what the skater actually executes, although in occasional confusing situations

Knowing what the skater got credit for executing is the most valuable aspect of IJS for the skaters themselves and for anyone else who is trying to follow the technical details of the sport. Sure, it may be uninteresting and confusing to nonskaters, but if you do want to change how you report the details to nonskaters who aren't interested in learning the details, please leave the details in place for the people who do care and who are actually affected by those details. Please do not do away with the detailed protocols that give this information. They are much more useful everyone within the sport itself.

Having set values for each element that's known in advance for the whole season (although there are some changes to the scale of values each year) is also important. I don't think you're trying to get rid of it, but just to hide it from the public.

What you're proposing is to dumb down the base values as determined by the tech panel for purposes of reporting to the general public. Fair enough. I have no idea how gymnastics judges arrive at base values for routines, for example, and I can sit back and enjoy watching and get a general sense of who had a harder program without knowing the details.

You're also proposing to condense the columns of each judge's GOE added to the tech-panel-determined base mark for each skater into one score reported to public, paired with what I think is an average of each judge's five program component scores for each skater, to arrive at one technical score and one components score from each judge for each skater.

If indeed judges continue awarding separate scores for separate components, it's useful to the skaters themselves and to others who care about the details to see that broken down on the detailed protocol.

But for reporting to casual fans who are never going to look at the protocols anyway, seeing the base+GOE and average PCS from each judge for each skater gives more information than just the average total of the whole panel, which is currently all that's reported in the Kiss&Cry.

Yes, you can see which judges scored each skater higher or lower, which is interesting. It doesn't tell you what the judges' reasoning was, or give any idea who was wrong or right or biased or cheating or legitimately in the minority -- all that would be pure speculation, as it was under 6.0.

Looking at (non-anonymous) detailed protocols gives a better idea about why or where judges were marking skaters up or down, although we still can't actually read their minds.

I'm not sure what the value is of scaling the technical scores to a world record program. It will have to be recalibrated every time someone breaks the record. What happens if one skater breaks the record during a competition and earns a technical score that exceeds 10.0, and then another skater does an even harder program even better later in the same competition? Will scores greater than 10.0 be allowed? Or will those two best technical skaters be tied even though one clearly performed more/better and the whole point of competition is to distinguish between them?

Of course, if the point is just to let casual audiences know how these performances stand up compared to past performances and the 10.0 scale scores don't actually count toward the final result, then have fun, but make it clear to those casual viewers that that's all those numbers mean.

The protocols revealed at the end of each competition will essentially remain the same. It will still have the list of elements, their levels, their base values, and the individual scores for each component. Some of the 10.0-scaled marks I propose can be added for additional comprehensiveness, but the protocols remains the same. As you, I want to see the full breakdown.

This 10.0 system I'm proposing is simply for what's revealed on the TV screens and for the audiences in the ice rink. It gives a general idea of each judge's mark without having to fill the screen with too many numbers, but hardcore fans will know to go to the protocols online for a more complete picture of how every mark is determined.

As for using the world record score, I think it's best in this system to set this mark at the beginning of the season and not having it change until the start of the next season. If someone like Yuzuru Hanyu breaks the record at Skate America (as he did) and gets 10.0s across the board on TES, then I think he deserves to be able to earn those same 10.0s at all the competitions during the season, especially if he can do it consistently. Then at the start of the next season, the world record score for TES will be raised and he will be chasing the standard that he set himself the prior year.

A part of my reasoning behind this is because of how the 6.0 system worked in the past. A 6.0 in 1970 was much different than a 6.0 in 2000. What the perfect 6.0 means is to say that this particular program is perfect at this place and time. And I believe that the judges would reward that same program with perfect marks at a later competition if it was performed in the same manner. However, the following year, achieving that 6.0 would more difficult as a new standard would be set in place.
 
Last edited:

draqq

FigureSkatingPhenom
Record Breaker
Joined
May 10, 2010
I like the simplicity of 10.0, but you lost me when skaters can get higher than 10.0 but that score is not shown to the audience. That could cause more confusion because if someone had 10.3 but the audience didn't know that then when the LP score is factored in and that 0.3 makes a difference in placement, people are going to wonder why.

What I do like about COP is that there is no cap on the TES. It bothered me when skaters would get 6.0 for programs that clearly had imperfections, such as Irina's terrific GPF skate in 2000. Now there is no "perfect" and skaters are marked on more quantifiable measures.

That's true. I was thinking about how to resolve this issue because theoretically the PCS can go from 0.0 - 10.0, but the TES could virtually go from 0.0 - infinity. I think my reasoning also stems from my inclination to hear the announcer shout "10!" instead of, say, "10.3!"

But to be clear, if someone does score higher than the 10.0 in TES, that change is still reflected in the final total score. It might cause slight confusion, but I think the chances of two skaters (let alone one) breaking the world record TES score would be incredibly rare. (And if so, we would be treated to one extremely magical night of skating.)
 

yunasashafan

On the Ice
Joined
Jan 22, 2010
That's true. I was thinking about how to resolve this issue because theoretically the PCS can go from 0.0 - 10.0, but the TES could virtually go from 0.0 - infinity.

Can it, though? Would it be possible to compute a maximum possible score for the SP/LP for each discipline, assuming the hardest jumps and highest spin and step levels with +3 GOE? For example, for ladies SP, that would include a 3A, 3LZ-3LO and 3F, all executed in the 2nd half with level 4 steps and spins, and +3 GOEs everywhere. This way, it would be very unlikely to get a relative score higher than 10. For the men, and for the LP it gets a bit more complicated but we can always make assumptions based on the current level of skating. For example a 4LZ-3T and 4F with 3A in he men SP.

This maximum would be adjusted every year to reflect the level of skating and the changing requirements/point system.

I love this idea, by the way.
 
Last edited:

drivingmissdaisy

Record Breaker
Joined
Feb 17, 2010
Can it, though? Would it be possible to compute a maximum possible score for the SP/LP for each discipline, assuming the hardest jumps and highest spin and step levels with +3 GOE? For example, for ladies SP, that would include a 3A, 3LZ-3LO and 3F, all executed in the 2nd half with level 4 steps and spins, and +3 GOEs everywhere. This way, it would be very unlikely to get a relative score higher than 10. For the men, and for the LP it gets a bit more complicated but we can always make assumptions based on the current level of skating. For example a 4LZ-3T and 4F with 3A in he men SP.

This maximum would be adjusted every year to reflect the level of skating and the changing requirements/point system.

I love this idea, by the way.

The problem with this is that top level of possible score sets the bar so high that most people will start out of 7 or 8. If you do all the non-jump elements that will account for about 4 points. So there is not going to be much variation between a program with good jumps and one with bad jumps, perhaps 2 points. That small margin can be more than made up with PCS if the judges use the full range. (In other words, a perfect skate could score 7 on TES and a disaster might score 5, whereas a good PCS mark might be 9 and a poor one 4.)

It's an interesting discussion but it really is hard to come up with a judging system everyone likes. :)
 

gkelly

Record Breaker
Joined
Jul 26, 2003
The protocols revealed at the end of each competition will essentially remain the same. It will still have the list of elements, their levels, their base values, and the individual scores for each component. Some of the 10.0-scaled marks I propose can be added for additional comprehensiveness, but the protocols remains the same. As you, I want to see the full breakdown.

Good. :)

This 10.0 system I'm proposing is simply for what's revealed on the TV screens and for the audiences in the ice rink. It gives a general idea of each judge's mark without having to fill the screen with too many numbers, but hardcore fans will know to go to the protocols online for a more complete picture of how every mark is determined.

My question is whether the scaled-to-10 marks will actually be used to calculate the results, or if they're just fiction to give the fans a benchmark for how the open-ended base mark + GOE scores compare to previous top scores.

What if, in your Suzuki example, the announcement in the K&C says "Technical base value 28.6" and then lists the technical scores from each judge (31.9 from judge 1, etc., across the board) and the average (7.8) or factored total (e.g., 30.22) component score from each judge. That way you get to see two scores from each judge like we did under the old system, and they would actually add up to the real score that skater achieved. But they would be open-ended scores, not scaled to a maximum that means something different for each discipline and that can theoretically be exceeded by multiple skaters.

I understand how the 10.0 reference point is meaningful for giving fans an idea of how this performance stacks up against the best technical content ever as of last year, but I don't understand how or whether it's actually used to calculate the results. How much information that is meaningful in distinguishing skaters would be lost in the conversion -- more or less than is lost by averaging and rounding in the current calculations?

Would anomalies in how the numbers get crunched this extra time ever lead to different results if they were crunched differently?

Certainly we've seen differences in 6.0 events that were accidentally scored with the wrong tiebreaker programmed into a computer or with majority calculations used for an event that should have used OBO. And we've seen rounding errors affect the results of close contests under IJS. So whatever system is used can be subject to paradoxical results. I just wonder what the effect of the extra manipulation to the IJS numbers you want to add would introduce. Would it be possible for the results on the detailed protocols to be different from the results on the scaled-to-10 matrix? If so, which would count as the official results?

A part of my reasoning behind this is because of how the 6.0 system worked in the past. A 6.0 in 1970 was much different than a 6.0 in 2000. What the perfect 6.0 means is to say that this particular program is perfect at this place and time. And I believe that the judges would reward that same program with perfect marks at a later competition if it was performed in the same manner. However, the following year, achieving that 6.0 would more difficult as a new standard would be set in place.

The difference, though, is that in ordinal judging the judges also explicitly had to leave room for subsequent skaters, so the scores didn't always mean the same thing from one event to the next in the same season. In IJS, they should, although we know that different panels might be more or less generous.

The other thing I'd ask about your plan is how it would apply to competitions where pretty much everyone watching is directly involved in the sport or else a diehard fan who is more likely to be interested in the detailed protocols than an intermediate level of summary scores -- let's say a JGP event or domestic sectional qualifier, etc. -- and where there is no expectation of television coverage and almost no expectation of ticket sales to casual fans. Would there be any value of running the numbers through this process in those events?

Is it a change to the actual scoring system that should be used at all competitions to determine results, or just a way of presenting fake scores to fans who aren't interested in the details of the real scores but are interested in more detail than one open-ended number for TES and PCS from the whole panel?
 

draqq

FigureSkatingPhenom
Record Breaker
Joined
May 10, 2010
Good. :)



My question is whether the scaled-to-10 marks will actually be used to calculate the results, or if they're just fiction to give the fans a benchmark for how the open-ended base mark + GOE scores compare to previous top scores.

What if, in your Suzuki example, the announcement in the K&C says "Technical base value 28.6" and then lists the technical scores from each judge (31.9 from judge 1, etc., across the board) and the average (7.8) or factored total (e.g., 30.22) component score from each judge. That way you get to see two scores from each judge like we did under the old system, and they would actually add up to the real score that skater achieved. But they would be open-ended scores, not scaled to a maximum that means something different for each discipline and that can theoretically be exceeded by multiple skaters.

I understand how the 10.0 reference point is meaningful for giving fans an idea of how this performance stacks up against the best technical content ever as of last year, but I don't understand how or whether it's actually used to calculate the results. How much information that is meaningful in distinguishing skaters would be lost in the conversion -- more or less than is lost by averaging and rounding in the current calculations?

Would anomalies in how the numbers get crunched this extra time ever lead to different results if they were crunched differently?

Certainly we've seen differences in 6.0 events that were accidentally scored with the wrong tiebreaker programmed into a computer or with majority calculations used for an event that should have used OBO. And we've seen rounding errors affect the results of close contests under IJS. So whatever system is used can be subject to paradoxical results. I just wonder what the effect of the extra manipulation to the IJS numbers you want to add would introduce. Would it be possible for the results on the detailed protocols to be different from the results on the scaled-to-10 matrix? If so, which would count as the official results?



The difference, though, is that in ordinal judging the judges also explicitly had to leave room for subsequent skaters, so the scores didn't always mean the same thing from one event to the next in the same season. In IJS, they should, although we know that different panels might be more or less generous.

The other thing I'd ask about your plan is how it would apply to competitions where pretty much everyone watching is directly involved in the sport or else a diehard fan who is more likely to be interested in the detailed protocols than an intermediate level of summary scores -- let's say a JGP event or domestic sectional qualifier, etc. -- and where there is no expectation of television coverage and almost no expectation of ticket sales to casual fans. Would there be any value of running the numbers through this process in those events?

Is it a change to the actual scoring system that should be used at all competitions to determine results, or just a way of presenting fake scores to fans who aren't interested in the details of the real scores but are interested in more detail than one open-ended number for TES and PCS from the whole panel?

This 10.0 system works like a user-friendly cover for the current system. Everything is calculated using the same points system as the current IJS. It's just that scores are scaled to the 10.0 when they are announced and shown. I think that this is valuable to both fans who aren't interested in the protocols because it's viewer-friendly and fans (+skaters) who will see the protocols anyway since they give more information than just the bare TES and PCS scores.

Since all of the numbers are reduced by the same factor, the amount of information lost is quite minimal. We're talking about tenths of a point per judge. That said, the resulting Total Score isn't affected by the 10.0 scaling so people still know the precise final score.

I suppose the system could just use the actual individual scores for TES and PCS without scaling. But then in the SP, you would have technical marks ranging from 20-60 but still have PCS marked from 0-10. A part of this 10.0 system is meant to transform the TES to a scale that the PCS already uses.

Using the 10.0 reference point is meant to be viewer-friendly. I don't think a range of scores going from 25.8 to 30.8 is that exciting or even that insightful, despite being precise. Of course, I can experiment with different reporting methods. There's always a sacrifice somewhere.
 

draqq

FigureSkatingPhenom
Record Breaker
Joined
May 10, 2010
Can it, though? Would it be possible to compute a maximum possible score for the SP/LP for each discipline, assuming the hardest jumps and highest spin and step levels with +3 GOE? For example, for ladies SP, that would include a 3A, 3LZ-3LO and 3F, all executed in the 2nd half with level 4 steps and spins, and +3 GOEs everywhere. This way, it would be very unlikely to get a relative score higher than 10. For the men, and for the LP it gets a bit more complicated but we can always make assumptions based on the current level of skating. For example a 4LZ-3T and 4F with 3A in he men SP.

This maximum would be adjusted every year to reflect the level of skating and the changing requirements/point system.

I love this idea, by the way.

You're right that potentially, there is an upper maximum to what can be achieved under the current rules. It would have to consider ridiculous combinations like a 4A+4T+4T as a combo. (Or even a 5T?)

But the main point for setting the world record as the standard is that it's obtainable. Anything ridiculously higher has very little context, and every skater would receive consistently low marks for TES. I mean, the maximum for a ladies TES would be well over 60+, but even at 60, Yuna Kim's SP would just get a 7.4 on the 10.0 scale. It just makes all the marks feel deflated.
 

draqq

FigureSkatingPhenom
Record Breaker
Joined
May 10, 2010
Wonderful idea! I'll be waiting for this :agree:

I will certainly try. The problem of course is that this system is meant to be reported on the fly as the skater's marks go up. Unless I'm mistaken, we don't have access to the protocols until the competition is over... so by then, why not just look at the protocols?

Luckily, this 10.0 scaling system still does reveal bias and adds reference points, so I'll still do it. It should be fun experiment.
 

gkelly

Record Breaker
Joined
Jul 26, 2003
This 10.0 system works like a user-friendly cover for the current system.

Ah, OK. As long as it's clear that's all it is. It will take a little longer to read scores in the K&C and give some extra information about which judges gave higher aggregate scores to each skater and how the score compares to a benchmark score.
To keep up the suspense, maybe it would need to be introduced something like "The 10-scaled technical scores for this program by judge were [list of numbers] and the averaged component scores by judge were [list of numbers]. With a total Technical Elements Score of X and a Program Components Score of Y, that puts Skater A in first place."

I still think it's important in long programs to announce the standing for the long program alone as well as the overall placement. That's an area where the reporting has been incomplete and confusing under both systems.

Since all of the numbers are reduced by the same factor, the amount of information lost is quite minimal. We're talking about tenths of a point per judge. That said, the resulting Total Score isn't affected by the 10.0 scaling so people still know the precise final score.

You mean the scores could be off by as much as 0.1 per judge? That's almost a full point with 9judges, and some contests have been known to be decided by closer margins than that.

What if two skaters are so close that a tenth of a point or so in margin of error shows Skater A with a slightly higher 10-scaled score but Skater B slightly higher in the real scores that are used to calculate the real results?

If it's that close, they're probably both equally deserving. But the system has to draw the line somewhere, and even if we decided that hundredths of points meaningless nitpicking and final scores should be rounded to the nearest tenth, accepting a somewhat greater frequency of ties, we probably do still want to maintain tenth-of-point precision. But the scaling is only accurate to a full point?

The announcers would need to be are very clear that the 10-scaled scores are just derivations of the real scores that are reported for entertainment value and are not the actual numbers used to determine the results. Otherwise, if the 10-scaled scores are announced, avid fans write them down and add them up believing that they are following along with the results, and then the real scores show that someone else won, they will believe that someone pulled a fast one.

No more so than if the total scores were reported without decimal places or without mentioning deductions for falls, etc., or if the PCS factoring for disciplines other than the men aren't explained.

Arena announcers need an efficient (preferably) and consistent format for announcing scores and placements. The more they streamline it to save time, the more possibility for confusion with any system. So TV announcers should be prepared to anticipate and explain results that might seem incorrect or paradoxical at first glance. This is already an issue without introducing another layer of numbers between the real calculations and the public.
 
Top