It might look like an unintended consequence but for people with some professional background giving them some understanding how scoring scales work it was obvious from the very beginning that changing the system from +3/-3 to +5/-5 would introduce much more subjectivity and would give judges much more arbitrary influence over the results.
I'm not so sure.
Remember, with the +3/-3 scoring it took 2 bullet points to earn each +. (Although then, as now, the guidelines were presented as "guidelines" rather than firm "rules.")
So there would have been differences of opinion about whether an element for which a judge saw 3 strong points, for example, should earn +1 or +2. But according to the guidelines most judges would have given +1. And that meant they would have given the exact same mark as judges who saw only 2 strong points. And maybe even an occasional judge who saw only 1 but thought it was strong enough on its own to merit a +1.
There were differences of opinion among the judges -- most of them subjective because qualities being considered "good" or "very good" can only be assessed subjectively -- but the way the scoring was defined those differences were flattened out into the same score. Which wasn't fair to the skaters who really did have elements with 3 strong qualities but had to earn the same GOE as skaters who only had 2 or even 1.
Even if all the judges were in complete agreement that Skater A's axel, for example, deserved 2 bullet points and Skater B's deserved 3, according to the guidelines if strictly applied both skaters should have received the exact same score (+1) for their axel. With the +5/-5 range, the two jumps should receive differnt scores.
With +5/-5 there's more room to show the gradations based on how many individual bullet points each judge thinks the element deserves. There isn't more subjectivity in what the judges actual see than there was with +3/-3, but we get to see the effects more clearly, e.g., the differences between which judges thought the element deserved 2 vs. 3 bullet points.
On the other hand, each type of element now has mandatory bullet points that must be present for a judge to give +4 or +5 ("effortless" being mandatory for all element types). Therefore, there are many strong elements that can only earn +3 even if they meet 4 or 5 bullet points but are missing one of the mandatory ones. So there are still going to be a lot of +3s for elements of different overall quality.
Something like "very good height and distance" for jump elements or "good speed or acceleration" might be measured objectively someday, although for now they can only be determined by each judge's mental benchmarks for where they draw the line between "good enough" and "good" or "very good."
But most of these bullets are subjective by nature. There will be differences of opinion, and that's why there are 9 judges and not only 1, or 3.
That subjectivity was always there under 6.0 judging and with +3/-3 GOE scoring. Now we get to see the finer-grained differences of opinion, but ultimately it's the average that determines the final GOE.
It would also further promote the most costly elements, i.e. quads, because of the way GOE was to be calculated since
That is true. The penalties for failure are larger than with +3/-3, but the rewards for success are also higher.
Exactly. Giving more leverage to the judges might have appeared to favor one specific skater or a group of skaters or address some concern (such as artistic skaters or non-jumping elements are not appreciated enough), but someone else have benefitted or lost out in this change. Hence, unintended consequences.
I don't think the intention was ever to favor a specific skater or group of skaters. Perhaps to favor specific kinds of skating (which might be associated with specific skaters and how they were performing recently as handy examples of what the technical committee wanted to favor).
Personally, one unintended (or intended) consequence that I do not want is enshrining an individual or a team as unchallenged entity independently of how they skate at this specific moment of time, in this competition.
Neither do I.
Allowing judges to reflect their real-time assessments in finer detail is not a way to "enshrine" individual skaters or teams as unchallenged.
I think I've made this point before some time ago, but here goes. I'm not sure how judges can look at the same element and have such a disparity of GOE. Now, of course it doesn't happen all the time, but if you really look at protocols as I tend to do, sometimes it paints a very odd picture. I'm not sure how a judge can look at an element and score it +3 and the judge right beside will score it -1.
If you have this (let's assume honest) difference of opinion among judges, then there is no conspiracy to have all judges give the same high scores, because some of them are giving different scores.
If all judges do give maximum scores, maybe it's because they all got together beforehand and decided for political reasons to prop up that competitor. Or because that skater had won so many times before with excellent elements that judges expected excellence and were more inclined to see it and reward it even on occasions when a specific element might only have been just "good" to an observer with equal expertise but less familiarity with that skater's past accomplishments. Or maybe it really was just that good.
I wish we'd get to the point, theoretically, where a knowledgeable analyst might say, "Triple Flip. Nice transition in, correct edge taking off. Off axis in the air, wobbly landing but pulls it off. Fully rotated, but not much runout. Good, not spectacular. Should score 0 to+1." And that's what the protocols would show. I mean, I wouldn't want all that chatter during a program, but you get the idea - there would be consistency in scoring the individual elements because the standards would be so broadly understood.
As you note, there are reasons why we won't get that kind of commentary during figure skating performances.
If it comes down to a close call with GOEs on a specific high-value element making a difference in the results, some broadcasters might do an analysis after the fact to analyze where the winner gained points on that element and where the runner-up may have lost points on the comparable element.
But one element rarely tells the whole story.
It would be nice if there could be pre-game (or during-resurface) features during live events to point out what kinds of things judges are looking for on specific elements. For fairness, I'd prefer to get a judge not on the panel in to analyze elements by specific retired skaters -- not anyone entered in the current event.
Some TV commentators are more knowledgeable than others about how judges come up with GOEs. If we're going to get former champion skaters hired for their name recognition and personality to make those explanations, they'd better be well trained in judging standards.
For now, most analysis tends to focus on the tech panel calls. Which are more objective by nature.
And the focus also tends to be on jumps both because they tend to make the biggest difference to the point totals and also because they're quicker to rewatch. A tech panel might review a whole spin in slow motion, but broadcasts don't usually show whole spins even full speed in replays because of the time they take, in addition to the fact that the level calls don't have quite as big an impact on final scores.
But if we want educational features to show viewers while waiting for the actual competition to take place, a feature on what specific spin features are and how they're determined (tech panel calls) and perhaps another on what judges are rewarding and penalizing in their GOEs could be informative.
Still, there's no way there would be time for commentators to analyze individual elements in that kind of detail during the performance, or more than one or two during the replays while waiting for the panels' scores.
I'd just be happy if broadcasters would display the URLs where audiences would be able to find protocols after the fact so they can see exactly how elements were called and rewarded/penalized in more detail than the scoring boxes shown during the performance, and so they could rewind and the scoring boxes during the program to the final protocols, including significant changes in calls (and often resultant GOE) that commentators might have predicted but didn't have time to analyze.
Although in pairs twists and lifts are also big point-getters that might inspire such analysis.