I guess the question I am wrestling with is this.
Suppose the ISU comes up with some additional words to add to the present explanation of the Interpretation component. Would that make you and your colleagues better judges of this component than you are now?
Suppose they made you go to some extra seminars to hear lectures about what it means to be "musical" in the context of dance. Will that help you be more consistent and confident the next time out?
According to gsrossano's post about his/her personal communications with judges, they may not have a common understanding of each definition. As discussed, each term seems to mean different things for different people. So I think that it would help if they have seminars or something so that they could be clearer what each component really means. I think it better if each judge can stick to the ISU definitions regardless of their personal definitions.
I also think it better if they could make each component simpler. Right now, each one looks really crowded with many different concepts. If they wanted to make it comprehensive, they should have divided them into more compoments so that each component has just one concept within each.
Personally, I am not upset about the fact that different judges weigh certain aspects of a performnace more heavily than others. As Abaka puts it above, "There are many different ways to achieve a great performance." It does not seem so terrible to me if this spirit is reflected in a disparity among the judges' marks.
Sorry I feel a little confused. Based on our discussions, I understand that you think detailed analyses are ovbiously important.
Yet, if I understand you correctly (please correct me if I do not), it sounds like you are suggesting that you would not like to have the system to dictate the judges how they should conduct detailed analyses and that the system should allow the judges to have some levels of flexibility. Then the judges could weigh different aspects of a performnace according to what they perceived was significant in the given performance.
Based on your earlier discussions as well as this one, I guess that you may be referring to the idea that the whole is greater than the sum of its parts (correct me if I misunderstood you). I also heard your concern that the current system may be trying to quantify a performing art that is supposed to be all about the quality.
My questions are as follows.
First, I myself do not have any trouble with disparity in marks by judges. But another problem we are seeing is that all the PCS scores are too highly correlated, which suggests a paucity of detailed analyses. So I am not sure how this will be addressed without using the criteria more clearly.
Second, the criteria listed in PCS are mainly concerned about the "quality". Because each criterion is applied to the whole performance, it's not like chopping the performance into pieces as you do with the tech elements. So I wonder if a clearer use of five components enhances quantification of performing arts any more than the use of presentation mark under 6.0 did. Sure, you can't just say that I thought that A was better than B as you did under 6.0 (i.e., Ordinal judging). But I do not think that providing more detailed analyses by using five components marks more discriminantly would change the result if A is really better than B. Because as we agreed before, a good performance should be worth analyzing in detail.