- Joined
- Feb 27, 2012
ISU experiment: dividing tasks among judges??
(Did another thread already have discussion of this experiment? Sorry if I missed it. In any case, I am going to add a post to the existing Nebelhorn thread.)
@_David_Molina (who is an ISU judge)
Oberstdorf Sept 25: ISU will explore a new way of judging #figureskate by sharing tasks between judges eg eval 3 PCs out of 5, or GOE only..
5:46 AM - 3 Jul 2014
https://twitter.com/_David_Molina/status/484679575344283648
5:46 AM - 3 Jul 2014
https://twitter.com/_David_Molina/status/484679575344283648
(Did another thread already have discussion of this experiment? Sorry if I missed it. In any case, I am going to add a post to the existing Nebelhorn thread.)
ETA, I see that the Nebelhorn announcement has more information.
ISU Test policy:
Page 7 of the Nebelhorn announcement has a chart showing a sample configuration of how individual judges would take on different sets of responsibilities.
Two of the skating disciplines (Men and Ice Dance) are to be judged by the panel formed in the way described below:
Prior to the test a questionnaire will be prepared by the committees to evaluate the opinions of the judges used for the test. The success of the test will also be measured by the opinions of TC Members and Sports Directors and a final report will be sent to the ISU Council.
The two judging panels will be selected by the Technical Committees and will be trained at a one-day seminar before the start of the event.
The panel will consist of 12 judges
The panel will consist of 12 judges
GOE is evaluated by 5 judges
Four of these 5 Judges also evaluate one component different from the components evaluated by the other of these 4 Judges
The 5 components are also evaluated by the remaining 7 judges
The final result is calculated according to the current ISU system using the trimmed mean of the GOE and components scores. Four of these 5 Judges also evaluate one component different from the components evaluated by the other of these 4 Judges
The 5 components are also evaluated by the remaining 7 judges
- Each of these 7 judges is evaluating only 3 components
- The assignment of these components is done so that each component is finally evaluated with 5 scores.
- The assignment of these components is done so that each component is finally evaluated with 5 scores.
Prior to the test a questionnaire will be prepared by the committees to evaluate the opinions of the judges used for the test. The success of the test will also be measured by the opinions of TC Members and Sports Directors and a final report will be sent to the ISU Council.
Page 7 of the Nebelhorn announcement has a chart showing a sample configuration of how individual judges would take on different sets of responsibilities.
http://isuprod.blob.core.windows.net/media/155904/nt2014_announcement.pdf (twelve pages total)
ETA:
Thx to Mathman for figuring out how to convert the chart within the Nebelhorn PDF to a version that is compatible with the limitations of GS formatting.
...Here is the proposal for the tasks of the twelve judges, which will be tested at Nebelhorn.
Judge #1 SS TR PE
Judge#2 TR PE CH
Judge #3 PE CH INT
Judge #4 SS TR CH
Judge #5 SS TR INT
Judge #6 SS PE INT
Judge#7 TR CH INT
Judge #8 GOEs and also SS
Judge #9 GOEs and PE
Judge #10 GOEs and CH
Judge #11 GOEs and INT
Judge #12 Just GOEs
This way each of the five program components is evaluated by five judges, and GOEs are judged by 5 judges also. (Too bad the math worked out so that there was one GOE judge left over with no component to judge -- TR already had five judges. Oh well, nobody's perfect.) ...