Motion tracking and figure skating

[zeit_hexe]

I wanted to post this video here, because I posted originally a long time ago, asking about connecting with figure skaters on a motion tracking project.
I ended up connecting with amazing collaborators, and eventually we have realised a real-time ice performance project that includes motion tracking of figure skaters that impacts sound.

This is an experimental ice show featuring live music, contemporary composition, figure skating, and we also collaborated with local skaters on this project.
The motion tracking is used in the second number (the duet with live voice).

So I want to thank you all for your help and advice, and also to share this for your enjoyment.

 

[DizzyFrenchie]

I wanted to post this video here, because I posted originally a long time ago, asking about connecting with figure skaters on a motion tracking project.
I ended up connecting with amazing collaborators, and eventually we have realised a real-time ice performance project that includes motion tracking of figure skaters that impacts sound.

This is an experimental ice show featuring live music, contemporary composition, figure skating, and we also collaborated with local skaters on this project.
The motion tracking is used in the second number (the duet with live voice).

So I want to thank you all for your help and advice, and also to share this for your enjoyment.

Thank you! Is there a voiceover? I should get better earphones...

 

[zeit_hexe]

Thank you! Is there a voiceover? I should get better earphones...

Yes there is quite a lot of voiceover throughout - this was a collab between composers, singer, figure skaters, but also a poet (Elee Kraljii Gardiner) - Elee wrote the texts that we based the music and choreo on, and we had asked her to record herself reciting them, in case we wanted to use it in some of the musical works. There were three composers and we each ended up independently of one another using a lot of the text as voiceover.

 

[Mathman]

So does the motion of the skaters actually generate the sound through some kind of AI program?

 

[zeit_hexe]

So does the motion of the skaters actually generate the sound through some kind of AI program?

Not at all. Maybe someone will do something lile that someday but I am only a composer and I don’t have those kind of skills at all

All of the pieces are composed by the composers credited in the video.

Only one (the skating duet with the singer) uses motion tracking and it affects:
1. the speed of the voiceover in the beginning
2. volume of some of the electronic sounds (you can really hear this most when both skaters do a flying spin, or when they change movements suddenly
3. near the end of this piece, the movements of both skaters trigger pre-recorded voiceover (of course all aspects of movement adjust the volume of these sounds, if there is a lot of movement certain effects are added, etc)

 

[zeit_hexe]

So does the motion of the skaters actually generate the sound through some kind of AI program?

so in the end since a lot of people asked, I made a somewhat fun demonstration because it is really easy to hear in an identifiable clip: https://youtube.com/shorts/Iv9Gu2Vmv_U?si=-bFI1f7ulD2tWT-Y

 

[Mathman]

so in the end since a lot of people asked, I made a somewhat fun demonstration because it is really easy to hear in an identifiable clip:

Thanks for that. This is the first time I could ever understand the words in Ilia Malinin's LP Voiceover.

 

[DizzyFrenchie]

I've just heard Beethoven's Sonata n°10 in G major by András Schiff and Yuuko Shiokawa, and they make the Allegro Moderato sound "experimental" (which may well have been Beethoven's intent), and as often, I wondered if it could be skated and how, and your video came to my mind, I thought that it would suit well this method.