In general, I agree with you.
In practical terms though, a skater career is short and there so many things which can happen such as injuries, health problems, external factors e.g. pandemic and so on, so there is really could be just one Olympic cycle this particular skater/pair could peak in. And ''whose turn is it'' is not as much as philosophy as a cold reality of judging system (especially in ID) when you just have to climb the PCS ladder first. And then, when you got through all the obstacles, dealt with a few injuries, earned your reputation with the judges and about to 'arrive', bang, someone who already got all the medals/titles decides to come back and all your work and sacrifices are just not good enough.
It just does not feel fair somehow...