BTW, a 20 second stumble is not a little stumble but a big one and unfortunately the other team had no stumbles.
What are you talking about? Who ever had a "20-second stumble"?
20 seconds is LONG time on the ice. Most elite skaters can complete a whole straight-line step sequence in well under 20 seconds, maybe a whole circular sequence, and a whole, complicated combination spin.
Occasionally a pair or dance team will miss 20 seconds of their program if one partner falls and the other partner skates away and it takes that long for them to catch up to each other. Probably a whole element or two will have been omitted
That would be a huge disruption in a program, and in the rules that have been in effect for dance since right after the 1998 Olympics would lead to a huge deduction. (The team that finished last in the free dance at 1998 Worlds was the first victim of this deduction -- and I think their program was "only" disrupted for 10 or 15 seconds, which is still a lot -- long enough for one partner to be at the far end of the ice before the other caught up.)
A single stumble would not cause that kind of disruption. Even a stumble out of an element and some more stumbling around trying to recover before finally regaining balance or finally falling and then getting up will only take around 5 seconds. A bad fall and awkward recovery will probably only take about 5 seconds. If it takes longer than that, especially with a single skater so that catching up to the partner is not an issue, the skater is probably injured and/or disoriented from the fall.
On the rare occasions when I've seen program disruptions in excess of 10 seconds, medals were not in question. The safety of the skater more often was.
Of course, if you take a 1- or 2-second stumble and show it over and over again in slow motion replays, it might come to feel like 20 seconds, but that's a false perception of the actual impact in the whole program.