.. Well, I did see
this tweet from a skater who said she saw him with the Shibutanis and Davis/White on 8/19. ...
Ice Coverage, if you read in the tweet conversation, someone asked who she met, and Dyon mentions Patrick by name:
"@KeShonWilliams0 I met Meryl and Charlie the Shibutanis and Patrick Chan."
At first I thought maybe she confused Patrick with somebody else, but I wondered what occasion would bring the five champions together. Upon checking Meryl and Charlie and the Shibutani's Twitter timelines, that's where I found out that Maia and Alex were going to the Champs camp, and Maia also tweeted that they visited the World FS Museum and Hall of Fame that day, which is in Colorado Springs. Hence, the "huge leap".
It's possible that they were all at the airport together and were traveling to different destinations, since I don't know where Dyon is located. What other event or occasion happened around 8/19 that would place all 5 skaters together?
vivley, my apology that I did not delete the first part of my post quickly enough

.
My computer has been acting strange (freezing up, etc.) ... and as an example of the strangeness, the first time that I clicked on your link, all that showed up on my screen was the original tweet that referred to "5 Olympians." What did not show up are the query from K Daddy as to who and the reply tweet listing their five names.
Thus my initial reaction of "a huge leap."
But after I went ahead and hit "Submit" on my post, my curiosity led me to start clicking around to look for anything else from the original tweeter. Only then was I able to find the reply tweet with Patrick's name.
And as soon as I discovered the reply tweet, of course I sheepishly realized that my reaction of "a huge leap" had been (unbeknownst to me) without basis.
I immediately went back to edit my post ... with my computer freezing/hiccupping along the way.
Anyway, I clearly was too slow to make the deletion before you read my post.
I do think that it is a plausible scenario that all five Olympians could have been at the airport in Detroit or Denver.
But if they really were in Colorado Springs together ... another amusing-to-me fantasy-only "possibility" (again, strictly fantasy) is that perhaps

Patrick was a decoy-of-sorts related to Meryl and Charlie going to Champs Camp.
For those who don't know:
Every year, USFS surprises the Champs Camp skaters with a major keynote speaker (such as Wylie, Kwan, Hamilton) ... whose identity is kept secret until the moment of the speech. Sometimes USFS social media has made a thing of building suspense before the big reveal of who the speaker is.
This year, Meryl and Charlie were the keynote speakers. So if (as in years past) they were supposed to be a surprise -- even for their good friends the Shibs -- I am ROFLing as my over-active imagination runs wild and I envision USFS hiring Patrick to travel with Meryl and Charlie and supplying those three with a fake reason

as to why they needed to be in Colorado Springs together

.... a fake reason that would be the furthest thing from the truth of M/C's surprise appearance at Champs Camp.