I was the only person in the crowd with a sharpie – and Patrick got his hat signed by the newest American gold medalist