Backstory revealed! At some point in the past, Whitney moved away and completely lost contact with Peter, leaving her as the "one that got away" in his mind.
Part of growing up is learning not to hold onto your past. The question of whether Peter eventually ended up with a girlfriend during his high school years will be answered in time as well.
