This strikes me as one of the bleakest sentences that could be written/spoken in any language. "Why didn't you travel with me?" sounds like an ex-spouse or ex-lover plaintively asking — years after the agonizing breakup — how the other person could have been so heartless by not going on the surprise trip she/he had spent months planning. I see the two people sitting in a coffee shop while rain streams down the window outside. One of them has their head in their hands; the other is just sort of dead inside.
Sorry to be such a downer, but I laughed when I read it and apparently needed to riff. (lol) Thanks, Duo!