This reminds me of synaesthesia, where two concepts are involuntarily linked within someone’s brain. Typically it’s something like numbers and colours, or letters and colours, but could also be something like words and taste. It’s rare, but people who have it would probably remember a phone number based on its “colour” and think that’s how everyone does it.