Why do the language model and the vision model align?

[John Clark]

Why do the language model and the vision model align? Because they’re both shadows of the same world

The following quote is from the above: 

"More powerful AI models seem to have more similarities in their representations than weaker ones. Successful AI models are all alike, and every unsuccessful model is unsuccessful in its own particular way.[...] He would feed the pictures into the vision models and the captions into the language models, and then compare clusters of vectors in the two types. He observed a steady increase in representational similarity as models became more powerful. It was exactly what the Platonic representation hypothesis predicted."

In my opinion the above finding has profound philosophical implications. 

John K Clark    See what's on my new list at  Extropolis

qjq