Transformers arn't the only game in town

[John Clark]

It seems like every day something important is happening in AI, there is an explosion of new ideas. The latest advance is Mercury, the first Large Language Model that works by diffusion not transformers, it starts with random gibberish and then refines it, this technique had worked before but only in generating art, nobody could get it to work for language until today.  The advantage is the program is smaller than transformer AIs and it's much faster because it works on the entire output at the same time not one bit at a time as transformers do; it seems to be especially good at writing computer code. For me the most exciting thing is that it offers an entirely new pathway towards AI. 

Whenever I get upset by reading the front page of today's newspapers I calm down by reflecting that Donald Trump and his clown car cabinet are small potatoes compared with the AI earthquake that is about to hit. 

LLM generates the ENTIRE output at once (world's first diffusion LLM)

 John K Clark    See what's on my new list at  Extropolis  

rcc

[Cosmin Visan]

AI! AI! AI! Aaaahhhh... so gooood!!!