LLAMA3

[John Clark]

Meta (a.k.a. Facebook) released LLAMA3 just a few days ago, and it's amazing for three reasons: 

1) It's tiny, it only has 70 billion parameters, GPT4 is about 1.8 trillion parameters. 

2) Despite its small size on AI benchmarks it's performance is just a smidgen below that of GPT4.

3) It is open source. 

Meta says it's performance would be even better if they trained it for longer but they stopped early because the company's computational resources are large but not infinite so they decided that compute time could be better spent training a 400 billion parameter version of LLAMA3, which they say they'll release sometime in the next couple of months, and in developing LLAMA4.

And anybody who still thinks the Singularity is not near really needs to look at the following video. I'll tell you one thing, it sure makes the issues that most Americans believe are the most important and which will probably decide the November election, excessive wokeness, the "invasion" from Mexico, and transsexual bathrooms, seem pretty damn trivial. 

LLAMA 3 *BREAKS* the Industry | Government Safety Limits Approaching | Will Groq kill NVIDIA?

 John K Clark    See what's on my new list at  Extropolis

pdt

[John Clark]

On Sat, Apr 20, 2024 at 7:11 PM Brent Meeker <meeke...@gmail.com> wrote:

> How about the war in Ukraine, Russian hacking, global warming,  Chinese threats in the Taiwan strait and South China sea, and U.S. infrastructure decay?

If the singularity happens in the next two or three years, which doesn't sound nearly as ridiculous as it would have 18 months ago, then every one of those things is of utterly trivial importance.

John K Clark    See what's on my new list at  Extropolis

m5x

pdt