- cross-posted to:
- singularity@lemmit.online
- cross-posted to:
- singularity@lemmit.online
Big day for people who use AI locally. According to benchmarks this is a big step forward to free, small LLMs.
Big day for people who use AI locally. According to benchmarks this is a big step forward to free, small LLMs.
Llama 70B is probably where its at, if you go the API route. It’s distilled from 405B, and its benchmarks are pretty close.