@joseki@lemmy.zip
member since 12 Sep 2026 23:30
comments
- on is K2 horizons historically significant as the first actual open-source LLM, or am I falling for hype? in c/selfhosted@lemmy.world · 4d ago
-
on is K2 horizons historically significant as the first actual open-source LLM, or am I falling for hype? in c/selfhosted@lemmy.world · 4d ago
K2 wasn’t the first.
China had CPM-1 in 2020 that was a 2.6B model.
GPT-Neo (Mar 2021) EleutherAI replicates early GPT
PanGu-α (Apr 2021) Huawei’s 200B model
WuDao 2.0 (May 2021) BAAI’s massive 1.75T sparse MoE model
GPT-J (Jun 2021) EleutherAI release 6B
Meta released OPT in 2022, BLOOM was in 2022, GLM 130B by Tsinghua/Zhipu was in 2022 etc
K2 horizon is very recent, nowhere near the first. Different labs have different computational innovations worth studying. DeepSeek is crazy efficient and doing very novel things. Mistral in France is making very compact local friendly models that are fun and easy to fine tune and merge on consumer hardware.
-
on Marvel's Wolverine motorcycle section and quicktime events are getting the wrong kind of attention because "the game plays itself" and "you don't have to press anything" in c/technology@lemmy.world · 4d ago
Sounds like you didn’t make it past the intro
-
on Cops Search Thousands of Flock Cameras for Reasons of ‘LMAO,’ ‘IDK,’ ‘Hehe,’ and ‘asdfg’ in c/privacy@lemmy.ml · 15 Sep 2026
Well sure human nature exists but there’s also professionalism - unfortunately in many parts of the country these people take an intelligence test to screen out the high scorers.
-
on ‘I Felt Super Violated’: Men Wearing Meta Glasses on Dates Is an Instant Red Flag in c/privacy@lemmy.ml · 15 Sep 2026
Yeah im a huge nerd and techno-weenie but this is just creepy abuser behavior and a major red flag if it wasn’t consented to im advance
Right and the predecessor to ChatGPT was trained on links from reddit posts pretty wild. I remember having fun making it come up with nonsense prose on my GPU