OhneHose
@OhmeHose@feddit.org
-
on EUROPA, the EU's open AI model, is aiming for nearly 1 trillion parameters in c/europe@feddit.org · 3d ago
Depends on your hardware. Apples unified memory system can give near complete access to the ram for their GPU/npu.
Apart from that you don’t need a single bit of vram/gpu to host a model. Then can be run completely on CPU+ram. But that comes with a significant processing penalty.
On top of that there’s new “engines” which can run a LLM from disk storage +system ram/vram, yet again with lots of speed penalities, since you chunk the model into small pieces and load them into ram accordingly. This will also cripple the lifetime of ssds with the sheer amount of read/write cycles.
Then there’s also dedicated systems or extension cards which can be used as accelerator.
None the less we speak about a minimum of 5000€’s for a system which can run llms and (lightweight) games simultaneously.
-
on Commission preliminarily finds TikTok\'s ‘For You\' feed in breach of Digital Services Act for harmful ‘rabbit holes\' effect in c/europe@feddit.org · 3d ago
Tiktok is banned in China, they have their own dedicated filteredversion of it.
-
on EUROPA, the EU's open AI model, is aiming for nearly 1 trillion parameters in c/europe@feddit.org · 3d ago
Judging from the size of other frontier models on hf, you won’t host it.
The best/biggest you can squeeze on 64gb ram rn is ~70-80B in a Q4 Quant. Going lower with quantization will usually leave you with notable degraded performance.
-
on Commission preliminarily finds TikTok\'s ‘For You\' feed in breach of Digital Services Act for harmful ‘rabbit holes\' effect in c/europe@feddit.org · 8 Nov 2026
It’s not like any other big social media platform does the same!
But I guess it’s only bad when China does it…
-
on German police union defends blaming migrants groups for Gen Z riots in c/europe@feddit.org · 3 Nov 2026
This just in: Right wing person says right wing statement.
-
on Argentina's Milei calls Spain's Sánchez a 'dictator' and a 'thief' in c/europe@feddit.org · 21 Oct 2026
Lol, says the lunatic thief of Argentina.
-
on Investigation: EU citizens' private messages are run through Palantir’s software in c/europe@feddit.org · 15 Oct 2026
If you’d read the article you would have come across that Whatsapp f.e. is exempt from scanning.
Best bang for the buck is a Mac mini with 64gbs memory. But that’s still ~3k€