So firstly, shut up, nerd. You’ve clearly never worked a corporate job and don’t understand the compulsion to in-house nothing.
I WISH. Would have saved so much headache from rolling our own framework for the millionth time instead of using standard solution that already exists... Tell me you've never worked in corporate software without telling me you've never worked in corporate software.
Secondly, approximately 0.0% of chatbot users will ever run an LLM at home.
Wut. Individual models on huggingface have monthly downloads in the hundreds of thousands... Just Deepseek R1 was downloaded 550,000 times in the last month alone. Gemma 3n was downloaded over 120,000 times in the last 7 days.
Thirdly, it’s slow as hell even on a top-end home Nvidia card — and the data centre cards are expensive.
They literally run well on mobile phones and laptops lol.
The author is desperately grasping at straws at best, intentionally making up false claims at worst... either way, they aren't qualified to write on this subject.