{"comments":[{"comment":{"id":18042569,"creator_id":16432647,"post_id":33492250,"content":"Not sure I want to name any names... 😂","removed":false,"published":"2025-09-09T07:29:02.018534Z","deleted":false,"ap_id":"https://reddthat.com/comment/21398157","local":false,"path":"0.18042569","distinguished":false,"language_id":37},"creator":{"id":16432647,"name":"swelter_spark","avatar":"https://reddthat.com/pictrs/image/2a4f6f71-ff7a-4502-9bd5-b65ddde8faad.png","banned":false,"published":"2025-03-06T18:17:06.228876Z","actor_id":"https://reddthat.com/u/swelter_spark","local":false,"deleted":false,"bot_account":false,"instance_id":16},"post":{"id":33492250,"name":"What local, small models are you all using?","body":"I'm curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)\n\nWhat do you consider the \"best\" model under ~30B parameters?","creator_id":20896354,"community_id":353,"removed":false,"locked":false,"published":"2025-09-06T03:03:37.574296Z","deleted":false,"nsfw":false,"ap_id":"https://sh.itjust.works/post/45495313","local":false,"language_id":37,"featured_community":false,"featured_local":false},"community":{"id":353,"name":"localllama","title":"LocalLLaMA","description":"Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.\n\nGet support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.\n\nAs ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.\n\nRules:\n\nRule 1 -\nNo harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.\n\nRule 2 -\nNo comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.\n\nRule 3 -\nNo comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as \"llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since .\n\nRule 4 -\nNo implying that models are devoid of purpose or potential for enriching peoples lives.","removed":false,"published":"2023-06-08T18:21:54.578976Z","updated":"2025-06-09T20:51:11.460711Z","deleted":false,"nsfw":false,"actor_id":"https://sh.itjust.works/c/localllama","local":false,"icon":"https://sh.itjust.works/pictrs/image/8e07ec26-c7e5-4411-a4d5-c0c7a292b773.gif","banner":"https://sh.itjust.works/pictrs/image/5d07b398-7675-4862-8277-5906400b666d.png","hidden":false,"posting_restricted_to_mods":false,"instance_id":3,"visibility":"Public"},"counts":{"comment_id":18042569,"score":1,"upvotes":1,"downvotes":0,"published":"2025-09-09T07:29:02.018534Z","child_count":0},"creator_banned_from_community":false,"banned_from_community":false,"creator_is_moderator":false,"creator_is_admin":false,"subscribed":"NotSubscribed","saved":false,"creator_blocked":false},{"comment":{"id":18010137,"creator_id":3265,"post_id":33492250,"content":"I'm a big fan of NousResearch their deephermes release was awesome and now I'm trying out Hermes 4. I have an 8gb 1070ti GPU was able to fully offload a medium quant of hermes 4 14b with an okay amount of context.\n\nI'm a big fan of the hybrid reasoning models I like being able to turn thinking on or of depending on scenario. \n\nI had a vision model document scanner + TTS going on with a finetune of qwen 2.5 vl and outetts.\n\nIf you care more about character emulation for writing and creativity then mistral 2407 and mistral NeMo are other models to check out. \n","removed":false,"published":"2025-09-07T10:11:33.556978Z","deleted":false,"ap_id":"https://lemmy.world/comment/19253085","local":false,"path":"0.18010137","distinguished":false,"language_id":37},"creator":{"id":3265,"name":"Smokeydope","display_name":"SmokeyDope","avatar":"https://lemmy.world/pictrs/image/730b5b99-5282-40da-aaeb-fcb133fc59c4.gif","banned":false,"published":"2023-07-01T22:46:32.097408Z","actor_id":"https://lemmy.world/u/Smokeydope","local":false,"banner":"https://lemmy.world/pictrs/image/9d380ed3-18d5-4dc5-a56e-27764caad912.jpeg","deleted":false,"bot_account":false,"instance_id":2},"post":{"id":33492250,"name":"What local, small models are you all using?","body":"I'm curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)\n\nWhat do you consider the \"best\" model under ~30B parameters?","creator_id":20896354,"community_id":353,"removed":false,"locked":false,"published":"2025-09-06T03:03:37.574296Z","deleted":false,"nsfw":false,"ap_id":"https://sh.itjust.works/post/45495313","local":false,"language_id":37,"featured_community":false,"featured_local":false},"community":{"id":353,"name":"localllama","title":"LocalLLaMA","description":"Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.\n\nGet support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.\n\nAs ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.\n\nRules:\n\nRule 1 -\nNo harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.\n\nRule 2 -\nNo comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.\n\nRule 3 -\nNo comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as \"llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since .\n\nRule 4 -\nNo implying that models are devoid of purpose or potential for enriching peoples lives.","removed":false,"published":"2023-06-08T18:21:54.578976Z","updated":"2025-06-09T20:51:11.460711Z","deleted":false,"nsfw":false,"actor_id":"https://sh.itjust.works/c/localllama","local":false,"icon":"https://sh.itjust.works/pictrs/image/8e07ec26-c7e5-4411-a4d5-c0c7a292b773.gif","banner":"https://sh.itjust.works/pictrs/image/5d07b398-7675-4862-8277-5906400b666d.png","hidden":false,"posting_restricted_to_mods":false,"instance_id":3,"visibility":"Public"},"counts":{"comment_id":18010137,"score":3,"upvotes":3,"downvotes":0,"published":"2025-09-07T10:11:33.556978Z","child_count":0},"creator_banned_from_community":false,"banned_from_community":false,"creator_is_moderator":true,"creator_is_admin":false,"subscribed":"NotSubscribed","saved":false,"creator_blocked":false},{"comment":{"id":17990959,"creator_id":27404,"post_id":33492250,"content":"In my opinion, [Qwen3-30B-A3B-2507](https://huggingface.co/Qwen/Qwen3-30B-A3B-Thinking-2507) would be the best here. Thinking version likely best for most things as long as you don’t mind a slight penalty to speed for more accuracy. I use the quantized IQ4_XS models from Bartowski or Unsloth on HuggingFace.\n\nI’ve seen the new OSS-20B models from OpenAI ranked well in benchmarks but I have not liked the output at all. Typically seems lazy and not very comprehensive. And makes obvious errors.\n\nIf you want even smaller and faster the [Qwen3 Distill of DeepSeek R1 0528 8B](https://huggingface.co/deepseek-ai/DeepSeek-R1-0528-Qwen3-8B) is great for its size (esp if you’re trying to free up some VRAM to use larger context lengths)","removed":false,"published":"2025-09-06T04:12:58.055207Z","deleted":false,"ap_id":"https://lemmy.ml/comment/20904841","local":false,"path":"0.17990959","distinguished":false,"language_id":37},"creator":{"id":27404,"name":"FrankLaskey","banned":false,"published":"2020-06-30T04:43:29.075463Z","actor_id":"https://lemmy.ml/u/FrankLaskey","local":false,"deleted":false,"bot_account":false,"instance_id":19},"post":{"id":33492250,"name":"What local, small models are you all using?","body":"I'm curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)\n\nWhat do you consider the \"best\" model under ~30B parameters?","creator_id":20896354,"community_id":353,"removed":false,"locked":false,"published":"2025-09-06T03:03:37.574296Z","deleted":false,"nsfw":false,"ap_id":"https://sh.itjust.works/post/45495313","local":false,"language_id":37,"featured_community":false,"featured_local":false},"community":{"id":353,"name":"localllama","title":"LocalLLaMA","description":"Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.\n\nGet support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.\n\nAs ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.\n\nRules:\n\nRule 1 -\nNo harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.\n\nRule 2 -\nNo comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.\n\nRule 3 -\nNo comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as \"llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since .\n\nRule 4 -\nNo implying that models are devoid of purpose or potential for enriching peoples lives.","removed":false,"published":"2023-06-08T18:21:54.578976Z","updated":"2025-06-09T20:51:11.460711Z","deleted":false,"nsfw":false,"actor_id":"https://sh.itjust.works/c/localllama","local":false,"icon":"https://sh.itjust.works/pictrs/image/8e07ec26-c7e5-4411-a4d5-c0c7a292b773.gif","banner":"https://sh.itjust.works/pictrs/image/5d07b398-7675-4862-8277-5906400b666d.png","hidden":false,"posting_restricted_to_mods":false,"instance_id":3,"visibility":"Public"},"counts":{"comment_id":17990959,"score":18,"upvotes":19,"downvotes":1,"published":"2025-09-06T04:12:58.055207Z","child_count":1},"creator_banned_from_community":false,"banned_from_community":false,"creator_is_moderator":false,"creator_is_admin":false,"subscribed":"NotSubscribed","saved":false,"creator_blocked":false},{"comment":{"id":17990455,"creator_id":5,"post_id":33492250,"content":"Qwen 2.5 VL and Code. I have a VL doing image captions for LoRA training running now. A 14B is okay for basic code. A quantized 32B 6KL gguf of the same Qwen 2.5 code model runs on 16GB but at a third of the speed of the 14B in bits and bytes 4b. The latter is reasonably fast enough for a couple layers of agentic stuff in emacs with gptel and hits thinking or function calling out of a llama.cpp server better than 50% of the time.\n\nI still haven't tried the new 20B out of Open AI yet.","removed":false,"published":"2025-09-06T03:18:42.568325Z","updated":"2025-09-06T03:19:29.757459Z","deleted":false,"ap_id":"https://lemmy.world/comment/19233731","local":false,"path":"0.17990455","distinguished":false,"language_id":37},"creator":{"id":5,"name":"j4k3","display_name":"𞋴𝛂𝛋𝛆","avatar":"https://lemmy.world/pictrs/image/69e27817-2c2e-48d1-8bb9-aa74c2fd4e15.jpeg","banned":false,"published":"2023-06-09T17:41:38.382015Z","actor_id":"https://lemmy.world/u/j4k3","local":false,"deleted":false,"matrix_user_id":"@-j4k3:matrix.org","bot_account":false,"instance_id":2},"post":{"id":33492250,"name":"What local, small models are you all using?","body":"I'm curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)\n\nWhat do you consider the \"best\" model under ~30B parameters?","creator_id":20896354,"community_id":353,"removed":false,"locked":false,"published":"2025-09-06T03:03:37.574296Z","deleted":false,"nsfw":false,"ap_id":"https://sh.itjust.works/post/45495313","local":false,"language_id":37,"featured_community":false,"featured_local":false},"community":{"id":353,"name":"localllama","title":"LocalLLaMA","description":"Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.\n\nGet support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.\n\nAs ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.\n\nRules:\n\nRule 1 -\nNo harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.\n\nRule 2 -\nNo comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.\n\nRule 3 -\nNo comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as \"llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since .\n\nRule 4 -\nNo implying that models are devoid of purpose or potential for enriching peoples lives.","removed":false,"published":"2023-06-08T18:21:54.578976Z","updated":"2025-06-09T20:51:11.460711Z","deleted":false,"nsfw":false,"actor_id":"https://sh.itjust.works/c/localllama","local":false,"icon":"https://sh.itjust.works/pictrs/image/8e07ec26-c7e5-4411-a4d5-c0c7a292b773.gif","banner":"https://sh.itjust.works/pictrs/image/5d07b398-7675-4862-8277-5906400b666d.png","hidden":false,"posting_restricted_to_mods":false,"instance_id":3,"visibility":"Public"},"counts":{"comment_id":17990455,"score":7,"upvotes":7,"downvotes":0,"published":"2025-09-06T03:18:42.568325Z","child_count":0},"creator_banned_from_community":false,"banned_from_community":false,"creator_is_moderator":false,"creator_is_admin":false,"subscribed":"NotSubscribed","saved":false,"creator_blocked":false},{"comment":{"id":17992378,"creator_id":10125682,"post_id":33492250,"content":"I really liked Mistral-Nemo-Instruct for its allround capabilities. But it's old and hardly the best any more. But I feel lots of newer models are sycophants and tuned more for question answering and assistant stuff, and their ability to write long-form prose or role play as a Podcast host hasn't really improved substancially. These days I switch models. I'll use something more creative if I want that, or switch to a model dedicated to coding if I want autocomplete. But to be honest, coding isn't on my list of requirements any more. I've tried AI coding and it's not really helping with what I do. I regularly waste some extra 30%-100% of time if I do it with AI, and that's with the huge commercial services like AIstudio or ChatGPT.","removed":false,"published":"2025-09-06T07:14:11.494300Z","updated":"2025-09-06T07:34:26.773664Z","deleted":false,"ap_id":"https://palaver.p3x.de/comment/2261665","local":false,"path":"0.17992378","distinguished":false,"language_id":37},"creator":{"id":10125682,"name":"hendrik","display_name":"hendrik","banned":false,"published":"2021-08-21T12:00:00Z","actor_id":"https://palaver.p3x.de/u/hendrik","bio":"A software developer and Linux nerd, living in Germany. I'm usually a chill dude but my online persona doesn't always reflect my true personality. Take what I say with a grain of salt, I usually try to be nice and give good advice, though. \r\n\r\nI'm into Free Software, selfhosting, microcontrollers and electronics, freedom, privacy and the usual stuff. And a few select other random things as well.","local":false,"deleted":false,"matrix_user_id":"@hendrik:p3x.de","bot_account":false,"instance_id":4362},"post":{"id":33492250,"name":"What local, small models are you all using?","body":"I'm curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)\n\nWhat do you consider the \"best\" model under ~30B parameters?","creator_id":20896354,"community_id":353,"removed":false,"locked":false,"published":"2025-09-06T03:03:37.574296Z","deleted":false,"nsfw":false,"ap_id":"https://sh.itjust.works/post/45495313","local":false,"language_id":37,"featured_community":false,"featured_local":false},"community":{"id":353,"name":"localllama","title":"LocalLLaMA","description":"Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.\n\nGet support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.\n\nAs ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.\n\nRules:\n\nRule 1 -\nNo harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.\n\nRule 2 -\nNo comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.\n\nRule 3 -\nNo comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as \"llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since .\n\nRule 4 -\nNo implying that models are devoid of purpose or potential for enriching peoples lives.","removed":false,"published":"2023-06-08T18:21:54.578976Z","updated":"2025-06-09T20:51:11.460711Z","deleted":false,"nsfw":false,"actor_id":"https://sh.itjust.works/c/localllama","local":false,"icon":"https://sh.itjust.works/pictrs/image/8e07ec26-c7e5-4411-a4d5-c0c7a292b773.gif","banner":"https://sh.itjust.works/pictrs/image/5d07b398-7675-4862-8277-5906400b666d.png","hidden":false,"posting_restricted_to_mods":false,"instance_id":3,"visibility":"Public"},"counts":{"comment_id":17992378,"score":4,"upvotes":4,"downvotes":0,"published":"2025-09-06T07:14:11.494300Z","child_count":0},"creator_banned_from_community":false,"banned_from_community":false,"creator_is_moderator":false,"creator_is_admin":false,"subscribed":"NotSubscribed","saved":false,"creator_blocked":false},{"comment":{"id":17994606,"creator_id":12923012,"post_id":33492250,"content":"I use Qwen coder 30B, testing Venice 24B, also going to play with Qwen embedding 8B and Qwen resorter(?) 8B. All with Q4.\n\nThey all run pretty well on the new MacBook I got for work. My Linux home desktop has far more modest capabilities, and I generally run 7B models, though gpt-oss-20B-Q4 runs decently. It's okay for a local model.\n\nNone of them really blow me away, though Cline running in VSCode with Qwen 30B is okay for certain tasks. Asking it to strip all of the irrelevant html out of a table to format as markdown or asciidoc had it thinking for about 10 minutes before asking specifically which one I wanted - my fault, I should've picked one. Wanted markdown but thought adoc would reproduce it with better fidelity (table had embedded code blocks) and so I left it open to interpretation.\n\nBy comparison, ChatGPT ingested it and popped an answer back out in seconds that was wrong. So Idk, nothing ventured, nothing gained. Emphasis on the latter.","removed":false,"published":"2025-09-06T11:19:16.400953Z","deleted":false,"ap_id":"https://lemmy.zip/comment/21290266","local":false,"path":"0.17994606","distinguished":false,"language_id":37},"creator":{"id":12923012,"name":"MagicShel","banned":false,"published":"2024-10-14T13:05:07.111954Z","actor_id":"https://lemmy.zip/u/MagicShel","bio":"25+ yr Java/JS dev \nLinux novice - running Ubuntu (no windows/mac)","local":false,"deleted":false,"bot_account":false,"instance_id":76},"post":{"id":33492250,"name":"What local, small models are you all using?","body":"I'm curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)\n\nWhat do you consider the \"best\" model under ~30B parameters?","creator_id":20896354,"community_id":353,"removed":false,"locked":false,"published":"2025-09-06T03:03:37.574296Z","deleted":false,"nsfw":false,"ap_id":"https://sh.itjust.works/post/45495313","local":false,"language_id":37,"featured_community":false,"featured_local":false},"community":{"id":353,"name":"localllama","title":"LocalLLaMA","description":"Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.\n\nGet support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.\n\nAs ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.\n\nRules:\n\nRule 1 -\nNo harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.\n\nRule 2 -\nNo comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.\n\nRule 3 -\nNo comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as \"llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since .\n\nRule 4 -\nNo implying that models are devoid of purpose or potential for enriching peoples lives.","removed":false,"published":"2023-06-08T18:21:54.578976Z","updated":"2025-06-09T20:51:11.460711Z","deleted":false,"nsfw":false,"actor_id":"https://sh.itjust.works/c/localllama","local":false,"icon":"https://sh.itjust.works/pictrs/image/8e07ec26-c7e5-4411-a4d5-c0c7a292b773.gif","banner":"https://sh.itjust.works/pictrs/image/5d07b398-7675-4862-8277-5906400b666d.png","hidden":false,"posting_restricted_to_mods":false,"instance_id":3,"visibility":"Public"},"counts":{"comment_id":17994606,"score":3,"upvotes":3,"downvotes":0,"published":"2025-09-06T11:19:16.400953Z","child_count":0},"creator_banned_from_community":false,"banned_from_community":false,"creator_is_moderator":false,"creator_is_admin":false,"subscribed":"NotSubscribed","saved":false,"creator_blocked":false},{"comment":{"id":17996195,"creator_id":19546494,"post_id":33492250,"content":"Unlike most of you here reading this, I don't allow a corporate executive/billionaire or a distant nation-state to tell me what I am permitted to say or what my model is allowed to output, so I use an uncensored general model from [here](https://huggingface.co/spaces/DontPlanToEnd/UGI-Leaderboard) (first uncheck \"proprietary model\" box).","removed":false,"published":"2025-09-06T13:23:42.785966Z","updated":"2025-09-06T13:24:48.651091Z","deleted":false,"ap_id":"https://piefed.social/comment/7857287","local":false,"path":"0.17996195","distinguished":false,"language_id":37},"creator":{"id":19546494,"name":"BaroqueInMind","display_name":"BaroqueInMind","avatar":"https://media.piefed.social/users/NT/tg/NTtgqyyLJXIcxEo.jpeg","banned":false,"published":"2025-07-04T18:41:29.114655Z","actor_id":"https://piefed.social/u/BaroqueInMind","bio":"There's nothing here because my brain is smooth and I have no original thoughts. You made a mistake coming here. ","local":false,"deleted":false,"bot_account":false,"instance_id":3518},"post":{"id":33492250,"name":"What local, small models are you all using?","body":"I'm curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)\n\nWhat do you consider the \"best\" model under ~30B parameters?","creator_id":20896354,"community_id":353,"removed":false,"locked":false,"published":"2025-09-06T03:03:37.574296Z","deleted":false,"nsfw":false,"ap_id":"https://sh.itjust.works/post/45495313","local":false,"language_id":37,"featured_community":false,"featured_local":false},"community":{"id":353,"name":"localllama","title":"LocalLLaMA","description":"Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.\n\nGet support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.\n\nAs ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.\n\nRules:\n\nRule 1 -\nNo harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.\n\nRule 2 -\nNo comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.\n\nRule 3 -\nNo comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as \"llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since .\n\nRule 4 -\nNo implying that models are devoid of purpose or potential for enriching peoples lives.","removed":false,"published":"2023-06-08T18:21:54.578976Z","updated":"2025-06-09T20:51:11.460711Z","deleted":false,"nsfw":false,"actor_id":"https://sh.itjust.works/c/localllama","local":false,"icon":"https://sh.itjust.works/pictrs/image/8e07ec26-c7e5-4411-a4d5-c0c7a292b773.gif","banner":"https://sh.itjust.works/pictrs/image/5d07b398-7675-4862-8277-5906400b666d.png","hidden":false,"posting_restricted_to_mods":false,"instance_id":3,"visibility":"Public"},"counts":{"comment_id":17996195,"score":1,"upvotes":6,"downvotes":5,"published":"2025-09-06T13:23:42.785966Z","child_count":8},"creator_banned_from_community":false,"banned_from_community":false,"creator_is_moderator":false,"creator_is_admin":false,"subscribed":"NotSubscribed","saved":false,"creator_blocked":false},{"comment":{"id":17990990,"creator_id":20896354,"post_id":33492250,"content":"That's what I'm using, and it's pretty nice. Thanks for your input!","removed":false,"published":"2025-09-06T04:16:22.963435Z","deleted":false,"ap_id":"https://sh.itjust.works/comment/20843138","local":false,"path":"0.17990959.17990990","distinguished":false,"language_id":37},"creator":{"id":20896354,"name":"devxyn","banned":false,"published":"2025-07-12T05:56:52.677861Z","actor_id":"https://sh.itjust.works/u/devxyn","local":false,"deleted":false,"bot_account":false,"instance_id":3},"post":{"id":33492250,"name":"What local, small models are you all using?","body":"I'm curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)\n\nWhat do you consider the \"best\" model under ~30B parameters?","creator_id":20896354,"community_id":353,"removed":false,"locked":false,"published":"2025-09-06T03:03:37.574296Z","deleted":false,"nsfw":false,"ap_id":"https://sh.itjust.works/post/45495313","local":false,"language_id":37,"featured_community":false,"featured_local":false},"community":{"id":353,"name":"localllama","title":"LocalLLaMA","description":"Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.\n\nGet support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.\n\nAs ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.\n\nRules:\n\nRule 1 -\nNo harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.\n\nRule 2 -\nNo comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.\n\nRule 3 -\nNo comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as \"llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since .\n\nRule 4 -\nNo implying that models are devoid of purpose or potential for enriching peoples lives.","removed":false,"published":"2023-06-08T18:21:54.578976Z","updated":"2025-06-09T20:51:11.460711Z","deleted":false,"nsfw":false,"actor_id":"https://sh.itjust.works/c/localllama","local":false,"icon":"https://sh.itjust.works/pictrs/image/8e07ec26-c7e5-4411-a4d5-c0c7a292b773.gif","banner":"https://sh.itjust.works/pictrs/image/5d07b398-7675-4862-8277-5906400b666d.png","hidden":false,"posting_restricted_to_mods":false,"instance_id":3,"visibility":"Public"},"counts":{"comment_id":17990990,"score":3,"upvotes":3,"downvotes":0,"published":"2025-09-06T04:16:22.963435Z","child_count":0},"creator_banned_from_community":false,"banned_from_community":false,"creator_is_moderator":false,"creator_is_admin":false,"subscribed":"NotSubscribed","saved":false,"creator_blocked":false},{"comment":{"id":18024968,"creator_id":7248,"post_id":33492250,"content":"How do you remove all the propaganda they are already trained on ? You reject Deepseek, but you are just allowing yourself to being manipulated by a throng of old propaganda/censorship from the normal internet - garbage manipulative information that is stored in the weights of your 'uncensored' model. 'Freeing' a model to say \"shit\", is not the same as an uncensored model that you can trust. I think we need a dataset cleansed from the current popular ideology and all propaganda against 'wevil nationstates' that have just rejected the western/US dominance (giving the middle-finger to western oligarchs)..","removed":false,"published":"2025-09-08T06:50:00.318715Z","deleted":false,"ap_id":"https://lemmy.ml/comment/20939944","local":false,"path":"0.17996195.18024968","distinguished":false,"language_id":37},"creator":{"id":7248,"name":"Sims","display_name":"Sims","banned":false,"published":"2023-06-08T10:13:48.761281Z","actor_id":"https://lemmy.ml/u/Sims","bio":"I'm sick and tired of the Capitalist religion and all their fanatic believers. The Western right-wing population are the most propagandized and harmful people on Earth.","local":false,"deleted":false,"bot_account":false,"instance_id":19},"post":{"id":33492250,"name":"What local, small models are you all using?","body":"I'm curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)\n\nWhat do you consider the \"best\" model under ~30B parameters?","creator_id":20896354,"community_id":353,"removed":false,"locked":false,"published":"2025-09-06T03:03:37.574296Z","deleted":false,"nsfw":false,"ap_id":"https://sh.itjust.works/post/45495313","local":false,"language_id":37,"featured_community":false,"featured_local":false},"community":{"id":353,"name":"localllama","title":"LocalLLaMA","description":"Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.\n\nGet support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.\n\nAs ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.\n\nRules:\n\nRule 1 -\nNo harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.\n\nRule 2 -\nNo comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.\n\nRule 3 -\nNo comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as \"llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since .\n\nRule 4 -\nNo implying that models are devoid of purpose or potential for enriching peoples lives.","removed":false,"published":"2023-06-08T18:21:54.578976Z","updated":"2025-06-09T20:51:11.460711Z","deleted":false,"nsfw":false,"actor_id":"https://sh.itjust.works/c/localllama","local":false,"icon":"https://sh.itjust.works/pictrs/image/8e07ec26-c7e5-4411-a4d5-c0c7a292b773.gif","banner":"https://sh.itjust.works/pictrs/image/5d07b398-7675-4862-8277-5906400b666d.png","hidden":false,"posting_restricted_to_mods":false,"instance_id":3,"visibility":"Public"},"counts":{"comment_id":18024968,"score":2,"upvotes":2,"downvotes":0,"published":"2025-09-08T06:50:00.318715Z","child_count":0},"creator_banned_from_community":false,"banned_from_community":false,"creator_is_moderator":false,"creator_is_admin":false,"subscribed":"NotSubscribed","saved":false,"creator_blocked":false},{"comment":{"id":18016749,"creator_id":19910167,"post_id":33492250,"content":"That is awesome, thank you for that link!\n\n","removed":false,"published":"2025-09-07T18:31:42.576704Z","deleted":false,"ap_id":"https://lemmy.ca/comment/18814044","local":false,"path":"0.17996195.18016749","distinguished":false,"language_id":37},"creator":{"id":19910167,"name":"panda_abyss","banned":false,"published":"2025-07-20T15:44:48.097088Z","actor_id":"https://lemmy.ca/u/panda_abyss","local":false,"deleted":false,"bot_account":false,"instance_id":17},"post":{"id":33492250,"name":"What local, small models are you all using?","body":"I'm curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)\n\nWhat do you consider the \"best\" model under ~30B parameters?","creator_id":20896354,"community_id":353,"removed":false,"locked":false,"published":"2025-09-06T03:03:37.574296Z","deleted":false,"nsfw":false,"ap_id":"https://sh.itjust.works/post/45495313","local":false,"language_id":37,"featured_community":false,"featured_local":false},"community":{"id":353,"name":"localllama","title":"LocalLLaMA","description":"Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.\n\nGet support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.\n\nAs ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.\n\nRules:\n\nRule 1 -\nNo harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.\n\nRule 2 -\nNo comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.\n\nRule 3 -\nNo comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as \"llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since .\n\nRule 4 -\nNo implying that models are devoid of purpose or potential for enriching peoples lives.","removed":false,"published":"2023-06-08T18:21:54.578976Z","updated":"2025-06-09T20:51:11.460711Z","deleted":false,"nsfw":false,"actor_id":"https://sh.itjust.works/c/localllama","local":false,"icon":"https://sh.itjust.works/pictrs/image/8e07ec26-c7e5-4411-a4d5-c0c7a292b773.gif","banner":"https://sh.itjust.works/pictrs/image/5d07b398-7675-4862-8277-5906400b666d.png","hidden":false,"posting_restricted_to_mods":false,"instance_id":3,"visibility":"Public"},"counts":{"comment_id":18016749,"score":3,"upvotes":3,"downvotes":0,"published":"2025-09-07T18:31:42.576704Z","child_count":0},"creator_banned_from_community":false,"banned_from_community":false,"creator_is_moderator":false,"creator_is_admin":false,"subscribed":"NotSubscribed","saved":false,"creator_blocked":false},{"comment":{"id":18009210,"creator_id":18751636,"post_id":33492250,"content":"This leaderboard is a gem! This should be a separate post, thank you!","removed":false,"published":"2025-09-07T08:29:54.122647Z","deleted":false,"ap_id":"https://mander.xyz/comment/21819970","local":false,"path":"0.17996195.18009210","distinguished":false,"language_id":37},"creator":{"id":18751636,"name":"RheumatoidArthritis","banned":false,"published":"2025-06-04T07:18:33.407547Z","actor_id":"https://mander.xyz/u/RheumatoidArthritis","local":false,"deleted":false,"bot_account":false,"instance_id":38},"post":{"id":33492250,"name":"What local, small models are you all using?","body":"I'm curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)\n\nWhat do you consider the \"best\" model under ~30B parameters?","creator_id":20896354,"community_id":353,"removed":false,"locked":false,"published":"2025-09-06T03:03:37.574296Z","deleted":false,"nsfw":false,"ap_id":"https://sh.itjust.works/post/45495313","local":false,"language_id":37,"featured_community":false,"featured_local":false},"community":{"id":353,"name":"localllama","title":"LocalLLaMA","description":"Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.\n\nGet support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.\n\nAs ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.\n\nRules:\n\nRule 1 -\nNo harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.\n\nRule 2 -\nNo comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.\n\nRule 3 -\nNo comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as \"llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since .\n\nRule 4 -\nNo implying that models are devoid of purpose or potential for enriching peoples lives.","removed":false,"published":"2023-06-08T18:21:54.578976Z","updated":"2025-06-09T20:51:11.460711Z","deleted":false,"nsfw":false,"actor_id":"https://sh.itjust.works/c/localllama","local":false,"icon":"https://sh.itjust.works/pictrs/image/8e07ec26-c7e5-4411-a4d5-c0c7a292b773.gif","banner":"https://sh.itjust.works/pictrs/image/5d07b398-7675-4862-8277-5906400b666d.png","hidden":false,"posting_restricted_to_mods":false,"instance_id":3,"visibility":"Public"},"counts":{"comment_id":18009210,"score":1,"upvotes":1,"downvotes":0,"published":"2025-09-07T08:29:54.122647Z","child_count":2},"creator_banned_from_community":false,"banned_from_community":false,"creator_is_moderator":false,"creator_is_admin":false,"subscribed":"NotSubscribed","saved":false,"creator_blocked":false},{"comment":{"id":17999585,"creator_id":5,"post_id":33492250,"content":"","removed":false,"published":"2025-09-06T17:16:26.812043Z","deleted":true,"ap_id":"https://lemmy.world/comment/19242624","local":false,"path":"0.17996195.17999585","distinguished":false,"language_id":37},"creator":{"id":5,"name":"j4k3","display_name":"𞋴𝛂𝛋𝛆","avatar":"https://lemmy.world/pictrs/image/69e27817-2c2e-48d1-8bb9-aa74c2fd4e15.jpeg","banned":false,"published":"2023-06-09T17:41:38.382015Z","actor_id":"https://lemmy.world/u/j4k3","local":false,"deleted":false,"matrix_user_id":"@-j4k3:matrix.org","bot_account":false,"instance_id":2},"post":{"id":33492250,"name":"What local, small models are you all using?","body":"I'm curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)\n\nWhat do you consider the \"best\" model under ~30B parameters?","creator_id":20896354,"community_id":353,"removed":false,"locked":false,"published":"2025-09-06T03:03:37.574296Z","deleted":false,"nsfw":false,"ap_id":"https://sh.itjust.works/post/45495313","local":false,"language_id":37,"featured_community":false,"featured_local":false},"community":{"id":353,"name":"localllama","title":"LocalLLaMA","description":"Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.\n\nGet support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.\n\nAs ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.\n\nRules:\n\nRule 1 -\nNo harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.\n\nRule 2 -\nNo comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.\n\nRule 3 -\nNo comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as \"llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since .\n\nRule 4 -\nNo implying that models are devoid of purpose or potential for enriching peoples lives.","removed":false,"published":"2023-06-08T18:21:54.578976Z","updated":"2025-06-09T20:51:11.460711Z","deleted":false,"nsfw":false,"actor_id":"https://sh.itjust.works/c/localllama","local":false,"icon":"https://sh.itjust.works/pictrs/image/8e07ec26-c7e5-4411-a4d5-c0c7a292b773.gif","banner":"https://sh.itjust.works/pictrs/image/5d07b398-7675-4862-8277-5906400b666d.png","hidden":false,"posting_restricted_to_mods":false,"instance_id":3,"visibility":"Public"},"counts":{"comment_id":17999585,"score":0,"upvotes":1,"downvotes":1,"published":"2025-09-06T17:16:26.812043Z","child_count":2},"creator_banned_from_community":false,"banned_from_community":false,"creator_is_moderator":false,"creator_is_admin":false,"subscribed":"NotSubscribed","saved":false,"creator_blocked":false},{"comment":{"id":18000299,"creator_id":19546494,"post_id":33492250,"content":"I am running the Irix model. \r\n\r\nYou can download and run locally any of the non-proprietary models listed there in that leaderboard, so I don't understand what you are trying to say by addressing the leaderboard scripts. Since you have no proof of this happening, and I can't find anything about what you are talking about, you are speaking literal fucking nonsense. \r\n\r\nSo please elaborate. \r\n\r\nThat paragraph about January 6th and 4chanGPT is making me think you are mentally unstable. Please translate that shit into English for me, because either I'm very dumb or we both are.","removed":false,"published":"2025-09-06T18:11:32.773036Z","updated":"2025-09-06T18:13:16.280743Z","deleted":false,"ap_id":"https://piefed.social/comment/7860675","local":false,"path":"0.17996195.17999585.18000299","distinguished":false,"language_id":37},"creator":{"id":19546494,"name":"BaroqueInMind","display_name":"BaroqueInMind","avatar":"https://media.piefed.social/users/NT/tg/NTtgqyyLJXIcxEo.jpeg","banned":false,"published":"2025-07-04T18:41:29.114655Z","actor_id":"https://piefed.social/u/BaroqueInMind","bio":"There's nothing here because my brain is smooth and I have no original thoughts. You made a mistake coming here. ","local":false,"deleted":false,"bot_account":false,"instance_id":3518},"post":{"id":33492250,"name":"What local, small models are you all using?","body":"I'm curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)\n\nWhat do you consider the \"best\" model under ~30B parameters?","creator_id":20896354,"community_id":353,"removed":false,"locked":false,"published":"2025-09-06T03:03:37.574296Z","deleted":false,"nsfw":false,"ap_id":"https://sh.itjust.works/post/45495313","local":false,"language_id":37,"featured_community":false,"featured_local":false},"community":{"id":353,"name":"localllama","title":"LocalLLaMA","description":"Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.\n\nGet support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.\n\nAs ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.\n\nRules:\n\nRule 1 -\nNo harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.\n\nRule 2 -\nNo comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.\n\nRule 3 -\nNo comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as \"llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since .\n\nRule 4 -\nNo implying that models are devoid of purpose or potential for enriching peoples lives.","removed":false,"published":"2023-06-08T18:21:54.578976Z","updated":"2025-06-09T20:51:11.460711Z","deleted":false,"nsfw":false,"actor_id":"https://sh.itjust.works/c/localllama","local":false,"icon":"https://sh.itjust.works/pictrs/image/8e07ec26-c7e5-4411-a4d5-c0c7a292b773.gif","banner":"https://sh.itjust.works/pictrs/image/5d07b398-7675-4862-8277-5906400b666d.png","hidden":false,"posting_restricted_to_mods":false,"instance_id":3,"visibility":"Public"},"counts":{"comment_id":18000299,"score":2,"upvotes":2,"downvotes":0,"published":"2025-09-06T18:11:32.773036Z","child_count":1},"creator_banned_from_community":false,"banned_from_community":false,"creator_is_moderator":false,"creator_is_admin":false,"subscribed":"NotSubscribed","saved":false,"creator_blocked":false},{"comment":{"id":18011174,"creator_id":19546494,"post_id":33492250,"content":"The votes here seem to disagree with you","removed":false,"published":"2025-09-07T12:07:34.440195Z","deleted":false,"ap_id":"https://piefed.social/comment/7869233","local":false,"path":"0.17996195.18009210.18011174","distinguished":false,"language_id":37},"creator":{"id":19546494,"name":"BaroqueInMind","display_name":"BaroqueInMind","avatar":"https://media.piefed.social/users/NT/tg/NTtgqyyLJXIcxEo.jpeg","banned":false,"published":"2025-07-04T18:41:29.114655Z","actor_id":"https://piefed.social/u/BaroqueInMind","bio":"There's nothing here because my brain is smooth and I have no original thoughts. You made a mistake coming here. ","local":false,"deleted":false,"bot_account":false,"instance_id":3518},"post":{"id":33492250,"name":"What local, small models are you all using?","body":"I'm curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)\n\nWhat do you consider the \"best\" model under ~30B parameters?","creator_id":20896354,"community_id":353,"removed":false,"locked":false,"published":"2025-09-06T03:03:37.574296Z","deleted":false,"nsfw":false,"ap_id":"https://sh.itjust.works/post/45495313","local":false,"language_id":37,"featured_community":false,"featured_local":false},"community":{"id":353,"name":"localllama","title":"LocalLLaMA","description":"Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.\n\nGet support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.\n\nAs ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.\n\nRules:\n\nRule 1 -\nNo harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.\n\nRule 2 -\nNo comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.\n\nRule 3 -\nNo comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as \"llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since .\n\nRule 4 -\nNo implying that models are devoid of purpose or potential for enriching peoples lives.","removed":false,"published":"2023-06-08T18:21:54.578976Z","updated":"2025-06-09T20:51:11.460711Z","deleted":false,"nsfw":false,"actor_id":"https://sh.itjust.works/c/localllama","local":false,"icon":"https://sh.itjust.works/pictrs/image/8e07ec26-c7e5-4411-a4d5-c0c7a292b773.gif","banner":"https://sh.itjust.works/pictrs/image/5d07b398-7675-4862-8277-5906400b666d.png","hidden":false,"posting_restricted_to_mods":false,"instance_id":3,"visibility":"Public"},"counts":{"comment_id":18011174,"score":2,"upvotes":2,"downvotes":0,"published":"2025-09-07T12:07:34.440195Z","child_count":1},"creator_banned_from_community":false,"banned_from_community":false,"creator_is_moderator":false,"creator_is_admin":false,"subscribed":"NotSubscribed","saved":false,"creator_blocked":false}]}