@[email protected] to [email protected]English • 7 months agoFirefox introduces AI as experimental featurelemmy.fishimagemessage-square101fedilinkarrow-up1224
arrow-up1224imageFirefox introduces AI as experimental featurelemmy.fish@[email protected] to [email protected]English • 7 months agomessage-square101fedilink
minus-square@[email protected]linkfedilink4•7 months agoCan you point me to some resources to running smol llm? My use case prob just to help “typing” miscellaneous idea I have or check for my grammatical error, in english. Thanks, in advance.
minus-squareSir Arthur V Quackingtonlinkfedilink4•7 months agoHere you go: Review of SmolVLM https://www.marktechpost.com/2024/11/26/hugging-face-releases-smolvlm-a-2b-parameter-vision-language-model-for-on-device-inference/ Model itself: https://huggingface.co/spaces/HuggingFaceTB/SmolVLM And you can use Ollama to run it locally, and Open WebUI to access it in browser.
Can you point me to some resources to running smol llm?
My use case prob just to help “typing” miscellaneous idea I have or check for my grammatical error, in english.
Thanks, in advance.
https://ollama.com/
Here you go: Review of SmolVLM https://www.marktechpost.com/2024/11/26/hugging-face-releases-smolvlm-a-2b-parameter-vision-language-model-for-on-device-inference/
Model itself: https://huggingface.co/spaces/HuggingFaceTB/SmolVLM
And you can use Ollama to run it locally, and Open WebUI to access it in browser.