LLM Models

Name File Language Size Status Action
smollm2-135m-instruct-iq3_xxs SmolLM2-135M-Instruct-iq3_xxs.gguf English 78.4 MB Installed
smollm2-135m-instruct-q4_0 SmolLM2-135M-Instruct-q4_0.gguf English 77.6 MB Installed
smollm2-135m-instruct-q5_1 SmolLM2-135M-Instruct-q5_1.gguf English 103.0 MB Installed
qwen2.5-0.5b-instruct-q5_k_m qwen2.5-0.5b-instruct-q5_k_m.gguf English 520.0 MB Installed
tinyllama-1.1b-chat-q4_k_m tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf English 667.0 MB Installed
smollm2-1.7b-instruct-q4_k_m SmolLM2-1.7B-Instruct-Q4_K_M.gguf English 1024.0 MB Installed