GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
YI
models--01-ai--Yi-1.5-6B-Chat
Yi · MaziyarPanahi
Params6.06B
Context4K
Q4_K_M3.7 GB
MI
Models Mistralai Mistral Nemo Instruct 2407
Mistral · MaziyarPanahi
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · thesven
Params7B
Context32K
Q4_K_M4.4 GB
WH
Whisper Large
Whisper · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
QW
Qwen3.8 27B TWIN TURBO Fable Cold Fusion 709 ULTRA HERETIC Uncensored NM DAU NEO MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
QW
Qwen3 VL 32B Instruct ultra uncensored heretic H3
Qwen · nif0
Params25.2B
Context256K
Q4_K_M14.9 GB
QW
Qwen3.5 35B A3B
Qwen · bartowski
Params35.5B
Context256K
Q4_K_M22.3 GB
AU
Audio8-TTS-Preview-0.6b
Audio · js-byte
Params1.3B
Context—
Smallest1.4 GB
QW
Qwen3 ASR 1.7B
Qwen · ggml-org
Params2.03B
Context64K
Smallest2.2 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
SE
SenseVoiceSmall GGUF audiocpp
Sensevoicesmall · FunAudioLLM
Params234M
Context—
Smallest0.3 GB
MI
Models Mistralai Mistral Small 24B Instruct 2501
Mistral · MaziyarPanahi
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Qwen2.5 Coder 14B Instruct Abliterated
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GP
Gpt Oss 20b Heretic
gpt-oss · DavidAU
Params20.9B
Context128K
Smallest11.8 GB
QW
Qwen2.5 Coder 14B Instruct
Qwen · lmstudio-community
Params14.8B
Context32K
Q4_K_M9.0 GB
GE
Gemma-4-E2B-It
Gemma · ente-ai
Params4.65B
Context128K
Q4_K_M3.1 GB
SM
SmolVLM2 2.2B Instruct
Smolvlm · ggml-org
Params1.81B
Context8K
Q4_K_M1.1 GB
QW
Models Qwen QwQ 32B
Qwen · MaziyarPanahi
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Qwen3.6-27B-Uncensored-HauhauCS-Balanced
Qwen · HauhauCS
Params27B
Context256K
Smallest10.0 GB
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
IN
Models PrimeIntellect INTELLECT 2
Intellect · MaziyarPanahi
Params32.8B
Context40K
Q4_K_M19.9 GB
QW
Text_Encoder
Qwen · pottokao
Params26.5B
Context256K
Smallest11.5 GB
QW
Qwen3.5 4B Claude 4.6 Opus Reasoning Distilled
Qwen · Jackrong
Params4.2B
Context256K
Q4_K_M2.7 GB
GE
gemma-4-31B-it
Gemma · ggml-org
Params30.7B
Context256K
Smallest0.3 GB
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GE
Gemma 4 31B
Gemma · lmstudio-community
Params30.7B
Context256K
Q4_K_M18.7 GB
NE
neutrino instruct
Neutrino · neuralcrew
Params7.25B
Context32K
Smallest4.1 GB
SM
SmolLM3 3B
SmolLM · bartowski
Params3.08B
Context64K
Q4_K_M1.9 GB
WA
Wan2.1 T2V 14B
Wan · city96
Params14.3B
Context—
Q4_K_M10.1 GB
QW
Qwen3 8B
Qwen · lmstudio-community
Params8.19B
Context32K
Q4_K_M5.0 GB