GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
QW
Qwen3.5 2B Claude Opus 4.6 High Resoning Base
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
RA
rank zephyr 7b v1 full
Rank · tinyopsec
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Self Certainty Qwen3 8B Base
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
IN
InnoSpark VPC RM 32B
Innospark · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
JI
JiRackUltra_32b
Jirackultra · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
LI
Ling Coder Lite
Ling · mradermacher
Params16.8B
Context4K
Q4_K_M11.2 GB
SA
SashaSheykina gpt2 finetuned cXg nl to code
Sashasheykina · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
QW
Qwen 0.6b Coder
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
NA
Minnow OCR 1B
Nano · mradermacher
Params891M
Context128K
Q4_K_M0.5 GB
PH
Phi 4 Empathetic i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Phi 3 Mini 4k Grammar Correction
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
VI
Vision DeepResearch 8B
Vision · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
PositiveDetox Qwen2.5 14B
Qwen · theprint
Params14.8B
Context32K
Q4_K_M9.0 GB
GL
GLM 5.3 Flash
GLM · ZHUOZA
Params321B
Context1024K
Smallest104.9 GB
VI
VibeThinker 3B
Vibethinker · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
ZE
Zenith 3B
Zenith · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
EL
elephant 1
Elephant · magnitudedev
Params8.95B
Context256K
Q4_K_M5.6 GB
GR
Groot 280B A16B 261023
Groot · GrootTeam
Params477B
Context1024K
Smallest8.5 GB
TY
Type o1 mini instruct
Type · kd13
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
Es Qwen Math Base 7b 3k Stage2 6k T4 Ds_O2_Aug Kl0.01 Step480
Qwen · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
MI
StructLM 7B Mistral
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
deepsex 34b
Deepsex · TriadParty
Params34.4B
Context4K
Smallest19.5 GB
QW
Qwen3 Next 416E Abliterated Instruct
Qwen · mradermacher
Params65.2B
Context256K
Q4_K_M39.7 GB
SE
SeaLLMs v3 1.5B Chat Uncensored
Seallms · BlossomsAI
Params1.54B
Context128K
Q4_K_M1.0 GB
MY
Myth 4B
Myth · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
DE
tngtech.DeepSeek TNG R1T2 Chimera BF16
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
NO
Noor Fatima 01 gpt2 finetuned summary
Noor · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
QW
Qwen2 VL PRISM DPO
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
RE
ReasonFlux PRM 1.5B
Reasonflux · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB