GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
UM
CENTAURUS Components v2
Uma · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 2 9B Chinese Chat Uncensored
Gemma · fengpeisheng1
Params9.24B
Context8K
Smallest5.4 GB
GL
THUDM/GLM-4-9B-0414
GLM · DevQuasar-12
Params9.4B
Context32K
Q4_K_M6.2 GB
DE
DeepSeek-R1-Distill-Qwen-32B
DeepSeek · Mungert
Params32.8B
Context128K
Q4_K_M20.1 GB
NU
NuExtract tiny Resume Data Extractor
Nuextract · nimendraai
Params494M
Context32K
Q4_K_M0.4 GB
KA
KaLM Embedding Multilingual Mini Instruct v1.5
Kalm · mradermacher
Params494M
Context128K
Q4_K_M0.4 GB
OC
OceanGPT Basic 30B A3B Instruct
Oceangpt · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
OC
OceanGPT-14B-v0.1
Oceangpt · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
TI
stories converted
Tinyllamas · shibatch
Params24M
Context128
Smallest0.0 GB
TH
Thau Agi v2
Thau · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
CE
Celune 1.7B Neutral
Celune · mradermacher
Params1.73B
Context32K
Q4_K_M1.0 GB
LU
Luna 7B A4B PaperWitch Heresy
Luna · mradermacher
Params6.71B
Context256K
Q4_K_M4.1 GB
LC
LCARS AI StarTrek Computer
Lcars · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
SAM3DBody cpp onnx models
Sam · AmmarkoV
Params7M
Context—
Smallest0.0 GB
OP
OptiMind SFT
Optimind · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
QW
micro-qwen4exp-realqsa-mtp
Qwen · Lynxpda
Params207M
Context256K
Q4_K_M0.1 GB
QW
Qwen2.5 7B ARPO
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
MO
sapienzanlp_modello-italia-9b
Modello · fbaldassarri
Params8.54B
Context4K
Q4_K_M5.5 GB
NU
NuExtract 2.0 4B
Nuextract · numind
Params3.09B
Context125K
Q4_K_M1.9 GB
LL
GlotMAX 101 14B
Llama · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
OR
RegesCore 1.0 9B
Ornith · iBossonline
Params8.95B
Context256K
Q4_K_M5.6 GB
DE
Deepseek R1 14b Cot Math Reasoning Full
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GL
Huihui GLM 4.5V Abliterated
GLM · mradermacher
Params107B
Context64K
Q4_K_M70.4 GB
QW
Noor ul ilm 7B Qwen 15 3 2026
Qwen · OpenNoorIlm
Params7.62B
Context32K
Q4_K_M4.7 GB
BI
BioMistral Clinical 7B
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
TimeCapsuleLLM v2 llama 1.2B
Llama · ncky
Params1.15B
Context2K
Q4_K_M0.7 GB
DE
DeepSeek R1 Distill Qwen 32B 3MPER0RR Abliterated
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
LI
Ling Lite 1.5 2506
Ling · mradermacher
Params16.8B
Context32K
Q4_K_M11.2 GB
GL
GLM-5.2 EXTENSOR Q2_K Experts v1
GLM · amd
Params743B
Context1024K
Smallest258.5 GB
QW
Parm 2 CoT 14B 16k o1 QwQ i1
Qwen · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB