GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
NU
NuExtract tiny
Nuextract · mradermacher
Params464M
Context32K
Q4_K_M0.3 GB
VI
ImageQuality R1 v1
Visualquality · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
RL
rlve opd teacher R1Distill 004 Path NoGoingBack Counting 20261025
Rlve · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
AD
AdaptThink 7B delta0.05
Adaptthink · tinyopsec
Params7.62B
Context128K
Q4_K_M4.7 GB
GL
THUDM/GLM-4-32B-Base-0414
GLM · DevQuasar-12
Params32.6B
Context32K
Q4_K_M19.7 GB
QW
Qwen SEA LION v4 8B VL
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
UnifiedReward Think Qwen3Vl 4b
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
GL
GLM 5.3 Flash GM E32
GLM · cgg507
Params321B
Context1024K
Q4_K_M207.4 GB
OH
Ohm MythosNano
Ohm · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
LI
Ling 3.0 tiny MXFP4 MOE
Ling · noctrex
Params7.89B
Context128K
Smallest4.9 GB
GU
GUI Actor Verifier 2B
Gui · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GG
ggml CLIP ViT B 32 laion2B s34B b79K
Ggml · mys
Params151M
Context—
Smallest0.0 GB
IN
InternVL2_5 1B
Internvl · mradermacher
Params630M
Context32K
Q4_K_M0.5 GB
TI
ModelCloud Tinyllama 15M Stories
Tinyllama · tensorblock
Params15M
Context256
Smallest0.0 GB
GL
GLM 4.7 Flash Ultimate Uncensored Heretic
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
PH
Phi 3 Mini 128k Instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
QU
quantum circuit qubo 3B
Quantum · mradermacher
Params3.4B
Context32K
Q4_K_M2.1 GB
LI
Ling flash 2.0 i1
Ling · mradermacher
Params103B
Context32K
Smallest0.3 GB
PH
Phi 4 Mini Instruct
Phi · DuoNeural
Params3.84B
Context128K
Q4_K_M2.5 GB
GE
Gemma 2 2B Indian Law i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
CobrIX 1.0 Coder Full 72B A18B
Qwythos · CobrIX
Params71.8B
Context1024K
Q4_K_M43.7 GB
RE
RealSafe R1 32B
Realsafe · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Majority Voting Qwen3 4B Base
Qwen · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
SU
SuperDeepseek V4 Flash abliterated IK
Superdeepseek · KeinNiemand
Params284B
Context1024K
Smallest65.4 GB
PH
Moxoff Phi3Mini DPO i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3.5 mini ITA i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
NE
Next 70b
Next · thelamapi
Params70.6B
Context128K
Q4_K_M42.5 GB
GL
GLM 4.6 Derestricted
GLM · mradermacher
Params357B
Context198K
Smallest130.0 GB
DE
DeepSeek-R1-Distill-Qwen-7B
DeepSeek · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
LL
GAD GPT 5 Chat Llama 3.1 8B Instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB