GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
OR
Orsta 32B 0326
Orsta · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
PY
PyroNet mini i1
Pyronet · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
DE
DeepSeek-V4.1-Flash-1017
DeepSeek · webmp3
Params748B
Context1024K
Smallest206.9 GB
PH
Phi 4 Mini Instruct
Phi · TAKADOX
Params3.84B
Context128K
Q4_K_M2.5 GB
MI
Midm 2.0 Mini Instruct
Midm · mykor
Params2.31B
Context32K
Q4_K_M1.4 GB
NE
NeuroBERT Mini
Neurobert · mradermacher
Params11M
Context512
Q4_K_M0.0 GB
OC
OceanGPT Basic 30B A3B Thinking
Oceangpt · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
HA
Harrier Oss v1 0.6b
Harrier · lm-kit
Params596M
Context32K
Q4_K_M0.4 GB
BA
e5-base-v2
Base · ChristianAzinn
Params109M
Context512
Q4_K_M0.1 GB
GI
GIST Large Embedding v0
Gist · mradermacher
Params334M
Context512
Q4_K_M0.2 GB
QW
Qwen2.5 Math 7B Think32k
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
SA
Sarashina2.2 Vision 3b
Sarashina · mradermacher
Params3.36B
Context8K
Q4_K_M2.1 GB
QW
Phi 4 QwQ i1
Qwen · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
QW
SmaliLLM Qwen2.5 Coder 0.5B Finetuned
Qwen · mradermacher
Params630M
Context32K
Q4_K_M0.5 GB
GL
GLM 4.6V Flash
GLM · AaryanK
Params9.4B
Context128K
Q4_K_M6.2 GB
RL
RLinf Math 1.5B
Rlinf · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
VP
VPPO 8B
Vppo · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
CH
Chocolatine Admin 3B SFT v0.3b i1
Chocolatine · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
Qwen3-8B-DFlash-b16
Qwen · Anbeeld
Params1.05B
Context40K
Q4_K_M0.6 GB
IN
InternVL2 1B
Internvl · mradermacher
Params630M
Context32K
Q4_K_M0.5 GB
VI
VisualPRM 8B V1_1
Visualprm · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
MM
MM R5
mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
AP
Apriel 1.6 15b Thinker Magic_beta Decensored
Apriel · mradermacher
Params14.4B
Context256K
Q4_K_M8.8 GB
MI
Nexus IKM Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
MentaLLaMA Chat 7B
Mentallama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
OP
OPRM RgFT 32B
Oprm · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
SV
SVILA 1 4B
Svila · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
DE
deepseek r1 distill qwen 1.5b
DeepSeek · cortexso
Params1.78B
Context128K
Q4_K_M1.1 GB
LA
Lattice Quark 1.5B SFT
Lattice · oli-mebberson
Params1.5B
Context2K
Q4_K_M0.9 GB
CE
Cerebras OPT Fusion
Cerebras · mradermacher
Params6.86B
Context2K
Q4_K_M4.4 GB