GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
LL
LLaDA 8B Base
Llada · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
LL
SimNPO WMDP llama3 8b
Llama · tinyopsec
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Qwen 14B Heretic
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
SP
Spark 1.5B ScienceWorld
Spark · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
GP
Gpt Nyc Small
Gpt · mradermacher
Params125M
Context1K
Q4_K_M0.1 GB
QW
Qwen2.5 7B Instruct Fs1 2708
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
FA
FastContext 1.0 4B SFT
Fastcontext · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
AU
authormist originality i1
Authormist · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
BI
Biomni R0 32B Preview
Biomni · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
PH
Phi 3.5 MoE Instruct
Phi · second-state
Params41.9B
Context128K
Q4_K_M25.3 GB
WH
When2Think 1.5B
When · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
MM
mmBERT Base
Mmbert · mykor
Params307M
Context8K
Q4_K_M0.2 GB
PH
phi 3 mini 4k instruct.Q4 0
Phi · Jaward
Params3.82B
Context4K
Smallest2.2 GB
AT
Atlas Flash 1.5B Preview
Atlas · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Self Certainty Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ZE
Zephyr 7b Sft Full SPIN Iter0
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HU
Cyber Tiel Coder 35B A3B
Huihui · ArkhAngelLifeJiggy
Params34.7B
Context256K
Q4_K_M22.1 GB
GL
GLM 4.7 Flash Ilograph
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
CO
CodeNinja 1.0 OpenChat 7B i1
Codeninja · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
QW
Qwerus 7B
Qwerus · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
LI
Ling Coder Lite Base
Ling · mradermacher
Params16.8B
Context4K
Q4_K_M11.2 GB
DE
Model Deepseek Ai DeepSeek R1 Distill Qwen 1.5B Cache
DeepSeek · Alcoft
Params1.78B
Context128K
Q4_K_M1.1 GB
PH
Phi 4 Mini Reasoning Heretic
Phi · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
LL
Cakrawala Llama 3.1 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
PI
PIPer 8B RL Only
Piper · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
LL
LLaDA 8B Instruct
Llada · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB
MI
Mistroll 7B v2.2 i1
Mistroll · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MM
MMaDA 8B MixCoT
Mmada · mradermacher
Params8.08B
Context4K
Q4_K_M5.0 GB
OR
Orsta 7B
Orsta · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
BG
bge-base-zh-v1.5
BGE · CompendiumLabs
Params102M
Context512
Q4_K_M0.1 GB