GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
LL
LLaMAX3 8B Alpaca
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
FA
Fara1.5 9B
Fara · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
DE
deepseek v4.1 flash gguf mirror
DeepSeek · hyukudan
Params755B
Context—
Smallest8.0 GB
QW
Qwen 2.5 7B Instruct novel lora
Qwen · cgxjdzz
Params7.62B
Context32K
Q4_K_M4.7 GB
GL
GLM 4.6V
GLM · bartowski
Params107B
Context128K
Q4_K_M71.4 GB
PU
public poetry 50m
Public · wildfellhall
Params47M
Context1K
Smallest0.1 GB
SY
SynLogic 7B Sft Gold v1
Synlogic · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
MiMo V2.6 Distill Qwen 9B Ablit
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
MiMo V2 Flash
Mimo · bartowski
Params309B
Context256K
Q4_K_M187.1 GB
AS
Asclepio 8B
Asclepio · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
DE
DeepSeek V4 Flash DSpark draft
DeepSeek · YanissAmz
Params19.8B
Context—
Smallest10.9 GB
LO
LongCat Flash Lite Sparse Uncensored Heretic Native MTP And LSA Preserved
Longcat · llmfan46
Params69B
Context960K
Q4_K_M41.2 GB
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · legraphista
Params14B
Context4K
Smallest3.1 GB
SI
UI Simulator R Web i1
Simulator · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
JO
JOSIE 2 9B OSS
Josie · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
PH
Phi 3 mini 3.8b 4Bit InstructionTuned Alpaca
Phi · Chituyi
Params3.82B
Context4K
Q4_K_M2.3 GB
LL
UserLM-8b
Llama · Mungert
Params8.03B
Context8K
Q4_K_M5.3 GB
GL
GLM 4.7 Flash Impotent Heresy
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
WH
whisper small
Whisper · oxide-lab
Params242M
Context—
Smallest0.1 GB
LO
LongCat Flash Lite Uncensored Heretic Native MTP Preserved
Longcat · llmfan46
Params69.1B
Context320K
Q4_K_M40.3 GB
CA
calme-2.1-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
HF
hft transformer
Hft · cstr
Params6M
Context—
Smallest0.0 GB
IR
irodori tts
Irodori · cstr
Params98M
Context—
Smallest0.0 GB
ST
stockmark 100b
Stockmark · mmnga
Params96.2B
Context4K
Smallest20.4 GB
PA
MS3.2 PaintedFantasy v4.1 24B Heretic v2
Paintedfantasy · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
AU
AutoGLM Phone 9B
Autoglm · BlcaCola
Params9.4B
Context64K
Q4_K_M6.2 GB
LI
Ling 3.0 Tiny
Ling · WhiskyAKM
Params7.89B
Context128K
Q4_K_M4.8 GB
LL
LLM4Binary.llm4decompile 6.7b v1.5
Llm · DevQuasar-7
Params6.74B
Context8K
Q4_K_M4.1 GB
DE
DeepSeek V4.1 Flash 1017 UNCENSORED VQ
DeepSeek · Baekpica
Params485M
Context—
Smallest1.0 GB
LL
LLaDA 1.5
Llada · mradermacher
Params8.02B
Context4K
Q4_K_M4.9 GB