GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
CA
cat-v1.0-13b
Cat · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GL
MuXodious GLM 4.7 Flash absolute heresy APEX
GLM · Koshkasa
Params30B
Context198K
Q4_K_M19.1 GB
Roleplay
NE
Nehuronion Dvt 9b
Nehuronion · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
OR
Ornith 1.5 122B
Ornith · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
ReasoningTool use
RE
Redmond Puffin 13B
Redmond · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DE
deepseek r1
DeepSeek · cortexso
Params70.6B
Context128K
Q4_K_M1.1 GB
Reasoning
CA
CarbonVillain en 10.7B v4
Carbonvillain · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MA
MAmmoTH2-8x7B
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · second-state
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
GL
GLM 4.7 Flash Heretic
GLM · Olafangensan
Params29.9B
Context198K
Q4_K_M18.1 GB
ReasoningTool use
MI
MiMo-V2.6-Pro-MOPD
Mimo · ggml-org
Params1020B
Context1024K
Smallest2.1 GB
Vision
LL
Nous Hermes Llama 2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
Tool use
HA
harrier oss v1 27b
Harrier · Abiray
Params27B
Context128K
Q4_K_M16.6 GB
Embedding
ME
mel band roformer vocals
Mel · cstr
Params228M
Context—
Smallest0.5 GB
GGUF
MO
Moonshine Streaming Tiny
Moonshine · handy-computer
Params44M
Context—
Smallest0.1 GB
GGUF
OR
Ornith 1.5 397B
Ornith · bartowski
Params397B
Context256K
Q4_K_M241.8 GB
Vision
LI
Ling 3.0 Tiny Uncensored Abliterated
Ling · mradermacher
Params7.9B
Context128K
Q4_K_M4.8 GB
Reasoning
CH
chatterbox turbo
Chatterbox · cstr
Params266M
Context—
Smallest0.3 GB
GGUF
DE
Janus Pro 1B
DeepSeek · mradermacher
Params1.65B
Context16K
Q4_K_M1.0 GB
Vision
YI
Faro Yi 34B DPO i1
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
GP
gpt2
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
CR
CREPE (tiny)
Crepe · cstr
Params22M
Context—
Smallest0.0 GB
GGUF
SM
Biggie SmoLlm 0.15B Base
SmolLM · mradermacher
Params181M
Context2K
Q4_K_M0.1 GB
GGUF
DE
Deepseek-V3-0324
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.7 GB
Coding
GL
Huihui GLM 4.6V Flash Abliterated
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
GGUF
GP
gpt2
Gpt · QuantFactory
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B Heretic
DeepSeek · saidutta69
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
CO
beowolx_codeninja-1.0-openchat-7b
Codeninja · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
EL
Elephant 1
Elephant · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
QW
Fathom-Search-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.6 GB
GGUF

Keep browsing