GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
GLM 5.2
GLM · unsloth
Params754B
Context1024K
Q4_K_M465.8 GB
GGUF
BG
bge-large-en-v1.5
BGE · CompendiumLabs
Params334M
Context512
Q4_K_M0.2 GB
Embedding
DE
DeepSeek V4.1 Flash 1017 Maya
DeepSeek · peasantsmith
Params748B
Context—
Smallest276.6 GB
GGUF
BG
bge-base-en-v1.5
BGE · CompendiumLabs
Params109M
Context512
Q4_K_M0.1 GB
Embedding
PH
Phi 4 Mini Instruct
Phi · unsloth
Params3.84B
Context128K
Q4_K_M2.5 GB
Coding
DE
DeepSeek V4.1 Flash 1017 ds4
DeepSeek · nazeshinjite
Params755B
Context—
Smallest1.0 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · bartowski
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
CP
CPH Community 7B
Cph · CypherTroopers
Params7B
Context—
Q4_K_M0.0 GB
GGUF
VI
VibeVoice-ASR-Streaming-7B
Vibevoice · audio-cpp
Params7B
Context—
Smallest5.9 GB
GGUF
DE
DeepSeek-V4-Pro-0813
DeepSeek · unsloth
Params1570B
Context1024K
Smallest849.7 GB
GGUF
VI
VibeVoice ASR Streaming 1.5B
Vibevoice · christopherthompson81
Params3.1B
Context—
Smallest2.1 GB
GGUF
QW
qmd query expansion 1.7B
Qwen · tobil
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
LI
Ling 3.0 Flash Dspark
Ling · bloomer010
Params127B
Context256K
Q4_K_M0.7 GB
GGUF
VI
VibeVoice ASR BitNet
Vibevoice · microsoft
Params1.78B
Context—
Smallest0.7 GB
GGUF
DE
DeepSeek V4.1 Flash GSQ RCO
DeepSeek · pfeifferj
Params748B
Context—
Smallest9.3 GB
GGUF
GI
GigaAM v3 E2E-RNN-T
Gigaam · handy-computer
Params223M
Context—
Q4_K_M0.2 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · audreyt
Params755B
Context—
Smallest365.7 GB
GGUF
LI
LING 3.0 FLASH ABLITERATED
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
Reasoning
SC
SCAIL 2
Scail · realrebelai
Params16.4B
Context—
Q4_K_M10.9 GB
GGUF
BG
bge m3
BGE · gpustack
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
DE
DeepSeek V4.1 Flash 1017 Vision Encoder
DeepSeek · kyuz0
Params755B
Context—
Smallest1.0 GB
GGUF
ST
stories15M MOE
Stories · ggml-org
Params8M
Context256
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash UNCENSORED DwarfStar Q2
DeepSeek · pyrodog
Params490M
Context—
Smallest1.0 GB
GGUF
HU
Cyber Tiel Coder 35B A3B
Huihui · peculiar-ragdoll
Params34.7B
Context256K
Q4_K_M22.1 GB
CodingReasoningTool use
GL
GLM-5.3-Flash
GLM · GCSA-AiLab
Params313B
Context1024K
Smallest137.1 GB
Vision
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · lmstudio-community
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
LI
Ling 3.0 Tiny
Ling · bartowski
Params7.89B
Context128K
Q4_K_M4.9 GB
GGUF
GL
GLM 5.3 Flash
GLM · huihui-ai
Params321B
Context1024K
Smallest93.1 GB
Vision
PH
Phi 3.5 Mini Instruct
Phi · MaziyarPanahi
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
FR
FrogNano 4B 2609
Frognano · bartowski
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision

Keep browsing