GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
GL
GLM 5.2
GLM · unsloth
Params754B
Context1024K
Q4_K_M465.8 GB
BG
bge-large-en-v1.5
BGE · CompendiumLabs
Params334M
Context512
Q4_K_M0.2 GB
DE
DeepSeek V4.1 Flash 1017 Maya
DeepSeek · peasantsmith
Params748B
Context—
Smallest276.6 GB
BG
bge-base-en-v1.5
BGE · CompendiumLabs
Params109M
Context512
Q4_K_M0.1 GB
PH
Phi 4 Mini Instruct
Phi · unsloth
Params3.84B
Context128K
Q4_K_M2.5 GB
DE
DeepSeek V4.1 Flash 1017 ds4
DeepSeek · nazeshinjite
Params755B
Context—
Smallest1.0 GB
PH
Phi 4 Mini Instruct
Phi · bartowski
Params3.84B
Context128K
Q4_K_M2.5 GB
CP
CPH Community 7B
Cph · CypherTroopers
Params7B
Context—
Q4_K_M0.0 GB
VI
VibeVoice-ASR-Streaming-7B
Vibevoice · audio-cpp
Params7B
Context—
Smallest5.9 GB
DE
DeepSeek-V4-Pro-0813
DeepSeek · unsloth
Params1570B
Context1024K
Smallest849.7 GB
VI
VibeVoice ASR Streaming 1.5B
Vibevoice · christopherthompson81
Params3.1B
Context—
Smallest2.1 GB
QW
qmd query expansion 1.7B
Qwen · tobil
Params2.03B
Context40K
Q4_K_M1.3 GB
LI
Ling 3.0 Flash Dspark
Ling · bloomer010
Params127B
Context256K
Q4_K_M0.7 GB
VI
VibeVoice ASR BitNet
Vibevoice · microsoft
Params1.78B
Context—
Smallest0.7 GB
DE
DeepSeek V4.1 Flash GSQ RCO
DeepSeek · pfeifferj
Params748B
Context—
Smallest9.3 GB
GI
GigaAM v3 E2E-RNN-T
Gigaam · handy-computer
Params223M
Context—
Q4_K_M0.2 GB
DE
DeepSeek V4.1 Flash
DeepSeek · audreyt
Params755B
Context—
Smallest365.7 GB
LI
LING 3.0 FLASH ABLITERATED
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
SC
SCAIL 2
Scail · realrebelai
Params16.4B
Context—
Q4_K_M10.9 GB
BG
bge m3
BGE · gpustack
Params567M
Context8K
Q4_K_M0.4 GB
DE
DeepSeek V4.1 Flash 1017 Vision Encoder
DeepSeek · kyuz0
Params755B
Context—
Smallest1.0 GB
ST
stories15M MOE
Stories · ggml-org
Params8M
Context256
Smallest0.0 GB
DE
DeepSeek V4.1 Flash UNCENSORED DwarfStar Q2
DeepSeek · pyrodog
Params490M
Context—
Smallest1.0 GB
HU
Cyber Tiel Coder 35B A3B
Huihui · peculiar-ragdoll
Params34.7B
Context256K
Q4_K_M22.1 GB
GL
GLM-5.3-Flash
GLM · GCSA-AiLab
Params313B
Context1024K
Smallest137.1 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · lmstudio-community
Params8.19B
Context128K
Q4_K_M5.0 GB
LI
Ling 3.0 Tiny
Ling · bartowski
Params7.89B
Context128K
Q4_K_M4.9 GB
GL
GLM 5.3 Flash
GLM · huihui-ai
Params321B
Context1024K
Smallest93.1 GB
PH
Phi 3.5 Mini Instruct
Phi · MaziyarPanahi
Params3.82B
Context128K
Q4_K_M2.4 GB
FR
FrogNano 4B 2609
Frognano · bartowski
Params4.33B
Context256K
Q4_K_M2.8 GB