GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
OR
Ornith 1.0 35B
Ornith · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
MO
Moonshine Streaming Small
Moonshine · handy-computer
Params140M
Context—
Smallest0.2 GB
BG
bge m3
BGE · lm-kit
Params567M
Context8K
Q4_K_M0.4 GB
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · zerofata
Params107B
Context128K
Smallest65.9 GB
SC
SCAIL Preview
Scail · vantagewithai
Params16.4B
Context—
Q4_K_M11.3 GB
DE
DeepSeek V3.1
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M409.2 GB
HU
Huihui Ornith 1.5 35B A3B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
PR
Prompt Refine
Prompt · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GL
GLM 5.3 Flash UNCENSORED NVFP4 DFlash2
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest1.3 GB
PH
phi 4
Phi · lmstudio-community
Params14.7B
Context16K
Q4_K_M9.1 GB
PH
Phi 3 mini 4k instruct update2024 07 03 IMat
Phi · legraphista
Params3.82B
Context4K
Smallest0.8 GB
DE
DeepSeek V4 Flash 0731 IK
DeepSeek · KeinNiemand
Params284B
Context—
Smallest65.4 GB
PH
phi3.5 gutenberg 4B
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
DE
DeepSeek V4.1 Flash 1017 dsx 2bit
DeepSeek · lxe
Params552B
Context—
Smallest148.1 GB
LI
Ling 3.0 tiny abliterated APEX
Ling · SC117
Params7.9B
Context128K
Smallest3.4 GB
DE
Deepseek-V4-Flash-Vision-Exp
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.4 GB
PH
phi 4
Phi · unsloth
Params14.7B
Context16K
Q4_K_M8.9 GB
OR
Ornith1.0 9B 3MPER0RR Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
PH
Phi 4 Mini Reasoning
Phi · lmstudio-community
Params3.84B
Context128K
Q4_K_M2.5 GB
QW
Qwen3 14B ARPO DeepSearch
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
CY
Cyber Tiel Coder 35B A3B APEX I NanoPlus
Cyber · IsValorum
Params34.7B
Context256K
Smallest1.5 GB
DE
DeepSeek V4.1 Flash 1017 dsx 2.6bit
DeepSeek · icecubetr
Params552B
Context—
Smallest187.6 GB
DE
Deepseek-V3.2
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
PH
Phi 3.1 mini 4k instruct
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
GL
GLM 4.7 Flash Derestricted
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
FA
Fara1.5 4B
Fara · bartowski
Params4.21B
Context256K
Q4_K_M2.9 GB
OR
Tiel Coder 35B A3B APEX I MiniPlus V2.1
Ornith · IsValorum
Params35.5B
Context256K
Smallest15.2 GB
DE
DeepSeek R1 Distill Qwen 7B Uncensored
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
LL
ultravox v0 5 llama 3 2 1b
Llama · ggml-org
Params1.24B
Context128K
Q4_K_M0.8 GB
HU
Huihui Ornith 1.5 35B A3B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB