All GGUF models

206,171 models with specs, quants and memory estimates.

LF
LFM2.5-1.2B-Thinking
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
GE
gemma 4 12B it uncensored
Gemma · TrevorJS
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
QW
Ingot XIII 27B Q2
Qwen · dendriteholdings
Params26.9B
Context256K
Smallest5.9 GB
ReasoningTool use
MU
Music Flamingo Hf
Music · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
ReasoningVision
MI
MiniCPM V 4.7 35B A3B
MiniCPM · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen2.5 0.5B Instruct
Qwen · lmstudio-community
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
KI
Kimi-K2.5
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
GGUF
QW
Qwen3-30B-A3B-Thinking-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
QW
Qwen3.5-0.8B
Qwen · unsloth
Params773M
Context256K
Q4_K_M0.5 GB
Vision
QW
Qwen3.8-27B
Qwen · 6block
Params27B
Context256K
Q4_K_M17.7 GB
Vision
DE
Deepseek-V3.1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
GGUF
QW
Qwen3.5 4B NSFW ARA Heretic Literotica i1
Qwen · Sinbad-The-Sailor
Params4.2B
Context256K
Q4_K_M2.7 GB
GGUF
LL
Nidum Llama 3.2 3B Uncensored
Llama · lemuralabs
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingRoleplay
QW
Huihui Qwen3.5 9B Abliterated
Qwen · Abiray
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwen3.6 35B A3B Anko
Qwen · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
LL
Llm Jp 4.1 32b A3B Thinking
Llm · llm-jp
Params32B
Context64K
Q4_K_M21.5 GB
Reasoning
QW
Qwen_Qwen3 VL 30B A3B Instruct
Qwen · lmstudio-community
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
NA
Nanonets-Ocr-S
Nanonets · unsloth
Params3.1B
Context125K
Q4_K_M1.9 GB
Vision
OR
Ornith
Ornith · pfeifferj
Params34.7B
Context256K
Smallest13.0 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · lmstudio-community
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
QW
Qwen3.8 Flash Next Uncensored ik llama
Qwen · ji-farthing
Params177B
Context—
Smallest2.2 GB
GGUF
QW
Qwen 3 8b Heretic
Qwen · DreamFast
Params8.19B
Context40K
Q4_K_M5.0 GB
Coding
MI
MiMo-V2.6-Flash-RL
Mimo · YanissAmz
Params310B
Context1024K
Smallest107.8 GB
GGUF
GE
gemma 4 12B it heretic QAT
Gemma · SC117
Params11.9B
Context256K
Smallest6.7 GB
CodingVision
GA
GalTransl v4 4B 2601
Galtransl · SakuraLLM
Params4B
Context32K
Smallest2.8 GB
GGUF
VE
UI Venus 2 9B
Venus · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
QW
Dongfangshuo Qwen3.8 27B NSFW Novel
Qwen · dongfangshuo
Params27B
Context256K
Q4_K_M16.5 GB
RoleplayVision
AR
Artemis 31B v1.2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
MU
Murasaki 4B v0.3
Murasaki · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
GGUF
QW
Huihui Qwen3.5 35B A3B Abliterated
Qwen · HeYujie
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision

Jump to a hub