GGUF models by Edge-Quant

79 GGUF models quantized by Edge-Quant on Hugging Face. Sizes run from 16M to 9.4B parameters. The longest trained context is 501K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
Phi 4 Mini Instruct
Phi · Edge-Quant
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
EX
EXAONE 4.0 1.2B
Exaone · Edge-Quant
Params1.28B
Context64K
Q4_K_M0.8 GB
GGUF
DA
DASD 4B Thinking
Dasd · Edge-Quant
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
LL
Llama 3.2 1B Instruct Hindi Q4 K M
Llama · Edge-Quant
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use
EX
EXAONE 3.5 2.4B Instruct
Exaone · Edge-Quant
Params2.41B
Context32K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.0 350m
Granite · Edge-Quant
Params352M
Context32K
Smallest0.4 GB
GGUF
GR
Granite 4.0 1b
Granite · Edge-Quant
Params1.63B
Context128K
Q4_K_M1.0 GB
GGUF
NA
Nanbeige4.1 3B
Nanbeige · Edge-Quant
Params3.93B
Context192K
Smallest3.2 GB
ReasoningTool use
NE
OpenReasoning Nemotron 1.5B
Nemotron · Edge-Quant
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingReasoning
OP
Open1 1.5B Instruct
Open · Edge-Quant
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use
YU
YuE s2 1B general Q4 K M
Yue · Edge-Quant
Params1.96B
Context8K
Q4_K_M1.3 GB
GGUF
OP
OpenCoder 1.5B Instruct
Opencoder · Edge-Quant
Params1.91B
Context4K
Q4_K_M1.4 GB
Coding
EX
EXAONE 4.0 1.2B
Exaone · Edge-Quant
Params1.28B
Context64K
Smallest0.9 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · Edge-Quant
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
NE
Orchestrator 8B
Nemotron · Edge-Quant
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
TR
Trinity Nano Preview
Trinity · Edge-Quant
Params6.12B
Context128K
Q4_K_M3.8 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · Edge-Quant
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
DA
H2O Danube2 1.8b Chat
Danube · Edge-Quant
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
BI
BitCPM4 1B Q4 K M
Bitcpm · Edge-Quant
Params1.36B
Context32K
Q4_K_M0.8 GB
GGUF
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · Edge-Quant
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
AQ
Aquif 3.6 1B
Aquif · Edge-Quant
Params2.03B
Context40K
Q4_K_M1.3 GB
Reasoning
SM
SmallThinker 4BA0.6B Instruct
Smallthinker · Edge-Quant
Params4.27B
Context32K
Q4_K_M2.6 GB
Tool use
NA
Nanbeige4 3B Thinking 2511
Nanbeige · Edge-Quant
Params3.93B
Context64K
Q4_K_M2.4 GB
ReasoningTool use
MI
Ministral 3b instruct Q4 K M
Mistral · Edge-Quant
Params3.32B
Context128K
Q4_K_M2.0 GB
GGUF
HU
Hunyuan 4B Instruct
Hunyuan · Edge-Quant
Params4.22B
Context256K
Q4_K_M2.6 GB
ReasoningTool use
GE
Gemma 3 1b It
Gemma · Edge-Quant
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
VI
VibeThinker 1.5B
Vibethinker · Edge-Quant
Params1.78B
Context128K
Q4_K_M1.1 GB
Coding
MI
MiroThinker v1.0 8B
Mirothinker · Edge-Quant
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool use
MI
MiniCPM4 0.5B
MiniCPM · Edge-Quant
Params434M
Context32K
Smallest0.5 GB
GGUF
FU
Functiongemma 270m It
Functiongemma · Edge-Quant
Params268M
Context32K
Smallest0.3 GB
GGUF

Keep browsing