GGUF models by gaianet

231 GGUF models quantized by gaianet on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
Yi Coder 9B Chat
Coder · gaianet
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
YI
Yi-1.5-9B-Chat-16K
Yi · gaianet
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · gaianet
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
VI
vitalik.eth 13b
Vitalik · gaianet
Params49M
Context128
Smallest0.2 GB
GGUF
QW
Qwen2-1.5B-Instruct
Qwen · gaianet
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
XL
xLAM 8x7b R
Xlam · gaianet
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
QW
QwQ 32B
Qwen · gaianet
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
MI
MiniCPM V 4 5
MiniCPM · gaianet
Params8.2B
Context40K
Q4_K_M5.0 GB
CodingVision
PH
Phi 4 Reasoning Plus
Phi · gaianet
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
SM
SmolLM 135M Instruct
SmolLM · gaianet
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
JI
jina embeddings v2 base code
Jina · gaianet
Params160M
Context8K
Q4_K_M0.1 GB
CodingEmbedding
QW
Qwen3 4B
Qwen · gaianet
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
CO
Yi Coder 1.5B Chat
Coder · gaianet
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
SM
SmolVLM2 2.2B Instruct
Smolvlm · gaianet
Params1.81B
Context8K
Q4_K_M1.1 GB
Vision
QW
Qwen2 Audio 7B Instruct
Qwen · gaianet
Params7.75B
Context8K
Q4_K_M4.8 GB
GGUF
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · gaianet
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
GE
Gemma 3 27b It
Gemma · gaianet
Params27B
Context128K
Q4_K_M16.5 GB
Vision
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · gaianet
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
QW
Qwen3 30B A3B Instruct 2507
Qwen · gaianet
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
YI
Yi-1.5-9B-Chat
Yi · gaianet
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
QW
Qwen2-72B-Instruct
Qwen · gaianet
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
JI
jina embeddings v2 base en
Jina · gaianet
Params137M
Context8K
Q4_K_M0.1 GB
CodingEmbedding
MI
Codestral-22B-v0.1-hf
Mistral · gaianet
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · gaianet
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
BR
Breeze 7B Instruct V1_0
Breeze · gaianet
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
BI
Bielik 1.5B v3.0 Instruct
Bielik · gaianet
Params1.6B
Context8K
Q4_K_M1.0 GB
GGUF
QW
Qwen3 30B A3B
Qwen · gaianet
Params30.5B
Context40K
Q4_K_M18.6 GB
ReasoningTool use
MI
MiniCPM V 4
MiniCPM · gaianet
Params3.61B
Context32K
Q4_K_M2.2 GB
CodingVision
PA
Palmyra Med 70B 32K
Palmyra · gaianet
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF

Keep browsing