GGUF models by gaianet
231 GGUF models quantized by gaianet on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.
CO
Yi Coder 9B Chat
Coder · gaianet
Params8.83B
Context128K
Q4_K_M5.3 GB
YI
Yi-1.5-9B-Chat-16K
Yi · gaianet
Params8.83B
Context16K
Q4_K_M5.3 GB
QW
Qwen2.5 1.5B Instruct
Qwen · gaianet
Params1.54B
Context32K
Q4_K_M1.0 GB
VI
vitalik.eth 13b
Vitalik · gaianet
Params49M
Context128
Smallest0.2 GB
QW
Qwen2-1.5B-Instruct
Qwen · gaianet
Params1.54B
Context32K
Q4_K_M1.0 GB
XL
xLAM 8x7b R
Xlam · gaianet
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
QwQ 32B
Qwen · gaianet
Params32.8B
Context128K
Q4_K_M19.9 GB
MI
MiniCPM V 4 5
MiniCPM · gaianet
Params8.2B
Context40K
Q4_K_M5.0 GB
PH
Phi 4 Reasoning Plus
Phi · gaianet
Params14.7B
Context32K
Q4_K_M9.1 GB
SM
SmolLM 135M Instruct
SmolLM · gaianet
Params135M
Context2K
Q4_K_M0.1 GB
JI
jina embeddings v2 base code
Jina · gaianet
Params160M
Context8K
Q4_K_M0.1 GB
QW
Qwen3 4B
Qwen · gaianet
Params4.02B
Context40K
Q4_K_M2.5 GB
CO
Yi Coder 1.5B Chat
Coder · gaianet
Params1.48B
Context128K
Q4_K_M1.0 GB
SM
SmolVLM2 2.2B Instruct
Smolvlm · gaianet
Params1.81B
Context8K
Q4_K_M1.1 GB
QW
Qwen2 Audio 7B Instruct
Qwen · gaianet
Params7.75B
Context8K
Q4_K_M4.8 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · gaianet
Params8.89B
Context1024K
Q4_K_M6.5 GB
GE
Gemma 3 27b It
Gemma · gaianet
Params27B
Context128K
Q4_K_M16.5 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · gaianet
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Qwen3 30B A3B Instruct 2507
Qwen · gaianet
Params30.5B
Context256K
Q4_K_M18.6 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB
YI
Yi-1.5-9B-Chat
Yi · gaianet
Params8.83B
Context4K
Q4_K_M5.3 GB
QW
Qwen2-72B-Instruct
Qwen · gaianet
Params72.7B
Context32K
Q4_K_M47.4 GB
JI
jina embeddings v2 base en
Jina · gaianet
Params137M
Context8K
Q4_K_M0.1 GB
MI
Codestral-22B-v0.1-hf
Mistral · gaianet
Params22.2B
Context32K
Q4_K_M13.3 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · gaianet
Params32.8B
Context128K
Q4_K_M19.9 GB
BR
Breeze 7B Instruct V1_0
Breeze · gaianet
Params7.49B
Context32K
Q4_K_M4.5 GB
BI
Bielik 1.5B v3.0 Instruct
Bielik · gaianet
Params1.6B
Context8K
Q4_K_M1.0 GB
QW
Qwen3 30B A3B
Qwen · gaianet
Params30.5B
Context40K
Q4_K_M18.6 GB
MI
MiniCPM V 4
MiniCPM · gaianet
Params3.61B
Context32K
Q4_K_M2.2 GB
PA
Palmyra Med 70B 32K
Palmyra · gaianet
Params70.6B
Context32K
Q4_K_M42.5 GB