GGUF models by gaianet
231 GGUF models quantized by gaianet on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.
LL
Llama 3_1 Nemotron 51B Instruct
Llama · gaianet
Params51.5B
Context128K
Q4_K_M31.0 GB
QW
Qwen2.5 72B Instruct
Qwen · gaianet
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
Llama 3 Taiwan 70B Instruct Rc3
Llama · gaianet
Params70.6B
Context8K
Q4_K_M42.5 GB
GE
Gemma 3 12b It
Gemma · gaianet
Params11.8B
Context128K
Q4_K_M7.3 GB
LL
Llama 3.2 3B Instruct
Llama · gaianet
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · gaianet
Params1.54B
Context4K
Q4_K_M1.0 GB
XL
xLAM 1b Fc R
Xlam · gaianet
Params1.35B
Context16K
Q4_K_M0.9 GB
LL
Llama-3-Groq-8B-Tool-Use
Llama · gaianet
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
Phi 3 medium 128k instruct
Phi · gaianet
Params14B
Context128K
Q4_K_M8.6 GB
QW
Qwen2.5 Math 7B Instruct
Qwen · gaianet
Params7.62B
Context4K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · gaianet
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen3 30B A3B Thinking 2507
Qwen · gaianet
Params30.5B
Context256K
Q4_K_M18.6 GB
PH
Phi 3 Mini 4k Instruct
Phi · gaianet
Params3.82B
Context4K
Q4_K_M2.4 GB
SK
Sky T1 32B Preview
Sky · gaianet
Params32.8B
Context32K
Q4_K_M19.9 GB
FA
Falcon3 10B Instruct
Falcon · gaianet
Params10.3B
Context32K
Q4_K_M6.3 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · gaianet
Params23.6B
Context128K
Q4_K_M14.3 GB
BI
Bielik 4.5B v3.0 Instruct
Bielik · gaianet
Params4.76B
Context8K
Q4_K_M2.9 GB
FU
functionary medium v3.1
Functionary · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
EM
Embeddinggemma 300m
Embeddinggemma · gaianet
Params303M
Context2K
Q4_K_M0.2 GB
QW
Gte Qwen2 7B Instruct
Qwen · gaianet
Params7.61B
Context128K
Q4_K_M4.7 GB
PH
phi 4
Phi · gaianet
Params14.7B
Context16K
Q4_K_M9.1 GB
QW
Qwen2.5 7B Instruct
Qwen · gaianet
Params7.62B
Context32K
Q4_K_M4.7 GB
YI
Yi-1.5-6B-Chat
Yi · gaianet
Params6.06B
Context4K
Q4_K_M3.7 GB
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · gaianet
Params494M
Context32K
Q4_K_M0.4 GB
FA
Falcon3 3B Instruct
Falcon · gaianet
Params3.23B
Context32K
Q4_K_M2.0 GB
QW
Qwen2 VL 2B Instruct
Qwen · gaianet
Params1.54B
Context32K
Q4_K_M1.0 GB
GE
Gemma 3n E4B It
Gemma · gaianet
Params6.87B
Context32K
Q4_K_M4.2 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · gaianet
Params7.25B
Context32K
Q4_K_M4.4 GB
LL
r1 1776 distill llama 70b
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
FU
functionary small v3.2
Functionary · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB