GGUF models by gaianet

231 GGUF models quantized by gaianet on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3_1 Nemotron 51B Instruct
Llama · gaianet
Params51.5B
Context128K
Q4_K_M31.0 GB
CodingTool use
QW
Qwen2.5 72B Instruct
Qwen · gaianet
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
LL
Llama 3 Taiwan 70B Instruct Rc3
Llama · gaianet
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
GE
Gemma 3 12b It
Gemma · gaianet
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
LL
Llama 3.2 3B Instruct
Llama · gaianet
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
Qwen2.5 Math 1.5B Instruct
Qwen · gaianet
Params1.54B
Context4K
Q4_K_M1.0 GB
CodingTool use
XL
xLAM 1b Fc R
Xlam · gaianet
Params1.35B
Context16K
Q4_K_M0.9 GB
Tool use
LL
Llama-3-Groq-8B-Tool-Use
Llama · gaianet
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
PH
Phi 3 medium 128k instruct
Phi · gaianet
Params14B
Context128K
Q4_K_M8.6 GB
Coding
QW
Qwen2.5 Math 7B Instruct
Qwen · gaianet
Params7.62B
Context4K
Q4_K_M4.7 GB
CodingTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · gaianet
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
QW
Qwen3 30B A3B Thinking 2507
Qwen · gaianet
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
PH
Phi 3 Mini 4k Instruct
Phi · gaianet
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
SK
Sky T1 32B Preview
Sky · gaianet
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
FA
Falcon3 10B Instruct
Falcon · gaianet
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · gaianet
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
BI
Bielik 4.5B v3.0 Instruct
Bielik · gaianet
Params4.76B
Context8K
Q4_K_M2.9 GB
GGUF
FU
functionary medium v3.1
Functionary · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
CodingTool use
EM
Embeddinggemma 300m
Embeddinggemma · gaianet
Params303M
Context2K
Q4_K_M0.2 GB
Embedding
QW
Gte Qwen2 7B Instruct
Qwen · gaianet
Params7.61B
Context128K
Q4_K_M4.7 GB
Coding
PH
phi 4
Phi · gaianet
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
QW
Qwen2.5 7B Instruct
Qwen · gaianet
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
YI
Yi-1.5-6B-Chat
Yi · gaianet
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · gaianet
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
FA
Falcon3 3B Instruct
Falcon · gaianet
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
QW
Qwen2 VL 2B Instruct
Qwen · gaianet
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
GE
Gemma 3n E4B It
Gemma · gaianet
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
MI
Mistral-7B-Instruct-v0.3
Mistral · gaianet
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LL
r1 1776 distill llama 70b
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
FU
functionary small v3.2
Functionary · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use

Keep browsing