GGUF models by gaianet

231 GGUF models quantized by gaianet on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 Coder 30B A3B Instruct
Qwen · gaianet
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Qwen3 1.7B
Qwen · gaianet
Params2.03B
Context40K
Q4_K_M1.3 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · gaianet
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct
Qwen · gaianet
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
LL
Llama 3.2 1B Instruct
Llama · gaianet
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · gaianet
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
PH
Phi 4 Mini Instruct
Phi · gaianet
Params3.84B
Context128K
Q4_K_M2.5 GB
Coding
ST
starcoder2-15b-instruct-v0.1
StarCoder · gaianet
Params16B
Context16K
Q4_K_M9.9 GB
Coding
GE
Gemma 3 4b It
Gemma · gaianet
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · gaianet
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
QW
Qwen2.5 0.5B Instruct
Qwen · gaianet
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Qwen2.5 Coder 7B Instruct
Qwen · gaianet
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
GE
Gemma 3 1b It
Gemma · gaianet
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
NO
Nomic Embed Text v1.5
Nomic · gaianet
Params137M
Context2K
Q4_K_M0.1 GB
CodingEmbedding
IN
Internlm2_5 1_8b Chat
InternLM · gaianet
Params1.89B
Context32K
Q4_K_M1.2 GB
Coding
SE
Seed Coder 8B Instruct
Seed · gaianet
Params8.25B
Context32K
Q4_K_M5.1 GB
Coding
QW
Qwen2.5 Coder 32B Instruct
Qwen · gaianet
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
FL
FLUX.1 Fill dev
Flux · gaianet
Params84M
Context—
Smallest0.3 GB
GGUF
ST
stable diffusion 3.5 medium
Stable · gaianet
Params695M
Context—
Smallest0.1 GB
GGUF
QW
Qwen2.5 32B Instruct
Qwen · gaianet
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
MI
MiniCPM V 2 6
MiniCPM · gaianet
Params7.6B
Context32K
Q4_K_M4.7 GB
CodingVision
QW
Qwen2.5 Coder 3B Instruct
Qwen · gaianet
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
QW
Qwen2.5 14B Instruct
Qwen · gaianet
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
SM
SmolVLM2 256M Video Instruct
Smolvlm · gaianet
Params163M
Context8K
Q4_K_M0.1 GB
Vision
PH
Phi 3 Mini 128k Instruct
Phi · gaianet
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
QW
Qwen3 8B
Qwen · gaianet
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
ME
Medgemma 27b Text It
Medgemma · gaianet
Params27B
Context128K
Q4_K_M16.5 GB
Vision
DE
DeepSeek Coder V2 Instruct
DeepSeek · gaianet
Params236B
Context160K
Q4_K_M142.5 GB
Coding
JI
jina embeddings v2 base de
Jina · gaianet
Params160M
Context8K
Q4_K_M0.1 GB
CodingEmbedding

About gaianet on Hugging Face

gaianet has published 231 GGUF models that ggufmodels.com tracks, across families such as Qwen, Llama and Gemma. The most downloaded are Qwen3 Coder 30B A3B Instruct, Qwen3 1.7B and Qwen2.5 3B Instruct.

The quants gaianet publishes most often are Q5_K_M (220), F16 (212), Q8_0 (203) and Q5_0 (202). Their Q4_K_M files range from 0.1 to 142.5 GB. Parameter counts run from 23M to 236B, and the longest trained context window is 10240K tokens.

Frequently asked questions

What GGUF models has gaianet published?

231 models are listed here, mainly from the Qwen, Llama and Gemma families. The most downloaded is Qwen3 Coder 30B A3B Instruct.

Which quants does gaianet publish?

The most common are Q5_K_M (220 models), F16 (212 models), Q8_0 (203 models) and Q5_0 (202 models).

Keep browsing