GGUF models by gaianet

231 GGUF models quantized by gaianet on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
glm-4-9b-chat-1m
GLM · gaianet
Params9.48B
Context1024K
Q4_K_M6.3 GB
CodingTool use
FL
FLUX.1 Canny dev
Flux · gaianet
Params11.9B
Context—
Smallest4.2 GB
GGUF
EX
EXAONE 3.5 2.4B Instruct
Exaone · gaianet
Params2.41B
Context32K
Q4_K_M1.5 GB
Coding
NE
Nemotron Mini 4B Instruct
Nemotron · gaianet
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
LL
Llama 4 Scout 17B 16E Instruct
Llama · gaianet
Params108B
Context10240K
Q4_K_M65.4 GB
Tool useVision
SM
SmolLM3 3B
SmolLM · gaianet
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
LL
llm-compiler-7b-ftd
Llm · gaianet
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
MiniCPM Llama3 V 2 5
Llama · gaianet
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingVision
MI
mathstral-7B-v0.1
Mistral · gaianet
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
XL
xLAM 7b Fc R
Xlam · gaianet
Params6.91B
Context4K
Q4_K_M4.2 GB
Tool use
SE
SeaLLMs Audio 7B Chat
Seallms · gaianet
Params7.64B
Context8K
Q4_K_M4.7 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · gaianet
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
JI
Jina Embeddings v3
Jina · gaianet
Params558M
Context8K
Q4_K_M0.4 GB
CodingEmbedding
GE
Gemma 3 270m It
Gemma · gaianet
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
LL
Llama-3-8B-Japanese-Instruct
Llama · gaianet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 0.6B
Qwen · gaianet
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
FL
FLUX.1 Redux dev
Flux · gaianet
Params65M
Context—
Smallest0.0 GB
GGUF
IN
InternLM2
InternLM · gaianet
Params7.74B
Context32K
Q4_K_M4.7 GB
Coding
LL
Meta Llama 3.1 70B Instruct
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 Taiwan 8B Instruct Rc2
Llama · gaianet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PA
Palmyra Fin 70B 32K
Palmyra · gaianet
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
DA
datagemma rig 27b it
Datagemma · gaianet
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
OU
OuteTTS 0.2 500M
Outetts · gaianet
Params499M
Context32K
Q4_K_M0.4 GB
GGUF
LL
FinGPT MT Llama 3 8B LoRA
Llama · gaianet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MO
Moxin Reasoning 7b
Moxin · gaianet
Params8.11B
Context32K
Q4_K_M4.9 GB
Reasoning
MI
MiniCPM o 2 6
MiniCPM · gaianet
Params7.61B
Context32K
Q4_K_M4.7 GB
CodingTool useVision
IN
Internlm3 8b Instruct
InternLM · gaianet
Params8.8B
Context32K
Q4_K_M5.4 GB
Coding
TE
Tessa T1 14B
Tessa · gaianet
Params14.8B
Context117K
Q4_K_M9.0 GB
Tool use
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · gaianet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EX
EXAONE 3.5 7.8B Instruct
Exaone · gaianet
Params7.82B
Context32K
Q4_K_M4.8 GB
Coding

Keep browsing