GGUF models by gaianet

231 GGUF models quantized by gaianet on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Infinity Instruct 7M Gen Mistral 7B
Mistral · gaianet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi-1.5-34B-Chat-16K
Yi · gaianet
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
QW
Qwen2 VL 7B Instruct
Qwen · gaianet
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
LL
Llama 3 Groq 70B Tool Use
Llama · gaianet
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
MO
Moxin Instruct 7b
Moxin · gaianet
Params8.11B
Context32K
Q4_K_M4.9 GB
GGUF
QW
Qwen2-0.5B-Instruct
Qwen · gaianet
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
XL
xLAM 8x22b R
Xlam · gaianet
Params141B
Context64K
Q4_K_M85.6 GB
Tool use
GE
gemma-2-9b-it
Gemma · gaianet
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
OU
OuteTTS 0.3 500M
Outetts · gaianet
Params499M
Context32K
Q4_K_M0.4 GB
GGUF
MI
mistral
Mistral · gaianet
Params7.24B
Context32K
Smallest5.1 GB
Embedding
SM
SmolLM 360M Instruct
SmolLM · gaianet
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
QW
Qwen2.5 7B Instruct 1M
Qwen · gaianet
Params7.62B
Context986K
Q4_K_M4.7 GB
Tool use
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · gaianet
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
GR
GritLM 7B
Gritlm · gaianet
Params7.24B
Context32K
Smallest5.1 GB
GGUF
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
UA
UAE-Large-V1
Uae · gaianet
Params334M
Context512
Smallest0.2 GB
GGUF
EX
EXAONE 3.0 7.8B Instruct
Exaone · gaianet
Params7.82B
Context4K
Q4_K_M4.8 GB
Coding
MI
mistral
Mistral · gaianet
Params7.24B
Context32K
Smallest5.1 GB
GGUF
OS
Osmosis Structure 0.6B
Osmosis · gaianet
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · gaianet
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
FA
Falcon3 7B Instruct
Falcon · gaianet
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
LL
llm-compiler-7b
Llm · gaianet
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama3.1 8B Chinese Chat
Llama · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
gemma-2-27b-it
Gemma · gaianet
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
QW
Qwen2 VL 72B Instruct
Qwen · gaianet
Params72.7B
Context32K
Q4_K_M47.4 GB
Vision
EX
EXAONE Deep 7.8B
Exaone · gaianet
Params7.82B
Context32K
Q4_K_M4.8 GB
Coding
MI
mistral
Mistral · gaianet
Params7.24B
Context32K
Smallest5.1 GB
GGUF
BI
Bielik 11B v2.3 Instruct
Bielik · gaianet
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
QW
Qwen2.5 VL 7B Instruct
Qwen · gaianet
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen2.5 14B Instruct 1M
Qwen · gaianet
Params14.8B
Context986K
Q4_K_M9.0 GB
Tool use

Keep browsing