GGUF models by gaianet
231 GGUF models quantized by gaianet on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.
MI
Infinity Instruct 7M Gen Mistral 7B
Mistral · gaianet
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Yi-1.5-34B-Chat-16K
Yi · gaianet
Params34.4B
Context16K
Q4_K_M20.7 GB
QW
Qwen2 VL 7B Instruct
Qwen · gaianet
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama 3 Groq 70B Tool Use
Llama · gaianet
Params70.6B
Context8K
Q4_K_M42.5 GB
MO
Moxin Instruct 7b
Moxin · gaianet
Params8.11B
Context32K
Q4_K_M4.9 GB
QW
Qwen2-0.5B-Instruct
Qwen · gaianet
Params494M
Context32K
Q4_K_M0.4 GB
XL
xLAM 8x22b R
Xlam · gaianet
Params141B
Context64K
Q4_K_M85.6 GB
GE
gemma-2-9b-it
Gemma · gaianet
Params9.24B
Context8K
Q4_K_M5.8 GB
OU
OuteTTS 0.3 500M
Outetts · gaianet
Params499M
Context32K
Q4_K_M0.4 GB
MI
mistral
Mistral · gaianet
Params7.24B
Context32K
Smallest5.1 GB
SM
SmolLM 360M Instruct
SmolLM · gaianet
Params362M
Context2K
Q4_K_M0.3 GB
QW
Qwen2.5 7B Instruct 1M
Qwen · gaianet
Params7.62B
Context986K
Q4_K_M4.7 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · gaianet
Params8.19B
Context128K
Q4_K_M5.0 GB
GR
GritLM 7B
Gritlm · gaianet
Params7.24B
Context32K
Smallest5.1 GB
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
UA
UAE-Large-V1
Uae · gaianet
Params334M
Context512
Smallest0.2 GB
EX
EXAONE 3.0 7.8B Instruct
Exaone · gaianet
Params7.82B
Context4K
Q4_K_M4.8 GB
MI
mistral
Mistral · gaianet
Params7.24B
Context32K
Smallest5.1 GB
OS
Osmosis Structure 0.6B
Osmosis · gaianet
Params596M
Context40K
Q4_K_M0.4 GB
SM
SmolLM2 1.7B Instruct
SmolLM · gaianet
Params1.71B
Context8K
Q4_K_M1.1 GB
FA
Falcon3 7B Instruct
Falcon · gaianet
Params7.46B
Context32K
Q4_K_M4.6 GB
LL
llm-compiler-7b
Llm · gaianet
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama3.1 8B Chinese Chat
Llama · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
gemma-2-27b-it
Gemma · gaianet
Params27.2B
Context8K
Q4_K_M16.6 GB
QW
Qwen2 VL 72B Instruct
Qwen · gaianet
Params72.7B
Context32K
Q4_K_M47.4 GB
EX
EXAONE Deep 7.8B
Exaone · gaianet
Params7.82B
Context32K
Q4_K_M4.8 GB
MI
mistral
Mistral · gaianet
Params7.24B
Context32K
Smallest5.1 GB
BI
Bielik 11B v2.3 Instruct
Bielik · gaianet
Params11.2B
Context32K
Q4_K_M6.7 GB
QW
Qwen2.5 VL 7B Instruct
Qwen · gaianet
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen2.5 14B Instruct 1M
Qwen · gaianet
Params14.8B
Context986K
Q4_K_M9.0 GB