GGUF models by gaianet
231 GGUF models quantized by gaianet on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.
CO
C4Ai Command R 08 2024
Command R · gaianet
Params32.3B
Context128K
Q4_K_M19.8 GB
GL
glm-4-9b-chat
GLM · gaianet
Params9.4B
Context128K
Q4_K_M6.3 GB
QW
Qwen2 Math 7B Instruct
Qwen · gaianet
Params7.62B
Context4K
Q4_K_M4.7 GB
EX
EXAONE 3.5 32B Instruct
Exaone · gaianet
Params32B
Context32K
Q4_K_M19.3 GB
EX
EXAONE Deep 2.4B
Exaone · gaianet
Params2.41B
Context32K
Q4_K_M1.5 GB
MO
Moxin Chat
Moxin · gaianet
Params8.11B
Context32K
Q4_K_M4.9 GB
DA
datagemma rag 27b it
Datagemma · gaianet
Params27.2B
Context8K
Q4_K_M16.6 GB
GP
Gpt Oss 20b
gpt-oss · gaianet
Params20.9B
Context128K
Smallest12.1 GB
QW
Qwen3 32B
Qwen · gaianet
Params32.8B
Context40K
Q4_K_M19.8 GB
GE
Gemma 3n E2B It
Gemma · gaianet
Params4.46B
Context32K
Q4_K_M2.8 GB
JI
jina embeddings v2 base es
Jina · gaianet
Params160M
Context8K
Q4_K_M0.1 GB
FA
Falcon3 1B Instruct
Falcon · gaianet
Params1.67B
Context8K
Q4_K_M1.1 GB
LL
Llama 3.1 Nemotron 70B Reward HF
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
TE
Tessa T1 7B
Tessa · gaianet
Params7.62B
Context117K
Q4_K_M4.7 GB
BE
Bespoke Stratos 32B
Bespoke · gaianet
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
Llama 3.2 Korean Bllossom 3B
Llama · gaianet
Params3.21B
Context128K
Q4_K_M2.0 GB
IN
Internlm2_5 7b Chat 1m
InternLM · gaianet
Params7.74B
Context256K
Q4_K_M4.7 GB
LL
Llama 3.2 3B Instruct
Llama · gaianet
Params3.61B
Context128K
Q4_K_M2.2 GB
GP
Gpt Oss 120b
gpt-oss · gaianet
Params117B
Context128K
Smallest63.4 GB
LL
llm-compiler-13b
Llm · gaianet
Params13B
Context16K
Q4_K_M7.9 GB
EX
EXAONE Deep 32B
Exaone · gaianet
Params32B
Context32K
Q4_K_M19.3 GB
LL
DeepHermes 3 Llama 3 8B Preview
Llama · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2 Math 1.5B Instruct
Qwen · gaianet
Params1.54B
Context4K
Q4_K_M1.0 GB
TE
Tessa T1 3B
Tessa · gaianet
Params3.09B
Context117K
Q4_K_M1.9 GB
FU
functionary small v3.1
Functionary · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2 Math 72B Instruct
Qwen · gaianet
Params72.7B
Context4K
Q4_K_M47.4 GB
IN
Internlm2_5 20b Chat
InternLM · gaianet
Params19.9B
Context32K
Q4_K_M12.0 GB
ST
stablelm-2-12b-chat
Stablelm · gaianet
Params12.1B
Context4K
Q4_K_M7.4 GB
AL
all-MiniLM-L6-v2
All · gaianet
Params23M
Context512
Smallest0.0 GB
LL
Llama 3.3 Swallow 70B Instruct v0.4
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB