GGUF models by gaianet

231 GGUF models quantized by gaianet on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
C4Ai Command R 08 2024
Command R · gaianet
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
GL
glm-4-9b-chat
GLM · gaianet
Params9.4B
Context128K
Q4_K_M6.3 GB
CodingTool use
QW
Qwen2 Math 7B Instruct
Qwen · gaianet
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
EX
EXAONE 3.5 32B Instruct
Exaone · gaianet
Params32B
Context32K
Q4_K_M19.3 GB
Coding
EX
EXAONE Deep 2.4B
Exaone · gaianet
Params2.41B
Context32K
Q4_K_M1.5 GB
Coding
MO
Moxin Chat
Moxin · gaianet
Params8.11B
Context32K
Q4_K_M4.9 GB
GGUF
DA
datagemma rag 27b it
Datagemma · gaianet
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GP
Gpt Oss 20b
gpt-oss · gaianet
Params20.9B
Context128K
Smallest12.1 GB
Tool use
QW
Qwen3 32B
Qwen · gaianet
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
GE
Gemma 3n E2B It
Gemma · gaianet
Params4.46B
Context32K
Q4_K_M2.8 GB
Vision
JI
jina embeddings v2 base es
Jina · gaianet
Params160M
Context8K
Q4_K_M0.1 GB
CodingEmbedding
FA
Falcon3 1B Instruct
Falcon · gaianet
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
LL
Llama 3.1 Nemotron 70B Reward HF
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
TE
Tessa T1 7B
Tessa · gaianet
Params7.62B
Context117K
Q4_K_M4.7 GB
Tool use
BE
Bespoke Stratos 32B
Bespoke · gaianet
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
LL
Llama 3.2 Korean Bllossom 3B
Llama · gaianet
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
IN
Internlm2_5 7b Chat 1m
InternLM · gaianet
Params7.74B
Context256K
Q4_K_M4.7 GB
Coding
LL
Llama 3.2 3B Instruct
Llama · gaianet
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
GP
Gpt Oss 120b
gpt-oss · gaianet
Params117B
Context128K
Smallest63.4 GB
Tool use
LL
llm-compiler-13b
Llm · gaianet
Params13B
Context16K
Q4_K_M7.9 GB
Coding
EX
EXAONE Deep 32B
Exaone · gaianet
Params32B
Context32K
Q4_K_M19.3 GB
Coding
LL
DeepHermes 3 Llama 3 8B Preview
Llama · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Qwen2 Math 1.5B Instruct
Qwen · gaianet
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
TE
Tessa T1 3B
Tessa · gaianet
Params3.09B
Context117K
Q4_K_M1.9 GB
Tool use
FU
functionary small v3.1
Functionary · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
QW
Qwen2 Math 72B Instruct
Qwen · gaianet
Params72.7B
Context4K
Q4_K_M47.4 GB
GGUF
IN
Internlm2_5 20b Chat
InternLM · gaianet
Params19.9B
Context32K
Q4_K_M12.0 GB
Coding
ST
stablelm-2-12b-chat
Stablelm · gaianet
Params12.1B
Context4K
Q4_K_M7.4 GB
GGUF
AL
all-MiniLM-L6-v2
All · gaianet
Params23M
Context512
Smallest0.0 GB
Embedding
LL
Llama 3.3 Swallow 70B Instruct v0.4
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Keep browsing