GGUF models by gaianet

231 GGUF models quantized by gaianet on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
Medgemma 4b It
Medgemma · gaianet
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
LL
Llama-3-Instruct-8B-SimPO
Llama · gaianet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral Large Instruct 2407
Mistral · gaianet
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
QW
QwQ 32B Preview
Qwen · gaianet
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
GE
Gemma-2-9B-Chinese-Chat
Gemma · gaianet
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
OU
OuteTTS 0.3 1B
Outetts · gaianet
Params1.19B
Context4K
Q4_K_M0.7 GB
GGUF
MI
Mistral Small 24B Instruct 2501
Mistral · gaianet
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
PH
Phi 4 Reasoning
Phi · gaianet
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
QW
gte-Qwen2-1.5B-instruct
Qwen · gaianet
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingEmbedding
ME
Megrez 3B Instruct
Megrez · gaianet
Params2.92B
Context32K
Q4_K_M1.8 GB
GGUF
PH
Phi 3.5 MoE Instruct
Phi · gaianet
Params41.9B
Context128K
Q4_K_M25.3 GB
Coding
MI
Mistral Nemo Instruct 2407
Mistral · gaianet
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DE
DeepSeek-V2-Lite-Chat
DeepSeek · gaianet
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
GE
Gemma 2 2b It
Gemma · gaianet
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
PH
Phi 3 medium 4k instruct
Phi · gaianet
Params14B
Context4K
Q4_K_M8.6 GB
Coding
SM
SmolVLM2 500M Video Instruct
Smolvlm · gaianet
Params409M
Context8K
Q4_K_M0.3 GB
Vision
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
Llama 3.3 70B Instruct
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Reflection Llama 3.1 70B
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
JI
jina embeddings v2 base zh
Jina · gaianet
Params160M
Context8K
Q4_K_M0.1 GB
CodingEmbedding
ST
stable diffusion 3.5 large
Stable · gaianet
Params695M
Context—
Smallest0.7 GB
GGUF
QW
Qwen3 14B
Qwen · gaianet
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
PH
Phi 3.5 Mini Instruct
Phi · gaianet
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
NO
nomic-embed-text-v1.5
Nomic · gaianet
Params137M
Context2K
Smallest0.3 GB
Embedding
QW
Qwen2.5 VL 32B Instruct
Qwen · gaianet
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
PH
Phi 4 Mini Reasoning
Phi · gaianet
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
SE
Seed OSS 36B Instruct
Seed · gaianet
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningTool use
QW
Qwen2-7B-Instruct
Qwen · gaianet
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
llm-compiler-13b-ftd
Llm · gaianet
Params13B
Context16K
Q4_K_M7.9 GB
Coding
SE
Seed Coder 8B Reasoning
Seed · gaianet
Params8.25B
Context64K
Q4_K_M5.1 GB
CodingReasoning

Keep browsing