GGUF models by gaianet
231 GGUF models quantized by gaianet on Hugging Face. Sizes run from 23M to 236B parameters. The longest trained context is 10240K tokens.
ME
Medgemma 4b It
Medgemma · gaianet
Params3.88B
Context128K
Q4_K_M2.5 GB
LL
Llama-3-Instruct-8B-SimPO
Llama · gaianet
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral Large Instruct 2407
Mistral · gaianet
Params123B
Context128K
Q4_K_M73.2 GB
QW
QwQ 32B Preview
Qwen · gaianet
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
Gemma-2-9B-Chinese-Chat
Gemma · gaianet
Params9.24B
Context8K
Q4_K_M5.8 GB
OU
OuteTTS 0.3 1B
Outetts · gaianet
Params1.19B
Context4K
Q4_K_M0.7 GB
MI
Mistral Small 24B Instruct 2501
Mistral · gaianet
Params23.6B
Context32K
Q4_K_M14.3 GB
PH
Phi 4 Reasoning
Phi · gaianet
Params14.7B
Context32K
Q4_K_M9.1 GB
QW
gte-Qwen2-1.5B-instruct
Qwen · gaianet
Params1.78B
Context128K
Q4_K_M1.1 GB
ME
Megrez 3B Instruct
Megrez · gaianet
Params2.92B
Context32K
Q4_K_M1.8 GB
PH
Phi 3.5 MoE Instruct
Phi · gaianet
Params41.9B
Context128K
Q4_K_M25.3 GB
MI
Mistral Nemo Instruct 2407
Mistral · gaianet
Params12.2B
Context1000K
Q4_K_M7.5 GB
DE
DeepSeek-V2-Lite-Chat
DeepSeek · gaianet
Params15.7B
Context160K
Q4_K_M10.4 GB
GE
Gemma 2 2b It
Gemma · gaianet
Params2.61B
Context8K
Q4_K_M1.7 GB
PH
Phi 3 medium 4k instruct
Phi · gaianet
Params14B
Context4K
Q4_K_M8.6 GB
SM
SmolVLM2 500M Video Instruct
Smolvlm · gaianet
Params409M
Context8K
Q4_K_M0.3 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.3 70B Instruct
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Reflection Llama 3.1 70B
Llama · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
JI
jina embeddings v2 base zh
Jina · gaianet
Params160M
Context8K
Q4_K_M0.1 GB
ST
stable diffusion 3.5 large
Stable · gaianet
Params695M
Context—
Smallest0.7 GB
QW
Qwen3 14B
Qwen · gaianet
Params14.8B
Context40K
Q4_K_M9.0 GB
PH
Phi 3.5 Mini Instruct
Phi · gaianet
Params3.82B
Context128K
Q4_K_M2.4 GB
NO
nomic-embed-text-v1.5
Nomic · gaianet
Params137M
Context2K
Smallest0.3 GB
QW
Qwen2.5 VL 32B Instruct
Qwen · gaianet
Params32.8B
Context125K
Q4_K_M19.9 GB
PH
Phi 4 Mini Reasoning
Phi · gaianet
Params3.84B
Context128K
Q4_K_M2.5 GB
SE
Seed OSS 36B Instruct
Seed · gaianet
Params36.2B
Context512K
Q4_K_M21.8 GB
QW
Qwen2-7B-Instruct
Qwen · gaianet
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
llm-compiler-13b-ftd
Llm · gaianet
Params13B
Context16K
Q4_K_M7.9 GB
SE
Seed Coder 8B Reasoning
Seed · gaianet
Params8.25B
Context64K
Q4_K_M5.1 GB