GGUF models by grapevine-AI

77 GGUF models quantized by grapevine-AI on Hugging Face. Sizes run from 494M to 111B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
phi 4
Phi · grapevine-AI
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
GE
gemma-2-9b-it
Gemma · grapevine-AI
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 9b It SimPO
Gemma · grapevine-AI
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PH
Phi 3.5 MoE Instruct
Phi · grapevine-AI
Params41.9B
Context128K
Q4_K_M25.3 GB
GGUF
DE
Llama 70B DeepSeek R1 Distill
DeepSeek · grapevine-AI
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
QW
QwQ 32B
Qwen · grapevine-AI
Params32.8B
Context40K
Q4_K_M19.9 GB
ReasoningTool use
QW
Qwen2.5 32B Instruct
Qwen · grapevine-AI
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · grapevine-AI
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
EX
EXAONE 3.5 32B Instruct GGUF Japanese imatrix
Exaone · grapevine-AI
Params32B
Context32K
Q4_K_M19.3 GB
GGUF
QW
Qwen2.5 Bakeneko 32b Instruct
Qwen · grapevine-AI
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · grapevine-AI
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
CA
Calm3 22b Chat Selfimprove Experimental
Calm · grapevine-AI
Params22.5B
Context16K
Q4_K_M13.6 GB
GGUF
SA
Sarashina2.2 3b Instruct v0.1
Sarashina · grapevine-AI
Params3.36B
Context8K
Q4_K_M2.1 GB
Tool use
AY
aya 23 35B
Aya · grapevine-AI
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
LL
Llama 3.3 70B Instruct
Llama · grapevine-AI
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
KA
Karakuri Lm 32b Thinking 2501 Exp
Karakuri · grapevine-AI
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
LL
Llama 3.1 Nemotron 70B Instruct
Llama · grapevine-AI
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
QW
Qwen2.5 72B Instruct
Qwen · grapevine-AI
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
GE
EZO Common 9B gemma 2 it
Gemma · grapevine-AI
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Llama 3.1 70B Japanese Instruct 2407
Llama · grapevine-AI
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
CO
C4Ai Command A 03 2025
Command R · grapevine-AI
Params111B
Context128K
Q4_K_M67.1 GB
Tool use
AY
Aya Expanse 32b
Aya · grapevine-AI
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AT
Athene V2 Chat
Athene · grapevine-AI
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
CO
C4Ai Command R7B 12 2024
Command R · grapevine-AI
Params8.03B
Context8K
Q4_K_M5.1 GB
Tool use
LL
Llama 3.1 70B EZO 1.1 It
Llama · grapevine-AI
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
AY
Aya Expanse 8b
Aya · grapevine-AI
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
LL
llama 70b r1 1776 distill
Llama · grapevine-AI
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
CO
C4Ai Command R 08 2024
Command R · grapevine-AI
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
AT
Athene V2 Agent
Athene · grapevine-AI
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
QW
Qwen2.5 72B Instruct
Qwen · grapevine-AI
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use

Keep browsing