GGUF models by Cran-May

92 GGUF models quantized by Cran-May on Hugging Face. Sizes run from 66M to 72.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite 3.2 8b Instruct Preview
Granite · Cran-May
Params8.17B
Context128K
Smallest4.7 GB
Tool use
QW
Qwen2.5 14B
Qwen · Cran-May
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
BM
LT_BMO Test 5
Bmo · Cran-May
Params10.1B
Context1000K
Smallest5.6 GB
GGUF
AN
B and W Flycatcher Q4 K M
And · Cran-May
Params14.8B
Context195K
Q4_K_M9.0 GB
GGUF
LL
Infinity Instruct 7M Gen Llama3_1 8B
Llama · Cran-May
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
openbuddy-llama3-8b-v21.2-32k
Llama · Cran-May
Params8.03B
Context128K
Smallest4.4 GB
GGUF
SL
SLIDE v2 Q2 K
Slide · Cran-May
Params7.28B
Context32K
Smallest2.7 GB
GGUF
QW
Qwen2-7B-Instruct-Step-DPO
Qwen · Cran-May
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
RE
RA Reasoner Q5 K M
Reasoner · Cran-May
Params10.3B
Context32K
Smallest7.3 GB
Tool use
E5
E5 Q5 K M
Cran-May
Params7.24B
Context32K
Smallest5.1 GB
GGUF
MI
SLIDE v3 Preview6 Q4 K S
Mistral · Cran-May
Params7.24B
Context8K
Smallest4.1 GB
GGUF
DE
CohenQu DeepSeek R1 Distill Qwen 1.5B GRPO duplicate fixed 6140715 Q4 K M
DeepSeek · Cran-May
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
CohenQu DeepSeek R1 Distill Qwen 1.5B GRPO duplicate fixed 6140715 Q5 K M
DeepSeek · Cran-May
Params1.78B
Context128K
Smallest1.3 GB
ReasoningTool use
TE
Tempmotacilla Cinerea 0302
Tempmotacilla · Cran-May
Params14.8B
Context128K
Smallest6.7 GB
GGUF
MI
Mistral 22B v0.2 Q4 K S
Mistral · Cran-May
Params22.2B
Context64K
Smallest12.7 GB
GGUF
MI
Openbuddy Mistral 7b v18.1
Mistral · Cran-May
Params7.28B
Context32K
Smallest5.2 GB
GGUF
IN
InternLM2
InternLM · Cran-May
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
LL
InternLM3 8B Instruct Converted LlaMA
Llama · Cran-May
Params8.8B
Context32K
Smallest6.1 GB
GGUF
MO
Motacilla cinerea
Motacilla · Cran-May
Params7.62B
Context128K
Smallest5.8 GB
Tool use
OP
Openbuddy Openllama 7b v5 Fp16
Openbuddy · Cran-May
Params6.79B
Context2K
Smallest4.8 GB
GGUF
PH
Phi 4 Rp v1 Lora
Phi · Cran-May
Params66M
Context—
Smallest0.3 GB
GGUF
AW
AwA_Motacilla Cinerea 0122
Awa · Cran-May
Params8.8B
Context32K
Smallest6.3 GB
GGUF
FU
SLIDE v3 Preview4 Q4 K M
Fusechat · Cran-May
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
openbuddy-llama3-8b-v21.1-8k
Llama · Cran-May
Params8.03B
Context8K
Smallest4.7 GB
GGUF
AW
AwA_Motacilla Cinerea 0122
Awa · Cran-May
Params8.8B
Context32K
Smallest5.1 GB
GGUF
OP
OpenSLIDE
Openslide · Cran-May
Params7.28B
Context32K
Smallest3.5 GB
GGUF
MI
SLIDE v3 Preview1 Q4 K M
Mistral · Cran-May
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SL
SLIDE v2 Q4 K M
Slide · Cran-May
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SLIDE v3 Preview2 Q4 K M
Mistral · Cran-May
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 22B v0.2 Q4 K M
Mistral · Cran-May
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF

Keep browsing