GGUF models by DevQuasar-8

86 GGUF models quantized by DevQuasar-8 on Hugging Face. Sizes run from 362M to 671B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
SK
NovaSky AI.Sky T1 32B Flash
Sky · DevQuasar-8
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
GR
Ibm Granite.Granite 3.0 1b A400M Base
Granite · DevQuasar-8
Params1.38B
Context4K
Q4_K_M0.9 GB
GGUF
AY
Ayla Light 12B
Ayla · DevQuasar-8
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
OP
open thoughts.OpenThinker 32B
Openthinker · DevQuasar-8
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
QW
Qwen.Qwen1.5 7B Chat
Qwen · DevQuasar-8
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
QW
Qwen.Qwen1.5 7B
Qwen · DevQuasar-8
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
QW
Qwen.Qwen2 1.5B
Qwen · DevQuasar-8
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
SK
NovaSky AI.Sky T1 7B Zero
Sky · DevQuasar-8
Params7.62B
Context4K
Q4_K_M4.7 GB
Tool use
LL
Meta llama.Llama Guard 3 8B
Llama · DevQuasar-8
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen.Qwen2.5 7B Instruct 1M
Qwen · DevQuasar-8
Params7.62B
Context986K
Q4_K_M4.7 GB
Tool use
SA
Sbintuitions.Sarashina2.2 0.5b Instruct v0.1
Sarashina · DevQuasar-8
Params793M
Context8K
Q4_K_M0.5 GB
Tool use
MO
allura org.MoE Girl 800MA 3BT
Moe · DevQuasar-8
Params3.37B
Context8K
Q4_K_M2.1 GB
GGUF
QW
Qwen.Qwen2.5 Math 7B Instruct
Qwen · DevQuasar-8
Params7.62B
Context4K
Q4_K_M4.7 GB
Tool use
IN
Internlm.Internlm3 8b Instruct
InternLM · DevQuasar-8
Params8.8B
Context32K
Q4_K_M5.4 GB
GGUF
OP
open neo.DeepNeo 1 12B Preview
Open · DevQuasar-8
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
CA
prithivMLmods.Calcium Opus 14B Elite2 R1
Calcium · DevQuasar-8
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
QW
Qwen.Qwen1.5 14B
Qwen · DevQuasar-8
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
ME
ProbeMedicalYonseiMAILab.medllama3 v20
Medllama · DevQuasar-8
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev.S1 4o mini
Mlfoundations · DevQuasar-8
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
GR
Ibm Granite.Granite 20b Functioncalling
Granite · DevQuasar-8
Params20.1B
Context8K
Q4_K_M12.8 GB
GGUF
QW
Qwen.Qwen1.5 32B
Qwen · DevQuasar-8
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
EL
Eleusis 12B
Eleusis · DevQuasar-8
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen.Qwen1.5 0.5B
Qwen · DevQuasar-8
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
OC
NexaAIDev.Octopus v2
Octopus · DevQuasar-8
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
HE
Malteos.Hermeo 7b
Hermeo · DevQuasar-8
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AR
arcee ai.Arcee Maestro 7B Preview
Arcee · DevQuasar-8
Params7.61B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
LL
Meta llama.Meta Llama Guard 2 8B
Llama · DevQuasar-8
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev.oh dcft v3.1 claude 3 5 haiku 20241022
Mlfoundations · DevQuasar-8
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Rombo LLM V3.0 Qwen 32b
Qwen · DevQuasar-8
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
MI
mistralai.Mistral 7B v0.3
Mistral · DevQuasar-8
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing