GGUF models by DevQuasar-5

95 GGUF models quantized by DevQuasar-5 on Hugging Face. Sizes run from 135M to 479B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
MTSAIR.Cotype Nano
Cotype · DevQuasar-5
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
SA
sail.Sailor 1.8B Chat
Sailor · DevQuasar-5
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
SA
SauerkrautLM v2 14b DPO
Sauerkrautlm · DevQuasar-5
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
OP
infly.OpenCoder 8B Instruct
Opencoder · DevQuasar-5
Params7.77B
Context8K
Q4_K_M4.7 GB
Coding
SA
sail.Sailor2 8B Chat
Sailor · DevQuasar-5
Params8.55B
Context32K
Q4_K_M5.2 GB
GGUF
GE
Google.Gemma 2 2b Jpn It
Gemma · DevQuasar-5
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Bio Medical Llama 3 2 1B CoT 012025
Llama · DevQuasar-5
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MI
sapienzanlp.Minerva 7B Instruct v1.0
Minerva · DevQuasar-5
Params7.4B
Context4K
Q4_K_M4.5 GB
GGUF
SA
Sbintuitions.Sarashina2.2 1b
Sarashina · DevQuasar-5
Params1.41B
Context8K
Q4_K_M0.9 GB
GGUF
LL
Skywork O1 Open Llama3.1 8B
Llama · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
IN
INTELLECT 1 Instruct
Intellect · DevQuasar-5
Params10.2B
Context8K
Q4_K_M6.2 GB
GGUF
ML
mlfoundations dev.OH DCFT V3 wo sharegpt
Mlfoundations · DevQuasar-5
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Isotonic.OrcaAgent llama3.2 1b
Llama · DevQuasar-5
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Isotonic.reasoning llama3.2 3b
Llama · DevQuasar-5
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
QW
Q PING.krx Qwen2 7B It 1103
Qwen · DevQuasar-5
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
AT
Athene V2 Agent
Athene · DevQuasar-5
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
MI
nbeerbower.Mistral Nemo Prism 12B v7
Mistral · DevQuasar-5
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
nbeerbower.Qwen2.5 Gutenberg Doppel 14B
Qwen · DevQuasar-5
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
MI
mistralai.Mistral Nemo Base 2407
Mistral · DevQuasar-5
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
GE
Cognitivecomputations.Dolphin 2.9.4 Gemma2 2b
Gemma · DevQuasar-5
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Facebook.Layerskip Llama3.2 1B
Llama · DevQuasar-5
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · DevQuasar-5
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
SA
sail.Sailor 4B Chat
Sailor · DevQuasar-5
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
DE
Deepseek ai.DeepSeek V2.5 1210
DeepSeek · DevQuasar-5
Params236B
Context160K
Q4_K_M142.5 GB
Tool use
QW
Qwen2.5 72B
Qwen · DevQuasar-5
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
LL
Llama 3.1 Tulu 3 70B SFT
Llama · DevQuasar-5
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DA
H2O Danube3.1 4b Chat
Danube · DevQuasar-5
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
OL
allenai.OLMo 2 1124 13B DPO
OLMo · DevQuasar-5
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
SN
Snowflake.snowflake Arctic Instruct
Snowflake · DevQuasar-5
Params479B
Context4K
Smallest173.6 GB
GGUF
LL
AcademieDuNumerique.Llama 3.2 3B SQL Instruct
Llama · DevQuasar-5
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use

Keep browsing