GGUF models by DevQuasar-7
104 GGUF models quantized by DevQuasar-7 on Hugging Face. Sizes run from 362M to 406B parameters. The longest trained context is 1024K tokens.
LL
LLM4Binary.llm4decompile 1.3b v1.5
Llm · DevQuasar-7
Params1.35B
Context16K
Q4_K_M0.9 GB
VI
Arcee ai.Virtuoso Lite
Virtuoso · DevQuasar-7
Params10.3B
Context32K
Q4_K_M6.3 GB
DI
oumi ai.distill r1 670b math
Distill · DevQuasar-7
Params1.78B
Context128K
Q4_K_M1.1 GB
AC
nvidia.AceInstruct 7B
Aceinstruct · DevQuasar-7
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
LLM4Binary.llm4decompile 9b v2
Llm · DevQuasar-7
Params8.83B
Context128K
Q4_K_M5.3 GB
PH
mudler.LocalAI functioncall phi 4 v0.3
Phi · DevQuasar-7
Params14.7B
Context16K
Q4_K_M8.9 GB
FA
tiiuae.Falcon3 Mamba 7B Base
Falcon · DevQuasar-7
Params7.27B
Context1024K
Q4_K_M4.2 GB
AR
katanemo.Arch Function 7B
Arch · DevQuasar-7
Params7.62B
Context32K
Q4_K_M4.7 GB
NE
MarinaraSpaghetti.NemoMix Unleashed 12B
Nemomix · DevQuasar-7
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
OpenR1-Qwen-7B
Qwen · DevQuasar-7
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen.Qwen2.5 Coder 0.5B
Qwen · DevQuasar-7
Params494M
Context32K
Q4_K_M0.4 GB
DE
mkurman.Qwen2.5 14B DeepSeek R1 1M
DeepSeek · DevQuasar-7
Params14.8B
Context986K
Q4_K_M9.0 GB
AC
nvidia.AceInstruct 72B
Aceinstruct · DevQuasar-7
Params72.7B
Context128K
Q4_K_M47.4 GB
QW
Alibaba NLP.gte Qwen2 1.5B Instruct
Qwen · DevQuasar-7
Params1.78B
Context128K
Q4_K_M1.1 GB
LU
OpenLLM France.Lucie 7B
Lucie · DevQuasar-7
Params6.71B
Context31K
Q4_K_M4.1 GB
ME
ilsp.Meltemi 7B v1
Meltemi · DevQuasar-7
Params7.48B
Context32K
Q4_K_M4.5 GB
LL
Llama 3.2 Taiwan 3B Instruct
Llama · DevQuasar-7
Params3.61B
Context128K
Q4_K_M2.2 GB
RE
jinaai.ReaderLM v2
Readerlm · DevQuasar-7
Params1.54B
Context501K
Q4_K_M1.0 GB
MI
Dolphin3.0 R1 Mistral 24B
Mistral · DevQuasar-7
Params23.6B
Context32K
Q4_K_M14.3 GB
LL
MiniThinky v2 1B Llama 3.2
Llama · DevQuasar-7
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
LLM4Binary.llm4decompile 1.3b v2
Llm · DevQuasar-7
Params1.35B
Context16K
Q4_K_M0.9 GB
AC
nvidia.AceInstruct 1.5B
Aceinstruct · DevQuasar-7
Params1.78B
Context128K
Q4_K_M1.1 GB
MA
AIDC AI.Marco LLM ES
Marco · DevQuasar-7
Params7.62B
Context128K
Q4_K_M4.7 GB
OL
allenai.OLMoE 1B 7B 0125 SFT
OLMo · DevQuasar-7
Params6.92B
Context4K
Q4_K_M4.2 GB
LU
OpenLLM France.Lucie 7B Instruct
Lucie · DevQuasar-7
Params6.71B
Context31K
Q4_K_M4.1 GB
YU
m a p.YuE s2 1B general
Yue · DevQuasar-7
Params1.96B
Context8K
Q4_K_M1.3 GB
LL
itsnebulalol.Llama 3.2 Nemotron 3B Instruct
Llama · DevQuasar-7
Params3.21B
Context128K
Q4_K_M2.0 GB
HU
Huihui Ai.S1 32B Abliterated
Huihui · DevQuasar-7
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
Groq.Llama 3 Groq 70B Tool Use
Llama · DevQuasar-7
Params70.6B
Context8K
Q4_K_M42.5 GB
FA
Falcon-3B-8k-data-new-classes
Falcon · DevQuasar-7
Params3.23B
Context32K
Q4_K_M2.0 GB