GGUF models by DevQuasar-7
104 GGUF models quantized by DevQuasar-7 on Hugging Face. Sizes run from 362M to 406B parameters. The longest trained context is 1024K tokens.
LL
SentientAGI.Dobby Mini Unhinged Llama 3.1 8B
Llama · DevQuasar-7
Params8.03B
Context128K
Q4_K_M4.9 GB
OL
allenai.OLMoE 1B 7B 0125 Instruct
OLMo · DevQuasar-7
Params6.92B
Context4K
Q4_K_M4.2 GB
QW
Alibaba NLP.gte Qwen2 7B Instruct
Qwen · DevQuasar-7
Params7.61B
Context128K
Q4_K_M4.7 GB
FI
TheFinAI.Fino1 8B
Fino · DevQuasar-7
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
allenai.Llama 3.1 Tulu 3.1 8B
Llama · DevQuasar-7
Params8.03B
Context128K
Q4_K_M4.9 GB
GR
Granite 3.2 8b Instruct Preview
Granite · DevQuasar-7
Params8.17B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 0.5B
Qwen · DevQuasar-7
Params494M
Context32K
Q4_K_M0.4 GB
EX
Furiosa ai.EXAONE 3.0 7.8B Instruct Converted
Exaone · DevQuasar-7
Params7.82B
Context4K
Q4_K_M4.8 GB
MI
Minitron 4B Base
Minitron · DevQuasar-7
Params4.19B
Context4K
Q4_K_M2.7 GB
MI
Huihui ai.Dolphin3.0 R1 Mistral 24B Abliterated
Mistral · DevQuasar-7
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Qwen.Qwen2.5 14B Instruct 1M
Qwen · DevQuasar-7
Params14.8B
Context986K
Q4_K_M9.0 GB
LU
OpenLLM France.Lucie 7B Instruct Human Data
Lucie · DevQuasar-7
Params6.71B
Context31K
Q4_K_M4.1 GB
RE
Redemption_Wind_24B
Redemption · DevQuasar-7
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Dolphin3.0 Qwen2.5 3B
Qwen · DevQuasar-7
Params3.09B
Context32K
Q4_K_M1.9 GB
DE
DeepSeek Llama3.1 Bllossom 8
DeepSeek · DevQuasar-7
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
nvidia.Nemotron Mini 4B Instruct
Nemotron · DevQuasar-7
Params4.19B
Context4K
Q4_K_M2.7 GB
MI
mistralai.Mistral 7B v0.1
Mistral · DevQuasar-7
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
Deepseek ai.DeepSeek R1 Distill Llama 70B
DeepSeek · DevQuasar-7
Params70.6B
Context128K
Q4_K_M42.5 GB
XW
Xwen 0.5B Chat
Xwen · DevQuasar-7
Params630M
Context32K
Q4_K_M0.5 GB
LI
ozone ai.0x lite
Lite · DevQuasar-7
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
ilsp.Llama Krikri 8B Instruct
Llama · DevQuasar-7
Params8.2B
Context128K
Q4_K_M5.0 GB
AL
BSC LT.ALIA 40b
Alia · DevQuasar-7
Params40.4B
Context4K
Q4_K_M24.6 GB
QW
slm research vn.EdgeRunner Command AgentF qwen
Qwen · DevQuasar-7
Params7.62B
Context32K
Q4_K_M4.7 GB
DE
mobiuslabsgmbh.DeepSeek R1 ReDistill Qwen 1.5B v1.0
DeepSeek · DevQuasar-7
Params1.78B
Context128K
Q4_K_M1.1 GB
MI
nbeerbower.mistral nemo kartoffel 12B
Mistral · DevQuasar-7
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
HuggingFaceTB.FineMath Llama 3B
Llama · DevQuasar-7
Params3.21B
Context4K
Q4_K_M2.0 GB
IN
internlm.OREAL 7B
InternLM · DevQuasar-7
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
Huihui ai.DeepScaleR 1.5B Preview Abliterated
Deepscaler · DevQuasar-7
Params1.78B
Context128K
Q4_K_M1.1 GB
OP
teknium.OpenHermes 13B
Openhermes · DevQuasar-7
Params13B
Context4K
Q4_K_M7.9 GB
OL
allenai.OLMoE 1B 7B 0125 DPO
OLMo · DevQuasar-7
Params6.92B
Context4K
Q4_K_M4.2 GB