GGUF models by DevQuasar-6

110 GGUF models quantized by DevQuasar-6 on Hugging Face. Sizes run from 362M to 102B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
FI
HuggingFaceTB.finemath Ablation Infiwebmath
Finemath · DevQuasar-6
Params3.21B
Context4K
Q4_K_M2.0 GB
GGUF
LL
Trendmicro ailab.Llama Primus Merged
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
RLHFlow.Llama3.1 8B PRM Deepseek Data
DeepSeek · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DE
Deci.DeciLM 7B Instruct
Decilm · DevQuasar-6
Params7.04B
Context8K
Q4_K_M4.2 GB
GGUF
LL
allenai.Llama 3.1 Tulu 3 8B SFT no math data
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
FI
HuggingFaceTB.finemath Ablation Infiwebmath 3plus
Finemath · DevQuasar-6
Params3.21B
Context4K
Q4_K_M2.0 GB
GGUF
FA
tiiuae.Falcon3 7B Base
Falcon · DevQuasar-6
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
GR
Ibm Granite.Granite 3.1 2b Base
Granite · DevQuasar-6
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
FA
tiiuae.Falcon3 3B Base
Falcon · DevQuasar-6
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
MI
Mistral 7B Base SFT CPO
Mistral · DevQuasar-6
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HU
FreedomIntelligence.HuatuoGPT O1 72B
Huatuogpt · DevQuasar-6
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
SA
Sarashina2.1 1b
Sarashina · DevQuasar-6
Params1.41B
Context8K
Q4_K_M0.9 GB
GGUF
EX
LGAI EXAONE.EXAONE 3.5 7.8B Instruct
Exaone · DevQuasar-6
Params7.82B
Context32K
Q4_K_M4.8 GB
GGUF
AL
qingy2024.Albatross 8B Instruct
Albatross · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
VI
Virtuoso Small
Virtuoso · DevQuasar-6
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
LL
dnotitia.Llama DNA 1.0 8B Instruct
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
EU
utter project.EuroLLM 1.7B Instruct
Eurollm · DevQuasar-6
Params1.66B
Context4K
Q4_K_M1.0 GB
GGUF
GR
Ibm Granite.Granite 3.1 1b A400M Instruct
Granite · DevQuasar-6
Params1.33B
Context128K
Q4_K_M0.8 GB
Tool use
FI
HuggingFaceTB.finemath Ablation Infiwebmath 4plus
Finemath · DevQuasar-6
Params3.21B
Context4K
Q4_K_M2.0 GB
GGUF
QI
qingy2024.Albatross2.1 8B Instruct
Qingy · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Sao10K.14B Qwen2.5 Freya x1
Qwen · DevQuasar-6
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
LL
prithivMLmods.Llama Deepsync 3B
Llama · DevQuasar-6
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
SA
sail.Sailor2 1B
Sailor · DevQuasar-6
Params988M
Context32K
Q4_K_M0.7 GB
Tool use
FI
HuggingFaceTB.finemath Ablation Fwedu
Finemath · DevQuasar-6
Params3.21B
Context4K
Q4_K_M2.0 GB
GGUF
QW
Qwen2.5 32B
Qwen · DevQuasar-6
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
TR
prithivMLmods.Triangulum 1B
Triangulum · DevQuasar-6
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
UW
qingy2024.UwU 7B Instruct
Uwu · DevQuasar-6
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
LL
prithivMLmods.Llama 3.1 8B Open SFT
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
allenai.Llama 3.1 Tulu 3 8B SFT no safety data
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
FA
tiiuae.Falcon3 3B Instruct
Falcon · DevQuasar-6
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF

Keep browsing