GGUF models by DevQuasar-10
42 GGUF models quantized by DevQuasar-10 on Hugging Face. Sizes run from 10M to 70.6B parameters. The longest trained context is 128K tokens.
GR
Ibm Granite.Granite Guardian 3.0 2b
Granite · DevQuasar-10
Params2.53B
Context8K
Q4_K_M1.5 GB
QW
Rombo Org.Rombo LLM V3.1 QWQ 32b
Qwen · DevQuasar-10
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
OpenPipe.Deductive Reasoning Qwen 32B
Qwen · DevQuasar-10
Params10M
Context32K
Q4_K_M0.0 GB
MI
NousResearch.DeepHermes 3 Mistral 24B Preview
Mistral · DevQuasar-10
Params23.6B
Context32K
Q4_K_M14.3 GB
OL
allenai.OLMo 2 0325 32B DPO
OLMo · DevQuasar-10
Params32.2B
Context4K
Q4_K_M19.5 GB
QW
Qwq Bakeneko 32b
Qwen · DevQuasar-10
Params32.8B
Context128K
Q4_K_M19.9 GB
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_FineWeb.seed3
Granite · DevQuasar-10
Params6.85B
Context8K
Q4_K_M6.0 GB
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_GneissWeb.seed3
Granite · DevQuasar-10
Params6.85B
Context8K
Q4_K_M6.0 GB
HP
hpcgroup.hpc coder v2 1.3b
Hpc · DevQuasar-10
Params1.35B
Context16K
Q4_K_M0.9 GB
GR
Ibm granite.GneissWeb.7B_ablation_model_on_350B_GneissWeb.seed2
Granite · DevQuasar-10
Params6.85B
Context8K
Q4_K_M6.0 GB
CO
CohereForAI.c4ai Command R 08 2024
Command R · DevQuasar-10
Params32.3B
Context128K
Q4_K_M19.8 GB
RE
RekaAI.reka Flash 3
Reka · DevQuasar-10
Params20.9B
Context32K
Q4_K_M13.6 GB