GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
PY
Pythia 1.4b Deduped
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
QW
OpenChat 3.5 7B Qwen v2.0
Qwen · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
DE
DeepSeek V2 Lite Chat Uncensored
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
MI
Ministral 3 8B Reasoning 2512 Esper3.1
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
QW
Qwopus3.8 27B Flash V2 Apostate Uncensored
Qwopus · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CA
cat-v1.0-13b
Cat · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
MI
Hermes-2-Pro-Mistral-7B-infinity
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
JA
Javi0.3 2B
Javi · mradermacher
Params1.94B
Context256K
Q4_K_M1.3 GB
LL
gpt 4o distil Llama 3.3 70B Instruct PaperWitch heresy i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
IN
OpenChat 3.5 7B InternLM v2.0
InternLM · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
QW
FlashModel Qwen 3.6 35B A3B Maxed
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
MI
Mistral Syndicate 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Nehuronion Dvt 9b
Nehuronion · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
OR
Ornith 1.5 122B
Ornith · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
QW
Qwen3.6 35B A3B Uncensored Genesis Final Safetensors
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ZE
Zeta 2.1
Zeta · mradermacher
Params8.25B
Context32K
Q4_K_M5.1 GB
BR
Breeze-13B-32k-Instruct-v1_0
Breeze · mradermacher
Params12.7B
Context32K
Q4_K_M7.7 GB
QW
Qwen3 14B Abliterated
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Huihui Qwen3.5 9B Claude 4.6 Opus Abliterated Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
LA
Lambda 17b PcDPO
Lambda · mradermacher
Params16.8B
Context32K
Q4_K_M10.3 GB
OP
openPangu Embedded 7B V1.1
Openpangu · mradermacher
Params8.03B
Context32K
Q4_K_M4.9 GB
TH
TherapyBeagle 11B v1 i1
Therapybeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
EC
EchoVLM_v2
Echovlm · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MA
MAmmoTH2-8x7B
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
EU
Euryale 1.3 longLORA 70b rope8 32k fp16 i1
Euryale · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
IN
Internlm2 Math Plus 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
AR
Artemis 31B v1.1 Heretic v2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
CA
CarbonVillain En 10.7B v4
Carbonvillain · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Collaiborator-MEDLLM-Llama-3-8B-v2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
TH
Thaki ASR KO Dialects v1 i1
Thaki · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB