GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
SU
sum small
Sum · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
CO
c4ai-command-r-plus
Command R · bartowski
Params104B
Context128K
Q4_K_M62.8 GB
LL
Tess 3 Llama 3.1 405B
Llama · bartowski
Params410B
Context128K
Q4_K_M245.7 GB
LL
EVA LLaMA 3.33 70B v0.0
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 70B ArliAI RPMax v1.1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
InfiniAILab QwQ 0.5B
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
MI
ChatHercules 2.5 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
PN
L3 Pneuma 8B
Pneuma · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama-3-neural-chat-v2.2-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Ultra-Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
dolphin-2.9.2-mixtral-8x22b
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
LU
L3 Luna 8B
Luna · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Instruct-8B-SimPO-ExPO
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LF
LFM2 2.6B Exp
Lfm · bartowski
Params2.7B
Context125K
Q4_K_M1.6 GB
NO
Nova Tempus 70B v0.1
Nova · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Awanllm-Llama-3-8B-Instruct-ORPO-v0.1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
EulerMath-Mistral-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
bagel-8b-v1.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
SlimOrca-Llama-3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral 7B v0.1 ORPO
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
The Omega Directive M 12B v1.0
The · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama-3-Orca-1.0-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
MO
moxin llm 7b
Moxin · bartowski
Params8.11B
Context32K
Q4_K_M4.9 GB
LL
Llama3-ChatQA-1.5-70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
JSL-MedLlama-3-8B-v2.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
KU
Kurage En
Kurage · bartowski
Params7.61B
Context32K
Q4_K_M4.7 GB
LL
Llama 3 8B Stroganoff 4.0
Llama · bartowski
Params8.03B
Context10K
Q4_K_M4.9 GB
AS
Astral Fusion 8b v0.0
Astral · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral7B-PairRM-SPPO-Iter3
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
Infracelestial 7B
Infracelestial · bartowski
Params7.62B
Context32K
Q4_K_M4.9 GB