GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
LL
Llama-3-Hercules-5.0-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
Phi Lthy4
Phi · bartowski
Params11.9B
Context16K
Q4_K_M7.3 GB
LL
Llama3-8B-Instruct-Replete-Adapted
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
FU
functionary medium v3.2
Functionary · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
WI
WizardLM-2-8x22B
Wizardlm · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
ST
Starling LM 7B beta
Starling · bartowski
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Llama-3-Yggdrasil-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
FI
FineLlama 3.1 8B
Finellama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
OR
orca mini v8 1 70b
Orca · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
IC
IceDrunkenCherryRP 7b
Icedrunkencherryrp · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
FI
Fimbulvetr Kuro Lotus 10.7B
Fimbulvetr · bartowski
Params10.7B
Context8K
Q4_K_M6.5 GB
AR
Arch Function 1.5B
Arch · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
FA
FastApply 7B v1.0
Fastapply · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
SE
SERA 8B
Sera · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
AR
Arch Function 3B
Arch · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
Hyperion 3.0 Mistral 7B alpha
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
NI
NightWing3 10B v0.1
Nightwing · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
DA
L3.3 Dark Ages 70b v0.1
Dark · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama-3-Yggdrasil-2.0-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
OpenHercules 2.5 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenCerebrum-2.0-7B
Opencerebrum · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
HU
HuatuoGPT O1 70B
Huatuogpt · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
bigstral-12b-32k-8xMoE
Mistral · bartowski
Params81.5B
Context32K
Q4_K_M49.6 GB
NE
Nemomix v0.1 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
CO
codegemma-7b
Codegemma · bartowski
Params8.54B
Context8K
Q4_K_M5.3 GB
FA
Falcon
Falcon · bartowski
Params11.1B
Context2K
Q4_K_M6.8 GB
EN
Endurance 100B v1
Endurance · bartowski
Params100B
Context128K
Q4_K_M60.0 GB
TE
Teleut 7b
Teleut · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
AL
AlchemistCoder-DS-6.7B
Alchemistcoder · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
YI
Yi 9B Coder
Yi · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB