GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama-3-Hercules-5.0-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
Phi Lthy4
Phi · bartowski
Params11.9B
Context16K
Q4_K_M7.3 GB
GGUF
LL
Llama3-8B-Instruct-Replete-Adapted
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
FU
functionary medium v3.2
Functionary · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
WI
WizardLM-2-8x22B
Wizardlm · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
ST
Starling LM 7B beta
Starling · bartowski
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Llama-3-Yggdrasil-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
FI
FineLlama 3.1 8B
Finellama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
OR
orca mini v8 1 70b
Orca · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
IC
IceDrunkenCherryRP 7b
Icedrunkencherryrp · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FI
Fimbulvetr Kuro Lotus 10.7B
Fimbulvetr · bartowski
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
AR
Arch Function 1.5B
Arch · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
FA
FastApply 7B v1.0
Fastapply · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
SE
SERA 8B
Sera · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
AR
Arch Function 3B
Arch · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MI
Hyperion 3.0 Mistral 7B alpha
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
NI
NightWing3 10B v0.1
Nightwing · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
DA
L3.3 Dark Ages 70b v0.1
Dark · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-Yggdrasil-2.0-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
MI
OpenHercules 2.5 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
OP
OpenCerebrum-2.0-7B
Opencerebrum · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
HU
HuatuoGPT O1 70B
Huatuogpt · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
MI
bigstral-12b-32k-8xMoE
Mistral · bartowski
Params81.5B
Context32K
Q4_K_M49.6 GB
GGUF
NE
Nemomix v0.1 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CO
codegemma-7b
Codegemma · bartowski
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
FA
Falcon
Falcon · bartowski
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
EN
Endurance 100B v1
Endurance · bartowski
Params100B
Context128K
Q4_K_M60.0 GB
Tool use
TE
Teleut 7b
Teleut · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
AL
AlchemistCoder-DS-6.7B
Alchemistcoder · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
YI
Yi 9B Coder
Yi · bartowski
Params8.83B
Context4K
Q4_K_M5.3 GB
Coding

Keep browsing