GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Tess 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen2-7B-Multilingual-RP
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Roleplay
MI
Hyperion 2.0 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
LL
Tess-2.0-Llama-3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
dolphin-2.9.1-qwen-110b
Qwen · bartowski
Params111B
Context32K
Q4_K_M67.2 GB
CodingTool use
NE
Nemo 12b TheAnswer v0.1 E2
Nemo · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
GE
GeM2-Llamion-14B-LongChat
Gem · bartowski
Params14.5B
Context195K
Q4_K_M8.8 GB
GGUF
MI
Gigaberg Mistral Large 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
TU
turbcat instruct 72b
Turbcat · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
TE
Teleut 7b RP
Teleut · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Roleplay
CH
ozone research Chirp 01
Chirp · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MI
Mistral 7B v0.2 OpenHermes
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
CE
L3-8B-Celeste-V1.2
Celeste · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AL
AlchemistCoder-CL-7B
Alchemistcoder · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DO
dolphin 2.8 experiment26 7b
Dolphin · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
badger-lambda-llama-3-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Nexus IKM Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AR
Arcee-Nova
Arcee · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
BE
Behemoth 123B v2.1
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
TH
Theia 21B v1
Theia · bartowski
Params20.4B
Context1000K
Q4_K_M12.4 GB
GGUF
PR
Prismatic 12b v0.1 Experimental 1115
Prismatic · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
The Omega Abomination Gemma3 12B v1.0
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
QW
Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Roleplay
IN
InternLM2
InternLM · bartowski
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
NY
G2 DA Nyxora 27b V2
Nyxora · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral Crab SFT
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
TA
tabula-8b
Tabula · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
YI
Yi-1.5-34B-Chat-16K
Yi · bartowski
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
MI
internlm2-math-plus-mixtral8x22b
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
GGUF

Keep browsing