GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
FA
Falcon3 3B Instruct Abliterated
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
IM
Impish_Mind_8B
Impish · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LF
LFM2 VL 1.6B
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
Vision
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
TA
UI TARS 7B SFT
Tars · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
MI
Lite-Mistral-150M-v2-Instruct
Mistral · bartowski
Params157M
Context2K
Q4_K_M0.1 GB
GGUF
GE
gemma2 gutenberg 27B
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
BA
Baichuan M2 32B
Baichuan · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
BA
Bagel Dpo 8x7b v0.2
Bagel · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingRoleplay
LL
Llama Doctor 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
HU
Hunyuan A13B Instruct
Hunyuan · bartowski
Params80.4B
Context256K
Q4_K_M49.3 GB
GGUF
RO
RoboBrain2.0 7B
Robobrain · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
LL
Llama 3.1 70B ArliAI RPMax v1.3
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GR
Granite 3.0 8b Instruct
Granite · bartowski
Params8.17B
Context4K
Q4_K_M4.9 GB
GGUF
BE
Beck 4B
Beck · bartowski
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
MI
Miscii 14b 1028
Miscii · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
RoleplayTool use
TE
Tessa Rust T1 7B
Tessa · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
CY
Cydonia Redux 22B v1.1
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
NE
OpenReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
SU
TQ2.5 14B Sugarquill v1
Sugarquill · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Cogito v1 Preview Qwen 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.8 GB
GGUF
BI
Bielik 11B v3.0 Instruct
Bielik · bartowski
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
TW
TwinLlama 3.1 8B
Twinllama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
SE
Sekhmet_Bet L3.1 8B v0.2
Sekhmet · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GR
Granite Embedding 278m Multilingual
Granite · bartowski
Params278M
Context512
Q4_K_M0.2 GB
Embedding
IN
Internlm2_5 1_8b Chat
InternLM · bartowski
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
OL
open r1 OlympicCoder 32B
Olympiccoder · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoning
CY
Cydonia ReduX 22B v1
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
GE
FuseChat Gemma 2 9B Instruct
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Replete LLM Qwen2 7b
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF

Keep browsing