GGUF models by bartowski
1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
FA
Falcon3 3B Instruct Abliterated
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
IM
Impish_Mind_8B
Impish · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LF
LFM2 VL 1.6B
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
TA
UI TARS 7B SFT
Tars · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
Lite-Mistral-150M-v2-Instruct
Mistral · bartowski
Params157M
Context2K
Q4_K_M0.1 GB
GE
gemma2 gutenberg 27B
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
BA
Baichuan M2 32B
Baichuan · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
BA
Bagel Dpo 8x7b v0.2
Bagel · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
Llama Doctor 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
HU
Hunyuan A13B Instruct
Hunyuan · bartowski
Params80.4B
Context256K
Q4_K_M49.3 GB
RO
RoboBrain2.0 7B
Robobrain · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
LL
Llama 3.1 70B ArliAI RPMax v1.3
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GR
Granite 3.0 8b Instruct
Granite · bartowski
Params8.17B
Context4K
Q4_K_M4.9 GB
BE
Beck 4B
Beck · bartowski
Params4B
Context40K
Q4_K_M2.5 GB
MI
Miscii 14b 1028
Miscii · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
TE
Tessa Rust T1 7B
Tessa · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
CY
Cydonia Redux 22B v1.1
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
NE
OpenReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
SU
TQ2.5 14B Sugarquill v1
Sugarquill · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Cogito v1 Preview Qwen 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.8 GB
BI
Bielik 11B v3.0 Instruct
Bielik · bartowski
Params11.2B
Context32K
Q4_K_M6.7 GB
TW
TwinLlama 3.1 8B
Twinllama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
SE
Sekhmet_Bet L3.1 8B v0.2
Sekhmet · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GR
Granite Embedding 278m Multilingual
Granite · bartowski
Params278M
Context512
Q4_K_M0.2 GB
IN
Internlm2_5 1_8b Chat
InternLM · bartowski
Params1.89B
Context32K
Q4_K_M1.2 GB
OL
open r1 OlympicCoder 32B
Olympiccoder · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
CY
Cydonia ReduX 22B v1
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GE
FuseChat Gemma 2 9B Instruct
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Replete LLM Qwen2 7b
Qwen · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB