GGUF models by bartowski

1937 GGUF models quantized by bartowski on Hugging Face. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SU
sum small
Sum · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
CO
c4ai-command-r-plus
Command R · bartowski
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
LL
Tess 3 Llama 3.1 405B
Llama · bartowski
Params410B
Context128K
Q4_K_M245.7 GB
GGUF
LL
EVA LLaMA 3.33 70B v0.0
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
Llama 3.1 70B ArliAI RPMax v1.1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
InfiniAILab QwQ 0.5B
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
ReasoningTool use
MI
ChatHercules 2.5 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PN
L3 Pneuma 8B
Pneuma · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama-3-neural-chat-v2.2-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Ultra-Instruct
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
dolphin-2.9.2-mixtral-8x22b
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
CodingTool use
LU
L3 Luna 8B
Luna · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Instruct-8B-SimPO-ExPO
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LF
LFM2 2.6B Exp
Lfm · bartowski
Params2.7B
Context125K
Q4_K_M1.6 GB
Tool use
NO
Nova Tempus 70B v0.1
Nova · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Awanllm-Llama-3-8B-Instruct-ORPO-v0.1
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
EulerMath-Mistral-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
bagel-8b-v1.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingRoleplayTool use
LL
SlimOrca-Llama-3-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral 7B v0.1 ORPO
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
The Omega Directive M 12B v1.0
The · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
LL
Llama-3-Orca-1.0-8B
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
MO
moxin llm 7b
Moxin · bartowski
Params8.11B
Context32K
Q4_K_M4.9 GB
GGUF
LL
Llama3-ChatQA-1.5-70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
JSL-MedLlama-3-8B-v2.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KU
Kurage En
Kurage · bartowski
Params7.61B
Context32K
Q4_K_M4.7 GB
GGUF
LL
Llama 3 8B Stroganoff 4.0
Llama · bartowski
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
AS
Astral Fusion 8b v0.0
Astral · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral7B-PairRM-SPPO-Iter3
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IN
Infracelestial 7B
Infracelestial · bartowski
Params7.62B
Context32K
Q4_K_M4.9 GB
Roleplay

Keep browsing