GGUF models by bau0221

39 GGUF models quantized by bau0221 on Hugging Face. Sizes run from 1.24B to 3.82B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
model 1210
Llama · bau0221
Params1.24B
Context128K
Smallest2.5 GB
Tool use
LL
model 1210 llama 3
Llama · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
LL
model 1210 llama
Llama · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
HL
HLI 0113GGUF 2
Hli · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
model 1127 1b 351
Model · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
model 1127 1b
Model · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
LL
model 1210 longprompt 2
Llama · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
model 1127 1b 16
Model · bau0221
Params1.24B
Context128K
Smallest2.5 GB
Tool use
MO
model 1125 q3k
Model · bau0221
Params3.82B
Context128K
Smallest1.9 GB
GGUF
MO
model 1127 1b 501
Model · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
LL
model 1224
Llama · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
LL
model 1210 llama 2
Llama · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
PH
model 1125 8bit
Phi · bau0221
Params3.82B
Context128K
Smallest4.1 GB
GGUF
LL
model 1210 llama 4
Llama · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
PH
model 1125 q4k
Phi · bau0221
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
LL
model 1210 longprompt
Llama · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
HL
HLI 0113
Hli · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
HL
HLI 0115GGUF 3
Hli · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
LL
model 1218
Llama · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
LL
model 1224 GGUF sm 2
Llama · bau0221
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
model 1125 q2k
Model · bau0221
Params3.82B
Context128K
Smallest1.4 GB
GGUF
HL
HLI 0114GGUF 2
Hli · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
1112 model nice
Model · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
MO
1113 model 2 hf
Model · bau0221
Params3.82B
Context128K
Smallest4.1 GB
GGUF
HL
HLI 0115 Q4
Hli · bau0221
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
model 1224 GGUF 2
Llama · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
LL
model 1224 GGUF sm
Llama · bau0221
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
HL
HLI 0115 2 Q4
Hli · bau0221
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MO
1112 model 1500
Model · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use
LL
model 1204 llama300
Llama · bau0221
Params1.24B
Context128K
Smallest1.3 GB
Tool use

About bau0221 on Hugging Face

bau0221 has published 39 GGUF models that ggufmodels.com tracks, across families such as Llama, Model and Hli. The most downloaded are model 1210, model 1210 llama 3 and model 1210 llama.

The quants bau0221 publishes most often are Q8_0 (29), Q4_K_M (5), F16 (2) and Q3_K_M (1). Their Q4_K_M files range from 0.8 to 2.3 GB. Parameter counts run from 1.24B to 3.82B, and the longest trained context window is 128K tokens.

Frequently asked questions

What GGUF models has bau0221 published?

39 models are listed here, mainly from the Llama, Model and Hli families. The most downloaded is model 1210.

Which quants does bau0221 publish?

The most common are Q8_0 (29 models), Q4_K_M (5 models), F16 (2 models) and Q3_K_M (1 models).

Keep browsing