GGUF models by gabriellarson
87 GGUF models quantized by gabriellarson on Hugging Face. Sizes run from 354M to 1030B parameters. The longest trained context is 1024K tokens.
PO
Polaris 7B Preview
Polaris · gabriellarson
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
NextCoder 14B
Nextcoder · gabriellarson
Params14.8B
Context32K
Q4_K_M9.0 GB
LU
Lucy
Lucy · gabriellarson
Params1.72B
Context40K
Q4_K_M1.1 GB
SE
II Search 4B
Search · gabriellarson
Params4.41B
Context96K
Q4_K_M2.7 GB
JA
AI21 Jamba Mini 1.7
Jamba · gabriellarson
Params51.6B
Context256K
Q4_K_M31.2 GB
AN
Anonymizer 0.6B
Anonymizer · gabriellarson
Params596M
Context40K
Q4_K_M0.4 GB
GP
Gpt Oss 20b
gpt-oss · gabriellarson
Params20.9B
Context128K
Smallest11.5 GB
GP
Huihui Gpt Oss 20b BF16 Abliterated
gpt-oss · gabriellarson
Params20.9B
Context128K
Smallest12.1 GB
WE
WEBGEN 4B Preview
Webgen · gabriellarson
Params4.02B
Context256K
Q4_K_M2.5 GB
KI
Kimi K2 Instruct BF16
Kimi · gabriellarson
Params1030B
Context128K
Smallest372.9 GB
IN
INTELLECT 2
Intellect · gabriellarson
Params32.8B
Context40K
Q4_K_M19.9 GB
UI
UIGEN T3 32B Preview
Uigen · gabriellarson
Params32.8B
Context40K
Q4_K_M19.8 GB
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · gabriellarson
Params12.3B
Context1024K
Q4_K_M7.5 GB
QW
OpenBuddy R1 0528 Distill Qwen3 32B Preview3 QAT
Qwen · gabriellarson
Params32.8B
Context40K
Q4_K_M19.8 GB
AN
Anonymizer 1.7B
Anonymizer · gabriellarson
Params1.72B
Context40K
Q4_K_M1.1 GB
LU
Lucy 128k
Lucy · gabriellarson
Params1.72B
Context128K
Q4_K_M1.1 GB
SI
SimpleChat 4B V1
Simplechat · gabriellarson
Params4.02B
Context40K
Q4_K_M2.5 GB
AN
Anonymizer 4B
Anonymizer · gabriellarson
Params4.02B
Context40K
Q4_K_M2.5 GB
ER
ERNIE 4.5 300B A47B PT
Ernie · gabriellarson
Params299B
Context128K
Q4_K_M180.2 GB
MI
Magistral Small 2507
Mistral · gabriellarson
Params23.6B
Context40K
Q4_K_M14.3 GB
QW
OpenBuddy R1 0528 Distill Qwen3 32B Preview4 QAT
Qwen · gabriellarson
Params32.8B
Context195K
Q4_K_M19.8 GB
SI
SimpleChat 30BA3B V2
Simplechat · gabriellarson
Params30.5B
Context195K
Q4_K_M18.6 GB
UI
UIGEN X 4B 0729
Uigen · gabriellarson
Params4.41B
Context40K
Q4_K_M2.7 GB
NA
Nanonets-OCR-s.gguf
Nanonets · gabriellarson
Params3.09B
Context125K
Smallest6.2 GB
JA
AI21 Jamba Large 1.7
Jamba · gabriellarson
Params399B
Context256K
Q4_K_M240.3 GB
WE
WEBGEN OSS 20B
Webgen · gabriellarson
Params20.9B
Context128K
Smallest12.1 GB
GR
GroveMoE Inst
Grovemoe · gabriellarson
Params32.9B
Context40K
Smallest65.9 GB