GGUF models by gabriellarson

87 GGUF models quantized by gabriellarson on Hugging Face. Sizes run from 354M to 1030B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PO
Polaris 7B Preview
Polaris · gabriellarson
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
NE
NextCoder 14B
Nextcoder · gabriellarson
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingTool use
LU
Lucy
Lucy · gabriellarson
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
SE
II Search 4B
Search · gabriellarson
Params4.41B
Context96K
Q4_K_M2.7 GB
ReasoningTool use
JA
AI21 Jamba Mini 1.7
Jamba · gabriellarson
Params51.6B
Context256K
Q4_K_M31.2 GB
Tool use
AN
Anonymizer 0.6B
Anonymizer · gabriellarson
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
GP
Gpt Oss 20b
gpt-oss · gabriellarson
Params20.9B
Context128K
Smallest11.5 GB
Tool use
GP
Huihui Gpt Oss 20b BF16 Abliterated
gpt-oss · gabriellarson
Params20.9B
Context128K
Smallest12.1 GB
Tool use
WE
WEBGEN 4B Preview
Webgen · gabriellarson
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
KI
Kimi K2 Instruct BF16
Kimi · gabriellarson
Params1030B
Context128K
Smallest372.9 GB
Tool use
IN
INTELLECT 2
Intellect · gabriellarson
Params32.8B
Context40K
Q4_K_M19.9 GB
ReasoningTool use
UI
UIGEN T3 32B Preview
Uigen · gabriellarson
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · gabriellarson
Params12.3B
Context1024K
Q4_K_M7.5 GB
ReasoningTool use
QW
OpenBuddy R1 0528 Distill Qwen3 32B Preview3 QAT
Qwen · gabriellarson
Params32.8B
Context40K
Q4_K_M19.8 GB
Reasoning
AN
Anonymizer 1.7B
Anonymizer · gabriellarson
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
LU
Lucy 128k
Lucy · gabriellarson
Params1.72B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
SI
SimpleChat 4B V1
Simplechat · gabriellarson
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
AN
Anonymizer 4B
Anonymizer · gabriellarson
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
ER
ERNIE 4.5 300B A47B PT
Ernie · gabriellarson
Params299B
Context128K
Q4_K_M180.2 GB
GGUF
MI
Magistral Small 2507
Mistral · gabriellarson
Params23.6B
Context40K
Q4_K_M14.3 GB
Reasoning
QW
OpenBuddy R1 0528 Distill Qwen3 32B Preview4 QAT
Qwen · gabriellarson
Params32.8B
Context195K
Q4_K_M19.8 GB
Reasoning
SI
SimpleChat 30BA3B V2
Simplechat · gabriellarson
Params30.5B
Context195K
Q4_K_M18.6 GB
ReasoningTool use
UI
UIGEN X 4B 0729
Uigen · gabriellarson
Params4.41B
Context40K
Q4_K_M2.7 GB
ReasoningTool use
NA
Nanonets-OCR-s.gguf
Nanonets · gabriellarson
Params3.09B
Context125K
Smallest6.2 GB
Vision
JA
AI21 Jamba Large 1.7
Jamba · gabriellarson
Params399B
Context256K
Q4_K_M240.3 GB
Tool use
WE
WEBGEN OSS 20B
Webgen · gabriellarson
Params20.9B
Context128K
Smallest12.1 GB
Tool use
GR
GroveMoE Inst
Grovemoe · gabriellarson
Params32.9B
Context40K
Smallest65.9 GB
ReasoningTool use

Keep browsing