GGUF models by gabriellarson
87 GGUF models quantized by gabriellarson on Hugging Face. Sizes run from 354M to 1030B parameters. The longest trained context is 1024K tokens.
KI
Kimina Prover 72B
Kimi · gabriellarson
Params72.7B
Context128K
Q4_K_M47.4 GB
NF
NFT 7B
Nft · gabriellarson
Params7.62B
Context4K
Q4_K_M4.7 GB
TO
Tongyi DeepResearch 30B A3B
Tongyi · gabriellarson
Params30.5B
Context128K
Q4_K_M18.6 GB
LF
LFM2 2.6B
Lfm · gabriellarson
Params2.57B
Context125K
Q4_K_M1.6 GB
QW
Jupyter Agent Qwen3 4b Thinking
Qwen · gabriellarson
Params4.02B
Context256K
Q4_K_M2.5 GB
ME
Medgemma 27b It
Medgemma · gabriellarson
Params27B
Context128K
Q4_K_M16.5 GB
HU
Hunyuan 4B Instruct
Hunyuan · gabriellarson
Params4.22B
Context256K
Q4_K_M2.6 GB
LL
Llama 3 3 Nemotron Super 49B v1 5
Llama · gabriellarson
Params49.9B
Context128K
Q4_K_M30.2 GB
ME
MediPhi Instruct
Mediphi · gabriellarson
Params3.82B
Context128K
Q4_K_M2.4 GB
NE
OpenCodeReasoning Nemotron 1.1 32B
Nemotron · gabriellarson
Params32.8B
Context64K
Q4_K_M19.9 GB
NA
NatureLM 8x7B Inst
Naturelm · gabriellarson
Params46.8B
Context32K
Q4_K_M28.5 GB
MI
MindLink 32B 0801
Mindlink · gabriellarson
Params32.8B
Context40K
Q4_K_M19.8 GB
NE
AceReason Nemotron 1.1 7B
Nemotron · gabriellarson
Params7.62B
Context128K
Q4_K_M4.7 GB
GP
Gpt Oss 120b
gpt-oss · gabriellarson
Params117B
Context128K
Smallest62.6 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · gabriellarson
Params8.19B
Context128K
Q4_K_M5.0 GB
ER
ERNIE 4.5 21B A3B Thinking
Ernie · gabriellarson
Params21.8B
Context128K
Q4_K_M13.2 GB
KI
Kimina Prover Distill 1.7B
Kimi · gabriellarson
Params2.03B
Context40K
Q4_K_M1.3 GB
NE
OpenReasoning Nemotron 7B
Nemotron · gabriellarson
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
OpenReasoning Nemotron 32B
Nemotron · gabriellarson
Params32.8B
Context128K
Q4_K_M19.9 GB
HU
Hunyuan 1.8B Instruct
Hunyuan · gabriellarson
Params1.79B
Context256K
Q4_K_M1.1 GB
PO
Polaris 4B Preview
Polaris · gabriellarson
Params4.02B
Context128K
Q4_K_M2.5 GB
NE
NextCoder 32B
Nextcoder · gabriellarson
Params32.8B
Context32K
Q4_K_M19.9 GB
IC
ICONN 1
Iconn · gabriellarson
Params84B
Context32K
Q4_K_M50.9 GB
QQ
qqWen 32B RL Reasoning
Qqwen · gabriellarson
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
OpenBuddy R1 0528 Distill Qwen3 32B Preview7 QAT 200K
Qwen · gabriellarson
Params32.8B
Context195K
Q4_K_M19.8 GB
UI
UIGEN X 32B 0727
Uigen · gabriellarson
Params32.8B
Context40K
Q4_K_M19.8 GB
HU
Hunyuan 7B Instruct
Hunyuan · gabriellarson
Params7.5B
Context256K
Q4_K_M4.6 GB
HU
Hunyuan 0.5B Instruct
Hunyuan · gabriellarson
Params539M
Context256K
Q4_K_M0.4 GB
OP
OpenBuddy R10528DistillQwen 72B Preview1
Openbuddy · gabriellarson
Params72.7B
Context195K
Q4_K_M47.4 GB
PU
pumlGenV2
Pumlgenv · gabriellarson
Params8.19B
Context32K
Q4_K_M5.0 GB