GGUF models by KnutJaegersberg

54 GGUF models quantized by KnutJaegersberg on Hugging Face. Sizes run from 191M to 72.3B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
SC
SciReasoner 8B
Scireasoner · KnutJaegersberg
Params8.19B
Context32K
Smallest8.7 GB
GGUF
EU
EuroLLM 9B Instruct
Eurollm · KnutJaegersberg
Params9.15B
Context4K
Smallest9.7 GB
GGUF
XG
Xgen Small 9B Instruct R
Xgen · KnutJaegersberg
Params10.7B
Context256K
Smallest11.3 GB
GGUF
AG
Agents A1
Agents · KnutJaegersberg
Params34.7B
Context256K
Smallest36.9 GB
ReasoningTool use
EU
EuroLLM 22B Instruct Preview
Eurollm · KnutJaegersberg
Params22.6B
Context4K
Smallest24.1 GB
GGUF
RW
Rwkv7 7.2B G0A
Rwkv · KnutJaegersberg
Params7.2B
Context1024K
Smallest7.9 GB
Reasoning
TE
Teuken 7B Instruct Commercial v0.4
Teuken · KnutJaegersberg
Params7.45B
Context4K
Smallest7.9 GB
GGUF
XG
Xgen Small 4B Instruct R
Xgen · KnutJaegersberg
Params4.41B
Context256K
Smallest4.7 GB
GGUF
EU
EuroLLM 22B Preview
Eurollm · KnutJaegersberg
Params22.6B
Context4K
Smallest24.1 GB
GGUF
TE
Teuken 7B Instruct Research v0.4
Teuken · KnutJaegersberg
Params7.45B
Context4K
Q4_K_M5.0 GB
GGUF
YU
YuLan Mini
Yulan · KnutJaegersberg
Params2.42B
Context28K
Smallest2.6 GB
Coding
LL
Llama 3_3 Nemotron Super 49B GenRM Multilingual
Llama · KnutJaegersberg
Params49.9B
Context128K
Smallest40.9 GB
GGUF
OP
OpenCoder 8B Instruct
Opencoder · KnutJaegersberg
Params7.77B
Context8K
Smallest8.3 GB
Coding
FI
Fin R1 Q8 0
Fin · KnutJaegersberg
Params7.62B
Context32K
Smallest8.1 GB
ReasoningTool use
RR
RRM 32B
Rrm · KnutJaegersberg
Params32.8B
Context128K
Smallest34.8 GB
ReasoningTool use
AR
arco Q8 0
Arco · KnutJaegersberg
Params514M
Context8K
Smallest0.5 GB
GGUF
SA
SauerkrautLM v2 14b SFT
Sauerkrautlm · KnutJaegersberg
Params14.8B
Context32K
Smallest15.7 GB
GGUF
QW
Qwen2.5 7B Instruct RLVR
Qwen · KnutJaegersberg
Params7.62B
Context32K
Smallest8.1 GB
Tool use
QW
QwenLong L1 32B
Qwen · KnutJaegersberg
Params32.8B
Context128K
Smallest34.8 GB
ReasoningTool use
TE
Teuken 7B Instruct Research v0.4
Teuken · KnutJaegersberg
Params7.45B
Context4K
Smallest7.9 GB
GGUF
GE
GemmaCoder3 12B Q8 0
Gemma · KnutJaegersberg
Params11.8B
Context128K
Smallest12.5 GB
CodingReasoning
TH
K2 Think
Think · KnutJaegersberg
Params32.8B
Context128K
Smallest34.8 GB
Reasoning
RR
RRM 7B Q8 0
Rrm · KnutJaegersberg
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
MO
MoMo 72b
Momo · KnutJaegersberg
Params72.3B
Context32K
Q4_K_M43.8 GB
GGUF

Keep browsing