GGUF models by jkim96

65 GGUF models quantized by jkim96 on Hugging Face. Sizes run from 596M to 122B parameters. The longest trained context is 384K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Ministral 3 3B Reasoning 2512 DASHQ Q2
Mistral · jkim96
Params3.43B
Context256K
Smallest1.1 GB
ReasoningTool use
QW
Qwen2.5 VL 32B Instruct DASHQ Q2
Qwen · jkim96
Params32.8B
Context125K
Smallest9.3 GB
Vision
QW
Qwen3 4B Thinking 2507 DASHQ Q2
Qwen · jkim96
Params4.02B
Context256K
Smallest1.2 GB
ReasoningTool use
OR
Ornith 1.0 9B DASHQ Q2
Ornith · jkim96
Params8.95B
Context256K
Smallest3.2 GB
ReasoningTool use
QW
Qwen3.8 27B DASHQ Q2
Qwen · jkim96
Params26.9B
Context256K
Smallest7.8 GB
ReasoningTool use
MI
Ministral 3 14B Reasoning 2512 DASHQ Q2
Mistral · jkim96
Params13.5B
Context256K
Smallest4.1 GB
ReasoningTool use
MI
Devstral Small 2505 DASHQ Q2
Mistral · jkim96
Params23.6B
Context128K
Smallest6.8 GB
CodingTool use
GL
GLM 4 32B 0414 DASHQ Q2
GLM · jkim96
Params32.6B
Context32K
Smallest9.3 GB
Tool use
GE
gemma 4 31B it DASHQ Q2
Gemma · jkim96
Params30.7B
Context256K
Smallest8.8 GB
GGUF
QW
Qwen3.5 35B A3B DASHQ Q2
Qwen · jkim96
Params34.7B
Context256K
Smallest10.4 GB
GGUF
EX
EXAONE 4.5 33B DASHQ Q2
Exaone · jkim96
Params32.5B
Context256K
Smallest9.1 GB
GGUF
MI
Magistral Small 2509 DASHQ Q2
Mistral · jkim96
Params23.6B
Context128K
Smallest6.8 GB
ReasoningTool use
QW
Qwen3.5 9B DASHQ Q2
Qwen · jkim96
Params8.95B
Context256K
Smallest3.2 GB
GGUF
GE
gemma 4 12b it DASHQ Q2
Gemma · jkim96
Params11.9B
Context256K
Smallest3.6 GB
ReasoningTool use
GL
GLM 4.7 Flash DASHQ Q2
GLM · jkim96
Params29.9B
Context198K
Smallest10.2 GB
GGUF
PH
phi 4 DASHQ Q2
Phi · jkim96
Params14.7B
Context16K
Smallest4.7 GB
GGUF
LL
Llama 3.1 8B Instruct DASHQ Q2
Llama · jkim96
Params8.03B
Context128K
Smallest2.5 GB
Tool use
OL
Olmo 3.1 32B Instruct DASHQ Q2
OLMo · jkim96
Params32.2B
Context64K
Smallest8.9 GB
Tool use
SE
Seed Coder 8B Reasoning DASHQ Q2
Seed · jkim96
Params8.25B
Context64K
Smallest2.6 GB
CodingReasoning
SM
SmolLM3 3B DASHQ Q2
SmolLM · jkim96
Params3.08B
Context64K
Smallest0.9 GB
ReasoningTool use
MI
Magistral Small 2506 DASHQ Q2
Mistral · jkim96
Params23.6B
Context40K
Smallest6.8 GB
Reasoning
PH
Phi 4 reasoning DASHQ Q2
Phi · jkim96
Params14.7B
Context32K
Smallest4.2 GB
Reasoning
QW
Qwen3.6 27B DASHQ Q2
Qwen · jkim96
Params27B
Context256K
Smallest9.3 GB
GGUF
GE
gemma 4 E4B it DASHQ Q2
Gemma · jkim96
Params7.5B
Context128K
Smallest3.1 GB
GGUF
QW
Qwen3.5 0.8B DASHQ Q2
Qwen · jkim96
Params752M
Context256K
Smallest0.3 GB
ReasoningTool use
QW
Qwen3 0.6B DASHQ Q2
Qwen · jkim96
Params596M
Context40K
Smallest0.2 GB
ReasoningTool use
SE
Seed Coder 8B Instruct DASHQ Q2
Seed · jkim96
Params8.25B
Context32K
Smallest2.7 GB
Coding
QW
Qwen3.5 27B DASHQ Q2
Qwen · jkim96
Params27B
Context256K
Smallest8.6 GB
GGUF
OL
Olmo 3 7B Think DASHQ Q2
OLMo · jkim96
Params7.3B
Context64K
Smallest2.3 GB
Reasoning
MI
Devstral Small 2 24B Instruct 2512 DASHQ Q2
Mistral · jkim96
Params23.6B
Context384K
Smallest6.8 GB
CodingTool use

Keep browsing