GGUF models by jkim96
65 GGUF models quantized by jkim96 on Hugging Face. Sizes run from 596M to 122B parameters. The longest trained context is 384K tokens.
MI
Ministral 3 3B Reasoning 2512 DASHQ Q2
Mistral · jkim96
Params3.43B
Context256K
Smallest1.1 GB
QW
Qwen2.5 VL 32B Instruct DASHQ Q2
Qwen · jkim96
Params32.8B
Context125K
Smallest9.3 GB
QW
Qwen3 4B Thinking 2507 DASHQ Q2
Qwen · jkim96
Params4.02B
Context256K
Smallest1.2 GB
OR
Ornith 1.0 9B DASHQ Q2
Ornith · jkim96
Params8.95B
Context256K
Smallest3.2 GB
QW
Qwen3.8 27B DASHQ Q2
Qwen · jkim96
Params26.9B
Context256K
Smallest7.8 GB
MI
Ministral 3 14B Reasoning 2512 DASHQ Q2
Mistral · jkim96
Params13.5B
Context256K
Smallest4.1 GB
MI
Devstral Small 2505 DASHQ Q2
Mistral · jkim96
Params23.6B
Context128K
Smallest6.8 GB
GL
GLM 4 32B 0414 DASHQ Q2
GLM · jkim96
Params32.6B
Context32K
Smallest9.3 GB
GE
gemma 4 31B it DASHQ Q2
Gemma · jkim96
Params30.7B
Context256K
Smallest8.8 GB
QW
Qwen3.5 35B A3B DASHQ Q2
Qwen · jkim96
Params34.7B
Context256K
Smallest10.4 GB
EX
EXAONE 4.5 33B DASHQ Q2
Exaone · jkim96
Params32.5B
Context256K
Smallest9.1 GB
MI
Magistral Small 2509 DASHQ Q2
Mistral · jkim96
Params23.6B
Context128K
Smallest6.8 GB
QW
Qwen3.5 9B DASHQ Q2
Qwen · jkim96
Params8.95B
Context256K
Smallest3.2 GB
GE
gemma 4 12b it DASHQ Q2
Gemma · jkim96
Params11.9B
Context256K
Smallest3.6 GB
GL
GLM 4.7 Flash DASHQ Q2
GLM · jkim96
Params29.9B
Context198K
Smallest10.2 GB
PH
phi 4 DASHQ Q2
Phi · jkim96
Params14.7B
Context16K
Smallest4.7 GB
LL
Llama 3.1 8B Instruct DASHQ Q2
Llama · jkim96
Params8.03B
Context128K
Smallest2.5 GB
OL
Olmo 3.1 32B Instruct DASHQ Q2
OLMo · jkim96
Params32.2B
Context64K
Smallest8.9 GB
SE
Seed Coder 8B Reasoning DASHQ Q2
Seed · jkim96
Params8.25B
Context64K
Smallest2.6 GB
SM
SmolLM3 3B DASHQ Q2
SmolLM · jkim96
Params3.08B
Context64K
Smallest0.9 GB
MI
Magistral Small 2506 DASHQ Q2
Mistral · jkim96
Params23.6B
Context40K
Smallest6.8 GB
PH
Phi 4 reasoning DASHQ Q2
Phi · jkim96
Params14.7B
Context32K
Smallest4.2 GB
QW
Qwen3.6 27B DASHQ Q2
Qwen · jkim96
Params27B
Context256K
Smallest9.3 GB
GE
gemma 4 E4B it DASHQ Q2
Gemma · jkim96
Params7.5B
Context128K
Smallest3.1 GB
QW
Qwen3.5 0.8B DASHQ Q2
Qwen · jkim96
Params752M
Context256K
Smallest0.3 GB
QW
Qwen3 0.6B DASHQ Q2
Qwen · jkim96
Params596M
Context40K
Smallest0.2 GB
SE
Seed Coder 8B Instruct DASHQ Q2
Seed · jkim96
Params8.25B
Context32K
Smallest2.7 GB
QW
Qwen3.5 27B DASHQ Q2
Qwen · jkim96
Params27B
Context256K
Smallest8.6 GB
OL
Olmo 3 7B Think DASHQ Q2
OLMo · jkim96
Params7.3B
Context64K
Smallest2.3 GB
MI
Devstral Small 2 24B Instruct 2512 DASHQ Q2
Mistral · jkim96
Params23.6B
Context384K
Smallest6.8 GB