GGUF models by ijohn07
106 GGUF models quantized by ijohn07 on Hugging Face. Sizes run from 773M to 34.7B parameters. The longest trained context is 1024K tokens.
QW
Qwen3 14B Uncensored
Qwen · ijohn07
Params14.8B
Context40K
Smallest15.7 GB
DE
DeepSeek Coder V2 Lite Base
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest14.1 GB
LL
Llama 3.2 1B Instruct Uncensored
Llama · ijohn07
Params1.24B
Context128K
Smallest1.3 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · ijohn07
Params31.6B
Context1024K
Smallest19.8 GB
GE
GELab Zero 4B Preview Sico Evolution
Gelab · ijohn07
Params4.02B
Context256K
Q4_K_M2.5 GB
DE
DeepSeek V2 Lite
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest16.7 GB
DE
DeepSeek V2 Lite Chat Uncensored Unbiased Reasoner
DeepSeek · ijohn07
Params15.7B
Context4K
Q4_K_M10.4 GB
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest14.1 GB
HO
Holo 3.1 0.8B
Holo · ijohn07
Params1.01B
Context256K
Smallest0.8 GB
GE
gemma-3-12b-it-codeforces-SFT
Gemma · ijohn07
Params11.8B
Context128K
Smallest9.7 GB
AG
Agents A1
Agents · ijohn07
Params34.7B
Context256K
Smallest16.8 GB
MI
Mistral NeMo Minitron 8B Instruct
Mistral · ijohn07
Params8.41B
Context8K
Smallest8.9 GB
GE
gemma-3-4b-it-codeforces-SFT
Gemma · ijohn07
Params3.88B
Context128K
Smallest3.2 GB
DA
H2O Danube3.1 4b Chat
Danube · ijohn07
Params3.96B
Context8K
Q4_K_M2.4 GB
HO
Holo 3.1 4B
Holo · ijohn07
Params4.84B
Context256K
Smallest5.2 GB
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest16.7 GB
QE
QED Nano
Qed · ijohn07
Params4.02B
Context256K
Q4_K_M2.5 GB
GE
GELab Zero 4B Preview Sico Evolution
Gelab · ijohn07
Params4.02B
Context256K
Smallest3.3 GB
DE
DeepSeek V2 Lite Chat
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest16.7 GB
OL
OLMo 7B 0724 Instruct Hf
OLMo · ijohn07
Params6.89B
Context4K
Smallest7.3 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · ijohn07
Params7.62B
Context32K
Smallest8.1 GB
PR
Promt generator Q8 0
Promt · ijohn07
Params816M
Context2K
Smallest0.9 GB
NE
Nemotron Research GooseReason 4B Instruct
Nemotron · ijohn07
Params4.41B
Context256K
Smallest4.7 GB
DA
H2O Danube3.1 4b Chat
Danube · ijohn07
Params3.96B
Context8K
Smallest4.2 GB
QE
QED Nano
Qed · ijohn07
Params4.02B
Context256K
Smallest4.3 GB
DE
DeepSeek V2 Lite
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest14.1 GB
NE
Nemotron Research GooseReason 4B Instruct
Nemotron · ijohn07
Params4.41B
Context256K
Q4_K_M2.7 GB
GE
GELab Zero 4B Preview Sico Evolution
Gelab · ijohn07
Params4.02B
Context256K
Smallest2.9 GB
GE
gemma-3-4b-it-codeforces-SFT
Gemma · ijohn07
Params3.88B
Context128K
Smallest4.1 GB
MI
Minitron 4B Base
Minitron · ijohn07
Params4.19B
Context4K
Q4_K_M2.7 GB