GGUF models by ijohn07

106 GGUF models quantized by ijohn07 on Hugging Face. Sizes run from 773M to 34.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 14B Uncensored
Qwen · ijohn07
Params14.8B
Context40K
Smallest15.7 GB
ReasoningTool use
DE
DeepSeek Coder V2 Lite Base
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest14.1 GB
Coding
LL
Llama 3.2 1B Instruct Uncensored
Llama · ijohn07
Params1.24B
Context128K
Smallest1.3 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · ijohn07
Params31.6B
Context1024K
Smallest19.8 GB
GGUF
GE
GELab Zero 4B Preview Sico Evolution
Gelab · ijohn07
Params4.02B
Context256K
Q4_K_M2.5 GB
Vision
DE
DeepSeek V2 Lite
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest16.7 GB
GGUF
DE
DeepSeek V2 Lite Chat Uncensored Unbiased Reasoner
DeepSeek · ijohn07
Params15.7B
Context4K
Q4_K_M10.4 GB
Reasoning
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest14.1 GB
Coding
HO
Holo 3.1 0.8B
Holo · ijohn07
Params1.01B
Context256K
Smallest0.8 GB
ReasoningTool useVision
GE
gemma-3-12b-it-codeforces-SFT
Gemma · ijohn07
Params11.8B
Context128K
Smallest9.7 GB
Reasoning
AG
Agents A1
Agents · ijohn07
Params34.7B
Context256K
Smallest16.8 GB
ReasoningTool use
MI
Mistral NeMo Minitron 8B Instruct
Mistral · ijohn07
Params8.41B
Context8K
Smallest8.9 GB
GGUF
GE
gemma-3-4b-it-codeforces-SFT
Gemma · ijohn07
Params3.88B
Context128K
Smallest3.2 GB
Reasoning
DA
H2O Danube3.1 4b Chat
Danube · ijohn07
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
HO
Holo 3.1 4B
Holo · ijohn07
Params4.84B
Context256K
Smallest5.2 GB
ReasoningTool useVision
DE
DeepSeek Coder V2 Lite Instruct
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest16.7 GB
Coding
QE
QED Nano
Qed · ijohn07
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
GE
GELab Zero 4B Preview Sico Evolution
Gelab · ijohn07
Params4.02B
Context256K
Smallest3.3 GB
Vision
DE
DeepSeek V2 Lite Chat
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest16.7 GB
GGUF
OL
OLMo 7B 0724 Instruct Hf
OLMo · ijohn07
Params6.89B
Context4K
Smallest7.3 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct
Qwen · ijohn07
Params7.62B
Context32K
Smallest8.1 GB
CodingTool use
PR
Promt generator Q8 0
Promt · ijohn07
Params816M
Context2K
Smallest0.9 GB
GGUF
NE
Nemotron Research GooseReason 4B Instruct
Nemotron · ijohn07
Params4.41B
Context256K
Smallest4.7 GB
CodingReasoning
DA
H2O Danube3.1 4b Chat
Danube · ijohn07
Params3.96B
Context8K
Smallest4.2 GB
GGUF
QE
QED Nano
Qed · ijohn07
Params4.02B
Context256K
Smallest4.3 GB
ReasoningTool use
DE
DeepSeek V2 Lite
DeepSeek · ijohn07
Params15.7B
Context160K
Smallest14.1 GB
GGUF
NE
Nemotron Research GooseReason 4B Instruct
Nemotron · ijohn07
Params4.41B
Context256K
Q4_K_M2.7 GB
CodingReasoning
GE
GELab Zero 4B Preview Sico Evolution
Gelab · ijohn07
Params4.02B
Context256K
Smallest2.9 GB
Vision
GE
gemma-3-4b-it-codeforces-SFT
Gemma · ijohn07
Params3.88B
Context128K
Smallest4.1 GB
Reasoning
MI
Minitron 4B Base
Minitron · ijohn07
Params4.19B
Context4K
Q4_K_M2.7 GB
GGUF

Keep browsing