GGUF models by itlwas

475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
FA
Falcon3 10B Instruct Abliterated
Falcon · itlwas
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
QW
Qwen1.5 14B Chat
Qwen · itlwas
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
AU
Aura MoE 2x4B v2
Aura · itlwas
Params7.23B
Context128K
Q4_K_M4.4 GB
RoleplayTool use
LL
Meta Llama Guard 2 8B
Llama · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
LLaMA 2 13b GTL Delta Q4 K M
Llama · itlwas
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
TR
Triangulum 1B
Triangulum · itlwas
Params1.24B
Context128K
Q4_K_M0.8 GB
ReasoningTool use
PH
Einstein v6.1 phi2 Q4 K M
Phi · itlwas
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
SA
Sailor2 1B Chat
Sailor · itlwas
Params988M
Context32K
Q4_K_M0.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · itlwas
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
IN
Internlm2_5 20b Chat
InternLM · itlwas
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
LL
Llama 3.2 1B
Llama · itlwas
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
MI
Mixtral 8x7B Instruct v0.1
Mistral · itlwas
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
SH
Shieldgemma 2b
Shieldgemma · itlwas
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SM
SmolLM 1.7B
SmolLM · itlwas
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
FI
Fialka 7B v2.1
Fialka · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TR
Triangulum 10B
Triangulum · itlwas
Params10.3B
Context32K
Q4_K_M6.3 GB
Reasoning
PH
Einstein v4 phi2 Q4 K M
Phi · itlwas
Params2.78B
Context2K
Q4_K_M1.7 GB
CodingTool use
OP
OpenCoder 8B Instruct
Opencoder · itlwas
Params7.77B
Context8K
Q4_K_M4.7 GB
Coding
GE
Gemma 2 9b
Gemma · itlwas
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
CU
Custom KoLLM 13B v8 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
LL
llama 3 8b gpt 4o ru1.0 Q4 K M
Llama · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AV
Ava 1.0 12B Q4 K M
Ava · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Sailor-0.5B
Qwen · itlwas
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · itlwas
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
LL
Llama 3.2 Kapusta JapanChibi 3B v1
Llama · itlwas
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
MI
Mixtral 8x7B v0.1
Mistral · itlwas
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LL
LLaMA 2 7b GTL Delta Q4 K M
Llama · itlwas
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.1 Tulu 2 8b
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen1.5 7B
Qwen · itlwas
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF

Keep browsing