IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
ST
L3-8B-Stheno-v3.1
Stheno · Lewdiculous
Params8B
Context8K
Q4_K_M4.9 GB
CA
CAT Translate 7b
Cat · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
YI
yihao llm 7b i1
Yihao · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
FA
Fabliq 8B Agent FromBase Reasoning
Fabliq · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
FO
FoodGuard 4B
Foodguard · bartowski
Params4.41B
Context32K
Q4_K_M2.8 GB
TD
TDM 8b v0.1
Tdm · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
WI
Wicked Tutu 31B
Wicked · ReadyArt
Params30.7B
Context256K
Q4_K_M20.3 GB
OM
Omega Evolution 26B A4B v3.0
Omega · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
RA
Ramakrishna 7b v3
Ramakrishna · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
QW
Qwen3.8 27B TurboFCFusion CyberSec
Qwen · bbkdevops
Params27.3B
Context256K
Smallest17.8 GB
GE
gemma 4 A4B 98e v7 coderx it
Gemma · ManniX-ITA
Params19.9B
Context256K
Q4_K_M13.2 GB
CO
c4ai-command-r-plus
Command R · pmysl
Params104B
Context128K
Q4_K_M62.8 GB
LL
kykim0 Llama 2 7b ultrachat code
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
NE
NEIRA HF1 4B
Neira · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
OL
OLMoE 1B 7B 0924 SFT
OLMo · mradermacher
Params6.9B
Context4K
Q4_K_M4.2 GB
LF
LFM2 1.2B RAG
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
Qwen2.5 1.5B Instruct
Qwen · legraphista
Params1.54B
Context32K
Smallest0.4 GB
GR
granite-4.0-h-micro
Granite · Mungert
Params3.2B
Context1024K
Q4_K_M2.0 GB
CY
Cydonia_Vistral
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
PH
Phi4.React.Turn.V2.Full i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
QW
Qwen3.5-4B
Qwen · Fix-AI
Params4.21B
Context256K
Q4_K_M2.7 GB
NE
NVIDIA-Nemotron-3.5-Transcribe-30B-A4B
Nemotron · sakasegawa
Params33.7B
Context—
Smallest19.0 GB
VU
VulnLLM R 7B
Vulnllm · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
OH
Ohm MythosNano
Ohm · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
LF
LFM2.5 Encoder 350M
Lfm · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
LL
Llama 3.1 Argunaut 1 8B SFT
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
QW
qwen2.5 vl 7b it
Qwen · chatpig
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.5 4B Deckard HERETIC UNCENSORED Thinking
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GW
gWorld 8B
Gworld · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
Llama 2 7b Ultrachat
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB