IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
MV
mvpmaster NeuralDareDMistralPro 7b slerp
Mvpmaster · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
aifeifei798 DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · RichardErkhov
Params8B
Context—
Q4_K_M0.0 GB
HO
Homunculus
Homunculus · bartowski
Params12.5B
Context128K
Q4_K_M7.6 GB
DE
Llama 3 DeepSeek R1 Distill 8B LewdPlay Uncensored i1
DeepSeek · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GE
C2S-Scale-Gemma-2-27B
Gemma · Mungert
Params27.2B
Context8K
Q4_K_M16.7 GB
JA
JackOD 9B Coder
Jackod · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen2.5 14B Instruct Darija
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
UM
AQUILA Engine v1 i1
Uma · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
LL
Meta-Llama-3-8B-Instruct
Llama · duyntnet
Params8B
Context8K
Q4_K_M4.9 GB
QW
gte-Qwen2-7B-instruct
Qwen · RichardErkhov
Params7.61B
Context128K
Q4_K_M4.7 GB
PR
Precog 24B v1
Precog · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
EV
Evertide RX 12B
Evertide · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GL
GLM 4.7 Flash NEO CODE Imatrix MAX
GLM · DavidAU
Params30B
Context198K
Q4_K_M18.5 GB
SM
SmallThinker 3B Preview
Smallthinker · bartowski
Params3.4B
Context32K
Q4_K_M2.1 GB
TE
TextSynth 4B 0926
Textsynth · theprint
Params4B
Context256K
Q4_K_M2.5 GB
HA
Harmonic 9B
Harmonic · DJLougen
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama 3 Tulu v2.5 8b Uf Mean 70b Uf Rm Mixed Prompts
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MI
SlimHercules-4.0-Mistral-7B-v0.2
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
UN
UNA-ThePitbull-21.4B-v2
Una · bartowski
Params21.4B
Context32K
Q4_K_M12.9 GB
LU
LucidVitality 9b
Lucidvitality · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GL
GLM 4.7 Flash Heretic
GLM · bartowski
Params29.9B
Context198K
Q4_K_M18.5 GB
NE
OpenReasoning Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
PH
chrisob94 phi 3 7b dissertation doc chat experiment 10 fold
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
GR
Granite Vision 3.2 2b
Granite · bartowski
Params2.53B
Context16K
Q4_K_M1.5 GB
MA
Marco Mini Global Base
Marco · mradermacher
Params17.4B
Context32K
Q4_K_M10.6 GB
LI
ozone ai 0x lite
Lite · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GE
Gemma 3 R1 12B v1
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
PR
Nohobby L3.3 Prikol 70B v0.5
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen2.5 Wolverine CODER 11B
Qwen · mradermacher
Params10.9B
Context32K
Q4_K_M6.6 GB
QW
UnifiedReward 2.0 Qwen 7b
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB