IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
MI
Miscii 14b 1028
Miscii · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
MI
cognitivecomputations dolphin 2.6 mistral 7b dpo laser
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
TE
Tessa Rust T1 7B
Tessa · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
DA
Dans PersonalityEngine V1.2.0 24B i1
Dans · BasedAGI
Params23.6B
Context32K
Q4_K_M14.3 GB
AT
ATLAS 8B Thinking
Atlas · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
DA
Dans AdventurousWinds 7b
Dans · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
Montebello 7B SLERP
Montebello · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
CY
Cydonia Redux 22B v1.1
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GE
Gemma 3 12b It Vl GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GL
GLM 4.6V Flash Heretic
GLM · ZuzeTt
Params9.4B
Context128K
Q4_K_M6.2 GB
SM
Smollm2 1.7b Abliterated
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
FA
Falcon H1 0.5B Instruct
Falcon · tiiuae
Params521M
Context16K
Q4_K_M0.3 GB
NE
OpenReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
AM
AmoreLLM 4B
Amorellm · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
MI
flammenai flammen16 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniCPM5 2B Abliterated Uncensored Safetensors
MiniCPM · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
DA
Dark Craving 26B A4B v0.2
Dark · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
NE
NeuralMaxime 7B slerp
Neuralmaxime · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
QW
Qwen2.5 1.5B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Llama3 Med42 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Cogito v1 Preview Qwen 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.8 GB
LF
LFM2.5 2.6B heretic uncensored
Lfm · noctrex
Params2.7B
Context125K
Q4_K_M1.7 GB
BI
Bielik 11B v3.0 Instruct
Bielik · bartowski
Params11.2B
Context32K
Q4_K_M6.7 GB
AV
Avicenna 8B Base
Avicenna · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
OPSD Qwen3 4B
Qwen · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
LL
Llama 3.1 Storm 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
QW
Qwen3.8 27B TTURBO Cold Fusion 709 L NM DAU UltraOptimised VariableThinking
Qwen · Solstice-AI
Params27B
Context256K
Q4_K_M16.5 GB
CH
CHIMERA 4B SFT
Chimera · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
MA
Marco Nano Instruct
Marco · mradermacher
Params8B
Context32K
Q4_K_M5.4 GB
RA
RAFT 7B
Raft · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB