IQ4_NL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Miscii 14b 1028
Miscii · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
RoleplayTool use
MI
cognitivecomputations dolphin 2.6 mistral 7b dpo laser
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TE
Tessa Rust T1 7B
Tessa · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
DA
Dans PersonalityEngine V1.2.0 24B i1
Dans · BasedAGI
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
AT
ATLAS 8B Thinking
Atlas · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
DA
Dans AdventurousWinds 7b
Dans · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
Montebello 7B SLERP
Montebello · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
CY
Cydonia Redux 22B v1.1
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
GE
Gemma 3 12b It Vl GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
GL
GLM 4.6V Flash Heretic
GLM · ZuzeTt
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
SM
Smollm2 1.7b Abliterated
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
FA
Falcon H1 0.5B Instruct
Falcon · tiiuae
Params521M
Context16K
Q4_K_M0.3 GB
GGUF
NE
OpenReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
AM
AmoreLLM 4B
Amorellm · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
ReasoningTool use
MI
flammenai flammen16 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MiniCPM5 2B Abliterated Uncensored Safetensors
MiniCPM · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
Tool use
DA
Dark Craving 26B A4B v0.2
Dark · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
NE
NeuralMaxime 7B slerp
Neuralmaxime · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwen2.5 1.5B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
Llama3 Med42 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Cogito v1 Preview Qwen 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.8 GB
GGUF
LF
LFM2.5 2.6B heretic uncensored
Lfm · noctrex
Params2.7B
Context125K
Q4_K_M1.7 GB
GGUF
BI
Bielik 11B v3.0 Instruct
Bielik · bartowski
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
AV
Avicenna 8B Base
Avicenna · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
QW
OPSD Qwen3 4B
Qwen · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
Reasoning
LL
Llama 3.1 Storm 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
Reasoning
QW
Qwen3.8 27B TTURBO Cold Fusion 709 L NM DAU UltraOptimised VariableThinking
Qwen · Solstice-AI
Params27B
Context256K
Q4_K_M16.5 GB
CodingReasoningRoleplay
CH
CHIMERA 4B SFT
Chimera · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
MA
Marco Nano Instruct
Marco · mradermacher
Params8B
Context32K
Q4_K_M5.4 GB
Reasoning
RA
RAFT 7B
Raft · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use

Other quants

Keep browsing