General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
SY
maywell_synatra-v0.1-7b-instruct
Synatra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · qwp4w3hyb
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
SA
SambaLingo Hungarian Chat
Sambalingo · mradermacher
Params6.95B
Context4K
Q4_K_M4.2 GB
GGUF
PH
calme-2.1-phi3.5-4b
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
TO
tokyotech llm Swallow 7b instruct hf
Tokyotech · RichardErkhov
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Lebanese Llama 3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
NE
NeonLLM-Base
Neonllm · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Tool use
OR
Ornith 1.5 35B A3B BigBang MTP
Ornith · EryriLabs
Params1.86B
Context256K
Q4_K_M21.2 GB
GGUF
DE
DeepPresenter 9B
Deeppresenter · Forceless
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen3.8 Flash Next GSQ RCO IQ2 XS
Qwen · baibairui
Params177B
Context256K
Smallest68.0 GB
GGUF
NA
Nanbeige4.3 33B Base
Nanbeige · mradermacher
Params33.1B
Context128K
Q4_K_M20.1 GB
GGUF
NE
models--automerger--NeuralsynthesisMultiverseex26-7B
Neuralsynthesis · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
models--automerger--T3qT3qm7xp-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
nickynicky_mistral-7b-openorca-oasst_top1_2023-08-25-v2
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Turkish Llama 8b Instruct v0.1
Llama · ytu-ce-cosmos
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 8B Instruct Gradient 1048k GGUF smashed
Llama · PrunaAI
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
PH
Iceball Phi 3.5 mini instruct shareGPT v1.0 i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
PH
Phi4 Abliterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
YI
Yi-34B-200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Git Commit Message Splitter Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
LL
calme-2.1-llama3.1-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
IC
IceEspressoRPv1 7b i1
Iceespressorpv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi 34B
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
QW
Replete LLM V2.5 Qwen 7b
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GE
Fallen Gemma3 4B v1
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
SO
SOCAM V1
Socam · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
LF
LFM2.5 2.6B Tema_Q Abliterated
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
GGUF
DE
deepseek llm 67b chat i1
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
BI
Bielik 11B v2.3 Instruct
Bielik · speakleash
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
QW
Qwen3.5-9B
Qwen · EcoAI-Lab
Params9.2B
Context256K
Smallest3.9 GB
GGUF

Other uses

Keep browsing