GGUF models: cc-by-sa-4.0 license

501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama-3-sqlcoder-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
MI
sqlcoder 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
AI
AIFT Ko Orca Plat Yi Ko 6b v1.2 Dpo
Aift · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
MI
Synatra 7B v0.3 dpo Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EE
EEVE Instruct Math 10.8B
Eeve · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
GP
Gpt2 Context_Generator
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
KO
maywell_koopenchat-sft
Koopenchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
PiVoT 10.7B Mistral v0.2 RP
Mistral · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
FL
flan t5 definition en large
Flan · mradermacher
Params783M
Context512
Q4_K_M0.5 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
CH
chatdb natural sql 7b
Chatdb · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
MI
PiVoT 0.1 early Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KI
Kiqu 70b
Kiqu · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
QW
syrian_qwen_3.5_2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
AI
AIFT Ko Orca Plat Yi Ko 6b v1.2 Dpo 3
Aift · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
PH
Phi 3 Context Obedient RAG
Phi · afrideva
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
FL
flan t5 definition en xl
Flan · mradermacher
Params2.85B
Context512
Q4_K_M1.8 GB
GGUF
MI
.\Mermaid\
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Mini DPO test02
Mini · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
ST
Stablelm Base Alpha 7b
Stablelm · mradermacher
Params7.87B
Context4K
Q4_K_M5.1 GB
GGUF
KR
Krakowiak 7B v2
Krakowiak · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PI
Westest 7B
Piano · Aryanne
Params7.24B
Context32K
Smallest3.5 GB
GGUF
PA
Paradigm Shift 7B i1
Paradigm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF

Keep browsing