GGUF models: cc-by-sa-4.0 license
501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.
LL
llama-3-sqlcoder-8b
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
MI
sqlcoder 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
AIFT Ko Orca Plat Yi Ko 6b v1.2 Dpo
Aift · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
MI
Synatra 7B v0.3 dpo Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EE
EEVE Instruct Math 10.8B
Eeve · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GP
Gpt2 Context_Generator
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
KO
maywell_koopenchat-sft
Koopenchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
PiVoT 10.7B Mistral v0.2 RP
Mistral · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
FL
flan t5 definition en large
Flan · mradermacher
Params783M
Context512
Q4_K_M0.5 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
CH
chatdb natural sql 7b
Chatdb · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
MI
PiVoT 0.1 early Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
KI
Kiqu 70b
Kiqu · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
QW
syrian_qwen_3.5_2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
AI
AIFT Ko Orca Plat Yi Ko 6b v1.2 Dpo 3
Aift · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
PH
Phi 3 Context Obedient RAG
Phi · afrideva
Params3.82B
Context128K
Q4_K_M2.4 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
FL
flan t5 definition en xl
Flan · mradermacher
Params2.85B
Context512
Q4_K_M1.8 GB
MI
.\Mermaid\
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Mini DPO test02
Mini · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
ST
Stablelm Base Alpha 7b
Stablelm · mradermacher
Params7.87B
Context4K
Q4_K_M5.1 GB
KR
Krakowiak 7B v2
Krakowiak · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PI
Westest 7B
Piano · Aryanne
Params7.24B
Context32K
Smallest3.5 GB
PA
Paradigm Shift 7B i1
Paradigm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB