GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
AZ
Azazelle Mocha Sample 7b ex
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
Parakeet TDT 0.6b v3
Parakeet · Serveurperso
Params627M
Context—
Q4_K_M0.4 GB
QW
FlyBrain Pollard CNSv1
Qwen · PollardWeights
Params494M
Context32K
Smallest0.3 GB
OP
Open Gpt4 8x7B v0.2 q8 0
Open · rombodawg
Params46.7B
Context32K
Smallest49.6 GB
PA
Parakeet TDT 0.6B v2
Parakeet · myflow-ai
Params618M
Context—
Smallest0.7 GB
DI
diktafon dictate hr 1
Diktafon · infomiho
Params980M
Context—
Smallest0.8 GB
ST
citrinet 1024 loom
Stt · loom-ai-org
Params141M
Context—
Smallest0.6 GB
LL
TableLLM Llama3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Mermaid Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
IndicTrans3 Gemma Beta
Gemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
TI
TigerLLM 1B It
Tigerllm · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
PA
Parakeet TDT 0.6B v3
Parakeet · kusema
Params627M
Context—
Smallest0.7 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · SandLogicTechnologies
Params1.54B
Context128K
Q4_K_M1.0 GB
MI
Dionysus Mistral M3 v5
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
FL
Fluid Speech Pro
Fluid · FluidVoice-Labs
Params627M
Context—
Smallest0.9 GB
DR
DRA DR.GRPO i1
Dra · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Qwen2.5 0.5B Instruct_Johnny_Silverhand_Merged
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
CA
Canary 1B v2
Canary · SpectrumDicta
Params980M
Context—
Smallest0.8 GB
ST
stt-1b-en_fr
Stt · idle-intelligence
Params989M
Context—
Smallest0.6 GB
DA
davidkim205 komt solar 10.7b sft v5
Davidkim · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
LL
One Shot CFT Math Llama 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
SO
DT SL SOLAR 10.7B v0.1
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
Canary-Qwen 2.5B
Qwen · epapanita
Params2.53B
Context—
Q4_K_M1.7 GB
LL
llama 3.2 uk legislation instruct 3b
Llama · EryriLabs
Params3.61B
Context128K
Q4_K_M2.2 GB
PA
Parakeet Unified EN 0.6B
Parakeet · epapanita
Params618M
Context—
Q4_K_M0.5 GB
SA
Safe O1 V 7b
Safe · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
sahayak tb gemma4 e2b
Gemma · Roopalgn
Params4.65B
Context128K
Q4_K_M3.4 GB
AZ
Azazelle Mocha SR 7b ex
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
RI
Rio 2 Ocr
Rio · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
HA
Hammer2.0 7b
Hammer · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB