GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
RO
RoboReward 4B
Roboreward · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
AF
AfriqueQwen3.5 4B Instruct v1
Afriqueqwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
EV
Everyone Coder 4x7b Base
Everyone · RichardErkhov
Params28B
Context32K
Q4_K_M14.6 GB
TI
TigerLLM 9B It
Tigerllm · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
JA
Jachnun
Jachnun · Hebrish
Params618M
Context—
Q4_K_M0.5 GB
FE
FenggeLLM 32B
Fenggellm · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
SO
DT EQ SOLAR 10.7B v0.1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
AF
AfriqueQwen 4B
Afriqueqwen · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
NE
OpenReasoning Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
UniSS
Qwen · tinyopsec
Params1.86B
Context32K
Q4_K_M1.2 GB
BG
bge m3
BGE · doof-ferb
Params567M
Context8K
Q4_K_M0.4 GB
UN
Underdog Bark 3.0 Clean
Underdog · joshthomasdev
Params627M
Context—
Smallest0.7 GB
LL
Llama3 1B Base i1
Llama · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
MI
OGSQL Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
GEITje 7b Ultra Heretic
Geitje · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PY
Pythia 160m C2S
Pythia · mradermacher
Params162M
Context9K
Q4_K_M0.1 GB
NE
OpenMath Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ME
TroyDoesAI/Mermaid_PythonCoder
Mermaid · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
HE
Weyaxi/HelpSteer-filtered-7B
Helpsteer · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
OM
NeuralOmniBeagle 7B
Omnibeagle · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
OpenMath Nemotron 7B
Nemotron · DevQuasar-13
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Llama Nv Embed Reasoning 3b
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
PA
Parakeet Ultra
Parakeet · tryambientai
Params627M
Context—
Smallest0.7 GB
KU
kukulemon 7B GGUF IQ Imatrix
Kukulemon · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
Open Maid Samantha Hermes Orca dare tiesv0.1
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AF
AfriqueQwen 14B
Afriqueqwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
SA
Safiron
Safiron · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
GE
gemma3 270m it Cuperal
Gemma · cuperalAI
Params268M
Context32K
Q4_K_M0.3 GB
QW
Qwen2.5 7B blog key points
Qwen · ncls-p
Params7.62B
Context32K
Q4_K_M4.7 GB
PR
ProgressGym HistLlama3 8B C021 Instruct v0.2
Progressgym · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB