GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
JI
Jina Reranker v2 Base Multilingual
Jina · gpustack
Params278M
Context1K
Q4_K_M0.2 GB
OP
OpenJev Flash 9B
Openjev · openjev
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama-3-Lumimaid-8B-v0.1-OAS
Llama · Lewdiculous
Params8B
Context8K
Q4_K_M4.9 GB
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
EX
Extended-Mega-Mash-262K-8B-L3
Extended · mradermacher
Params8B
Context256K
Q4_K_M4.9 GB
OC
octo net
Octo · NexaAI
Params3.82B
Context128K
Q4_K_M2.4 GB
XL
xLAM 8x7b R
Xlam · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
OX
OxytocinErosEngineeringF1 7B slerp
Oxytocinerosengineeringf · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
AU
Aura-Uncensored-OAS-8B-L3
Aura · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama3 Aloe 8B Alpha
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MI
Mistral-11B-SynthIAirOmniMix
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
DA
DaringMaid 13B
Daringmaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AY
Aya Expanse 32b
Aya · bartowski
Params32.3B
Context8K
Q4_K_M19.8 GB
MI
chargoddard_mixtralrpchat-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
OP
OpenMia Indo Engineering 7b i1
Openmia · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · bartowski
Params8B
Context4192K
Q4_K_M4.9 GB
ST
L3-8B-Stheno-v3.1
Stheno · Lewdiculous
Params8B
Context8K
Q4_K_M4.9 GB
LL
LLaMA2 13B Estopia
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
WI
winter garden 7b beta
Winter · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
CO
c4ai-command-r-plus
Command R · pmysl
Params104B
Context128K
Q4_K_M62.8 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
KI
KittyNyanster v1
Kittynyanster · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
HO
Holo4 27B Abliterix
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
OU
Oumuamua-7b-RP
Oumuamua · mradermacher
Params7.33B
Context32K
Q4_K_M4.4 GB
DE
Vigyan 1.5B 4x MoE
DeepSeek · shreyansh12183
Params6.4B
Context128K
Q4_K_M3.9 GB
PI
maywell_pivot-0.1-starling-lm-rp
Pivot · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
RE
reader lm 0.5b IMat
Reader · legraphista
Params494M
Context250K
Smallest0.3 GB
MI
Mixtral_7Bx4_MOE_24B
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
AI
airoboros-65b-gpt4-m2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
GE
shamrock 0 e4b
Gemma · oxalis-ink
Params7.46B
Context128K
Q4_K_M5.3 GB