GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
Weyaxi/CollectiveCognition-v1.1-Nebula-7B
Collectivecognition · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
nasiruddin15/Neural-grok-dolphin-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
elyza/Llama-3-ELYZA-JP-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
Locutusque/NeuralHyperion-Medium-Preview
Neuralhyperion · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
Deepnoid/deep-solar-Rev-v3.0.4
Deepnoid · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
Locutusque/Hercules-3.0-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
mergekit-community/mergekit-passthrough-lkwyfft
Mergekit · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
OG
eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v3
Ogno · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
flammenai/Mahou-1.2-llama3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
jpacifico/French-Alpaca-Llama3-8B-Instruct-v1.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
shanchen/llama3-8B-slerp-med-chinese
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
12thD/ko-Llama-3-8B-sft-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
rmihaylov/Llama-3-DARE-v2-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
hkss/hk-SOLAR-10.7B-v1.4
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
jakeboggs/MTG-Llama
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
mzbac/Llama-3-8B-grammar-correction
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IN
Jithendra-k/InterACT_mini
Interact · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
VityaVitalich/Llama3.1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
martyn/mistral-megamerge-dare-7b
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NY
Nitral-AI/Nyanade_Stunna-Maid-7B-v0.2
Nyanade · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SE
clouditera/secgpt
Secgpt · featherless-ai-quants
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
PH
Sayan01/Phi3-TL-ORCAMEL-Skew-1-0.500000
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
yuiseki/tinyllama-ja-scp-1.5T-v0.1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
xw17/TinyLlama-1.1B-Chat-v1.0_finetuned_2_def
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
fumiyau/utllm-program-exp5b-llama-fw
Llama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
KA
NilanE/karasu-translation-2
Karasu · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
DA
ResplendentAI/Datura_7B
Datura · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
chargoddard/prometheus-2-llama-3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
mylesgoose/Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
NaniDAO/Meta-Llama-3.1-8B-Instruct-ablated-v1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing