GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
theo77186/Llama-3-8B-Instruct-norefusal
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
vihangd/neuralplats-1.1b-2T-v1
Neuralplats · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
NousResearch/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TI
sandeep1401/tinyllama_finetuned
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
BA
jondurbin/bagel-7b-v0.1
Bagel · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Corianas/Neural-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YU
gordicaleksa/YugoGPT
Yugogpt · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KU
grimjim/kunoichi-lemon-royale-v2-32K-7B
Kunoichi · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
Alphacode-AI/AlphaMist7B-slr-v4-slow
Alphamist · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
OwenArli/ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
upstage/SOLAR-10.7B-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Undi95/Meta-Llama-3-8B-hf
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
flammenai/Mahou-1.1-llama3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
mistral-community/Mistral-7B-v0.2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Nhoodie/Meta-Llama-3-8b-Lexi-Uninstruct-function-calling-json-mode-Task-Arithmetic-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
PH
Sayan01/Phi3-TL-ORCAMEL-1
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
shleeeee/mistral-ko-7b-wiki-neft
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
liangshuxin/qwen05b_ourmodel
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
GE
somosnlp/gemma-FULL-RAC-Colombia
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
DO
vihangd/DopeyTinyLlama-1.1B-v1
Dopeytinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
lordjia/Llama-3-Cantonese-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TI
tmd-rahul/tinyllama-chatbot-merged-v2
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
Locutusque/Hercules-2.0-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
mlabonne/NeuralDarewin-7B
Neuraldarewin · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
DeepMount00/Llama-3-8b-Ita
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MH
h2m/mhm-7b-v1.3-DPO-1
Mhm · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GN
Novaciano/Gnome-1.1b
Gnome · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
empower-dev/llama3-empower-functions-small-v1.1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Weni/ZeroShot-Agents-Llama3-4.0.11-SFT-merged
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
megastudyedu/M-SOLAR-10.7B-v1.4
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF

Keep browsing