GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
takano32/tinyllama-color-coder-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
MI
diffnamehard/Mistral-CatMacaroni-slerp-uncensored-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
MaziyarPanahi/Calme-7B-Instruct-v0.9
Calme · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
rinna/llama-3-youko-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
vicgalle/Configurable-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NE
Kukedlc/Neural-4-Maths-7b
Neural · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
MarinaraSpaghetti/NemoMix-Unleashed-12B
Nemomix · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
nasiruddin15/Mistral-dolphin-2.8-grok-instract-2-7B-slerp
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Ruqiya/Fine-Tuning-Gemma-2b-it-for-Arabic
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
CO
fhai50032/RP-Coder-SM3
Coder · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingRoleplay
LL
juungwon/Llama-3-instruction-constructionsafety
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
unsloth/llama-3-8b-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
ystemsrx/Qwen2.5-Sex
Qwen · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
PO
ChaoticNeutrals/Poppy_Porpoise-v0.7-L3-8B
Poppy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BL
alnrg2arg/blockchainlabs_7B_merged_test2_4_prune
Blockchainlabs · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WE
macadeliccc/WestLake-7B-v2-laser-truthy-dpo
Westlake · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Trelis/Meta-Llama-3-8B-Instruct-function-calling
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
SO
Jsoo/solar-ko-common-merged
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
DA
Khetterman/DarkAtom-12B-v3
Darkatom · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LL
ContextualAI/archangel_sft-kto_llama13b
Llama · featherless-ai-quants
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
QW
unsloth/Qwen2.5-Coder-1.5B
Qwen · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
QW
Qwen/Qwen2-Math-1.5B-Instruct
Qwen · featherless-ai-quants
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
LL
aifeifei798/llama3-8B-DarkIdol-2.1-Uncensored-1048K
Llama · featherless-ai-quants
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
LL
ruslanmv/Meta-Llama-3.1-8B-Text-to-SQL
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
richmondsin/finetuned-gemma-2-2b-output-layer-20-4k-7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
zetasepic/Qwen2.5-72B-Instruct-abliterated
Qwen · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
AN
moondriller/anarchy-solar-10B-v1
Anarchy · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
DiscoResearch/Llama3-German-8B-32k
Llama · featherless-ai-quants
Params8.03B
Context64K
Q4_K_M4.9 GB
GGUF
WI
maldv/winter-garden-7b-beta
Winter · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen/Qwen2.5-14B
Qwen · featherless-ai-quants
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use

Keep browsing