GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
DeepMount00/Llama-3-COT-ITA
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ribhu/llama13b-32k-illumeet-finetune
Llama · featherless-ai-quants
Params13B
Context32K
Q4_K_M7.9 GB
GGUF
LL
HanningZhang/Llama3-sft-more-corr-rr60k-3ep
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Hachipo/Qwen2.5-Coder-0.5B-Instruct_MIFT-ja_manywords_4000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
LL
Edgerunners/Llama-3-8B-Instruct-ortho-baukit-toxic-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
rombodawg/Rombos-Coder-V2.5-Qwen-32b
Qwen · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingTool use
MI
MaziyarPanahi/Mistral-7B-Instruct-v0.2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
dim/tiny-llama-2T-open-orca-ru-6300-step
Llama · featherless-ai-quants
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
GE
jeiku/GemmaDolly_2B
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
OG
eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO
Ogno · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UN
Undi95/Unholy-v2-13B
Unholy · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DA
Dans-Archive/Dans-MysteryModel-13b
Dans · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
collaiborateorg/Collaiborator-MEDLLM-Llama-3-8B-v1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MN
bunnycore/Mnemosyne-7B
Mnemosyne · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
hamxea/Mistral-7B-v0.1-activity-fine-tuned-v3
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
lemon-mint/gemma-2b-translation-v0.120
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
aipib/llama3_2-1B-instruct-sft-merged
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
TE
alnrg2arg/test_wanda_240109
Test · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SI
jambroz/sixtyoneeighty-7b
Sixtyoneeighty · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
AMindToThink/gemma-2-2b_RMU_s100_a300_layer3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Rupesh2/Llama-3.1-8b-Uncensored-Dare
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
PJMixers-Archive/LLaMa-3-CursedStock-v1.6-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
Sayan01/Phi3-TL-ORCAMEL-20
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PE
Abhishek107/Performancelog
Performancelog · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
realPCH/240103_llama_test_2
Llama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Cartinoe5930/Qwen-Prometheus-1.8B
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
LL
gradientai/Llama-3-8B-Instruct-Gradient-1048k
Llama · featherless-ai-quants
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
PO
Nitral-AI/Poppy_Porpoise-1.0-L3-8B
Poppy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
lalagi2/gemma-2-2b-it_finetuned
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LY
Sao10K/MN-12B-Lyra-v2a1
Lyra · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing