GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
SO
saishf/SOVL-Mega-Mash-V2-L3-8B
Sovl · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GU
erax-ai/Guardian-V0.1-13Oct2024-epoch2.0
Guardian · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SO
saishf/SOVLish-Devil-8B-L3
Sovlish · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
denxxs/soil-gemini
Soil · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
qzhang-2024/Llama-3.2-1B-pre-trained
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
scb10x/llama-3-typhoon-v1.5-8b-instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
JCHAVEROT/Qwen2-0.5B-Chat_SFT_LoRA
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_educational_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
Edgerunners/meta-llama-3-8b-instruct-hf-ortho-baukit-10fail-1000total
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
BCCard/Llama-3.1-Kor-BCCard-Finance-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Locutusque/Hercules-6.1-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
CarrotAI/Llama-3.2-Rabbit-Ko-1B-Instruct
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
RE
priyanshi27dixit/RESTA_sft_dare_full_ft
Resta · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Utsav03/gemma-2-full-dare-peft
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
NickyNicky/gemma-2b-it_oasst2_chatML_Cluster_1_V1
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
YOYO-AI/ZYH-LLM-Qwen2.5-14B
Qwen · featherless-ai-quants
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
QW
Qwen/Qwen2.5-Math-7B
Qwen · featherless-ai-quants
Params7.62B
Context4K
Q4_K_M4.7 GB
Tool use
QW
unsloth/Qwen2.5-Math-7B
Qwen · featherless-ai-quants
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
GE
chamibuddhika/Gemma-2-2b-it-chat-doctor
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
EV
VitalContribution/Evangelion-7B
Evangelion · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
bababababooey/llama-3-8b-instruct-toxic
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
princeton-nlp/Llama-3-Instruct-8B-SLiC-HF-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TA
tau-vision/sn6-finetune
Tau · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Vision
LL
DeividasM/AQ1-Finance-Llama3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HI
HiroseKoichi/L3-8B-Lunar-Stheno
Hirosekoichi · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
HeshamHaroon/llama-3-instruct-slerp-arabic
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
WebraftAI/synapsellm-7b-mistral-v0.4-preview3
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TO
ClaudioItaly/TopEvolutionWiz
Topevolutionwiz · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
pinkyponky/SOLAR-10.7B-dpo-instruct-tuned-v0.1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CH
jeiku/Chaos_RP_l3_8B
Chaos · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay

Keep browsing