GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
netcat420/MFANNv0.19.10
Netcat · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
MaziyarPanahi/Llama-3-8B-Instruct-v0.8
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
datek/Qwen-Qwen1.5-1.8B-1716821606
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
WI
dreamgen/WizardLM-2-7B
Wizardlm · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OF
Abhishek107/ofd1
Ofd · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
besimray/miner_id_3_56d9075c-cf98-498b-8ad6-84bc66fb6ee2_1729801842
Miner · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
migtissera/Llama-3-70B-Synthia-v3.5
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
RefalMachine/mistral_darulm_20_05_24_part1-2_32000_bpe_mean_init_03_07_24
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
grimjim/Llama-3-Instruct-demi-merge-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
T3Q-LLM/T3Q-LLM3-NC-v1.0
Llm · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen/Qwen2-Math-1.5B
Qwen · featherless-ai-quants
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
LL
anthonymeo/llama3.1-factory
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
automatedstockminingorg/merged-llama-1.5b
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
GE
williamlcn/gemmadpo5
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
priyanshi27dixit/base-tilde-sft-peft-gemma2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_KTO_40k_4_3ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
NY
tannedbum/L3-Nymeria-v2-8B
Nymeria · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
MaziyarPanahi/Llama-3-8B-Instruct-v0.10
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PL
GalrionSoftworks/Pleiades-12B-v1
Pleiades · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
tamang0000/Qwen2-0.5b-assamese-v0.2.2
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
RM
rmdhirr/Anthesis_7B
Rmdhirr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
4-alokk/llama-3-8b-English-to-Hinglish
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
gbueno86/Meta-LLama-3-Cat-A-LLama-70b
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
jinjinjinjinjinjin/hankook_llama
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
EdgerunnersArchive/Llama-3-8B-Instruct-ortho-baukit-toxic-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
DatToad/Chuluun-Qwen2.5-32B-v0.01
Qwen · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
GE
lemon-mint/gemma-2b-translation-v0.103
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
nayohan/llama3-8b-it-prometheus-ko
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
hassanepulga/Mateno-v1.5-2b-it
Mateno · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
DataPilot/Llama3-ArrowSE-8B-v0.3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing