GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
QW
magnifi/qwen2-rephrase-classify-multitask-v2
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
NE
netcat420/MFANNv0.14.10
Netcat · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
LL
Zardos/A.I.Kant-Test_Llama-3-8B-Instruct_v0.1.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
TI
devlocalhost/hi-tinylama
Tinylama · featherless-ai-quants
Params1.1B
Context4K
Q4_K_M0.7 GB
LL
agentlans/Llama3.1-SuperDeepFuse
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
ChrisCoffey/Qwen2-0.5B-test
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
MI
nbeerbower/Mahou-1.5-mistral-nemo-12B-lorablated
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
EV
sophosympatheia/Evathene-v1.3
Evathene · featherless-ai-quants
Params72.7B
Context128K
Q4_K_M47.4 GB
BI
LobnaSellami7/SC_16bit_merged_ready_final_finetuned_model
Bit · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
BA
maldv/badger-l3-instruct-32k
Badger · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
nayohan/llama3-8b-it-translation-general-en-ko-1sent
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
ihopper/I-SOLAR-10.7B-sft-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GE
AMindToThink/gemma-2-2b_RMU_s100_a100_layer3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
PA
NeuralNovel/Panda-7B-v0.1
Panda · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LA
lamm-mit/BioinspiredLlama-3-1-8B-128k
Lamm · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
NA
Nameless-86/pql-model-vllm
Nameless · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
nbeerbower/mistral-nemo-kartoffel-12B
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
JA
Jayant9928/tnayaj
Jayant · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ME
memevis/try11
Memevis · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Herry443/Mistral-7B-KNUT-ref
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
OpenLLM-Ro/RoMistral-7b-Instruct
Romistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
allknowingroger/Platapus-Orca-13B
Allknowingroger · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
LL
allganize/Llama-3-Alpha-Ko-8B-Evo
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SE
SeacomSrl/SeaQwen2-0.5B
Seaqwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
LL
selfcorrexp2/llama3_openmath_1m_ep1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AL
alielfilali01/L3H10M-0000
featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
AwanLLM/Awanllm-Llama-3-8B-Instruct-ORPO-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Ja-ck/KoMultiGen-General-Llama3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AL
Alphacode-AI/Alphallama3-8B
Alphallama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Sao10K/72B-Qwen2.5-Kunou-v1
Qwen · featherless-ai-quants
Params72.7B
Context128K
Q4_K_M47.4 GB