GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
QW
e-palmisano/Qwen2-1.5B-ITA-Instruct
Qwen · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
MI
maywell/PiVoT-10.7B-Mistral-v0.2-RP
Mistral · featherless-ai-quants
Params10.7B
Context32K
Q4_K_M6.5 GB
TA
benchang1110/Taiwan-tinyllama-v1.1-base
Taiwan · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Muadil/Llama-3.2-1B-Instruct_sum_KTO_80k_2_1ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
MI
uukuguy/speechless-thoughts-mistral-7b-v1.0
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Hachipo/Qwen2.5-0.5B_MIFT-en_250
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
lighteternal/Llama-3-8B-Instruct-MergeSLERP-Gradient1048k-OpenBioLLM
Llama · featherless-ai-quants
Params8.03B
Context1024K
Q4_K_M4.9 GB
LL
hfl/llama-3-chinese-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
anthracite-org/magnum-v1-32b
Magnum · featherless-ai-quants
Params32.5B
Context32K
Q4_K_M19.7 GB
NO
davidkim205/nox-solar-10.7b-v4
Nox · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GE
Nisk36/DPO_gemma_normalchosen
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
SO
ArianAskari/SOLID-SFT-DPO-MixQV2-SOLIDRejected-SFTChosen-Zephyr-7b-beta
Solid · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
JO
johnn3101/sn6-arixc-1
Johnn · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
MA
MaziyarPanahi/Experiment26Yamshadow_Ognoexperiment27Multi_verse_model
Maziyarpanahi · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
nem012/gemma2b-1e-3
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
QW
NaoS2/qwen2.5-0.5B_mask_uni5_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
ZE
vicgalle/zephyr-7b-truthy
Zephyr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
SongTonyLi/Llama-3.2-1B-Instruct-SFT-D_chosen-HuggingFaceH4-ultrafeedback_binarized-Xlarge
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
SE
SeaLLMs/SeaLLMs-v3-1.5B-Chat
Seallms · featherless-ai-quants
Params1.54B
Context128K
Q4_K_M1.0 GB
CO
williamlcn/6851_64_16_0318_combined
Combined · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
HanningZhang/Llama3-sft-less-corr-rr60k-3ep
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
grimjim/Llama-3-Instruct-8B-SPPO-Iter3-SimPO-merge
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ced-dpz/llama-31-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Locutusque/Apollo-0.4-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
SongTonyLi/Llama-3.2-1B-Instruct-SFT-D_chosen-pref-mix3
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
unsloth/gemma-2b
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
DeepAuto-AI/ldm_soup_Llama-3.1-8B-Inst
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
SO
er1123090/T3Q_SOLAR_SLERP_v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
rfrancu/LLMTwin-Llama-3.1-8B-instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB