GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
jl123/llama-3-8b-qlora-finetune
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
RE
almugabo/refprocess-tl-v0.1
Refprocess · featherless-ai-quants
Params1.1B
Context8K
Q4_K_M0.7 GB
MI
Loyola/Mistral-7b-ITmodel
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LY
GalrionSoftworks/Lyralin-12B-v1
Lyralin · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-5_1.0_0.25_0.5_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Gydoo/insane-llama3.1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
SO
bhavinjawade/SOLAR-10B-OrcaDPO-Jawade
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
maywell/Qwen2-7B-Multilingual-RP
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
UL
Eric111/UltraCatunaMayo-DPO
Ultracatunamayo · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
nayohan/llama3-8b-it-general-trc313k-enko-8k
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
MaziyarPanahi/calme-2.8-qwen2-7b
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
MC
williamlcn/6851_mcq_64_16_fixed_ab
Mcq · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gsoloupis/gemma2_2B_it_greek_full_32
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Gunulhona/Llama-Merge-Small
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
komi77/qwen2.5-0.5B_ed_gauss_linear_30-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top_2000_pythonblock_ja_en
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
AL
alielfilali01/Q2AW1M-0100
featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
ArliAI/Llama-3.1-8B-ArliAI-Indo-Formax-v1.0
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Esperanto/Protein-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
XE
xellDart13/extractor_normal
Xelldart · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ElMater06/Llama-3.2-1B-Puredove-p
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
NE
M4-ai/NeuralReyna-Mini-1.8B-v0.2
Neuralreyna · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
QW
OpenBuddy/openbuddy-qwen1.5-32b-v21.1-32k
Qwen · featherless-ai-quants
Params32.5B
Context32K
Q4_K_M19.7 GB
MI
YorkieOH10/MistralHermesPipe-7B-slerp
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
awnr/Mistral-7B-v0.1-signtensors-1-over-4
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
maxxi146/LLaMa_FactoryV5
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
NE
netcat420/MFANNv0.20.10
Netcat · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Saurabh15/gemma-Code-Instruct-Finetune-test
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
SP
cstr/Spaetzle-v60-7b
Spaetzle · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
AMindToThink/gemma-2-2b_RMU_s200_a100_layer7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB