GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
ST
Gille/StrangeMerges_52-7B-dare_ties
Strangemerges · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
jebish7/GEMMA-2B-B90
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
ME
ProbeMedicalYonseiMAILab/medllama3-v20
Medllama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
princeton-nlp/Llama-3-Instruct-8B-CPO-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Trelis/Llama-3.2-1B-Instruct-touch-rugby-synth-1epochs
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
bunnycore/Blackbird-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QR
OPI-PG/Qra-13b
Qra · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
TI
Alestin/tinyllama-outline-generator
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
UM
v000000/L3-Umbral-Storm-8B-t0.0001
Umbral · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
EI
TitleOS/EinsteinBagel-8B
Einsteinbagel · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
PO
saucam/PowerBot-8B
Powerbot · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_selec1000_pythonblock_en_ja
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s100_a1200_layer3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
grimjim/llama-3-Nephilim-v1-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
UN
proto-llm/uniwiz-7B-v0.1
Uniwiz · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
HanningZhang/Llama3-sft-gsm8k-c2c50K-w2c48K-c241K-2ep
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
T3Q-LLM/T3Q-LLM2-MK-v1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s200_a100_layer7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_all_add_pythonblock_2
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
DE
lex-hue/Delexa-7b
Delexa · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SP
spow12/ChatWaifu_v1.3.1
Spow · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Locutusque/NeuralHyperion-2.0-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
HA
haihp02/0cd02bd8-61ff-4068-8a3b-fc6f022bf94c
Haihp · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
calliehsu/tiny-llama-shuttle-xpc-cube-en2000
Llama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
ytcheng/llama-3-8b-hf-sm-lora-merged
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen/Qwen2.5-Math-1.5B
Qwen · featherless-ai-quants
Params1.54B
Context4K
Q4_K_M1.0 GB
LL
Trelis/Llama-3.2-1B-Instruct-MATH-augmented-synthetic
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.75_0.75_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Seanxh/Qwen-Qwen1.5-1.8B-1719286596
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
LL
rmihaylov/Llama-3-DARE-v1-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB