GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
nbeerbower/llama3.1-kartoffeldes-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
OF
Abhishek107/OFD
Ofd · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
kaitchup/Mayonnaise-4in1-01
Mayonnaise · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
Edcastro/safeTinyLlama
Safetinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
bengeos/Llama-3.2-1B-Instract
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
DanieleSalva/Gemma-2-2b-it-chat-doctor
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.25_0.15_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
CA
Casual-Autopsy/L3-Umbral-Mind-RP-v3.0-8B
Casual · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
JefiRyan/Llama-3.2-1B-bnb-4bit-soulcare_no_serialization
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
MA
GalrionSoftworks/Margnum-12B-v1
Magnusintellectus · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GH
ghost-x/ghost-7b-alpha
Ghost · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
AE
ZeusLabs/L3-Aethora-15B-V2
Aethora · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top15000_codeonly
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
SF
skarnam/SFT_peft
Sft · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
nbeerbower/bophades-mistral-math-DPO-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
nvidia/Llama3-ChatQA-1.5-70B
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
DeepMount00/Llama-3.1-8b-Ita
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_1.0_1.0_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
flammenai/Mahou-1.5-mistral-nemo-12B
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
SU
BoltMonkey/SuperNeuralDreadDevil-8b
Superneuraldreaddevil · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
OpenPipe/Deductive-Reasoning-Qwen-32B
Qwen · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
arnavgrg/mistral-7b-instruct-nf4-fp16-upscaled
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
rootsec1/gemma-2B-inst-aipi
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
princeton-nlp/Llama-3-Base-8B-SFT-RRHF
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
zJuu/Qwen-Qwen1.5-1.8B-1718018525
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
TA
picAIso/TARS-8B
Tars · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
astronomer/Llama-3-70B-Special-Tokens-Adjusted
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GE
whizzzzkid/gemma_v1
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
PatronusAI/Llama-3-Patronus-Lynx-70B-Instruct
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Hachipo/qwen2.5-0.5B_PIFT-enja_manywords_1000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB