Falcon GGUF models
576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.
FA
falcon h1 mamba2 truncation poc
Falcon · ryansecuritytest-fanpierlabs
Params—
Context2K
Smallest0.0 GB
FA
falcon 7b chat SFT
Falcon · Trelis
Params1.1B
Context4K
Smallest0.7 GB
FA
Falcon3 10B Instruct BehaviorTree 15epochs BehaviorTree 15epochs
Falcon · Inventors-Hub
Params10.3B
Context32K
Q4_K_M6.3 GB
FA
Falcon3 10B Instruct BehaviorTree 7epochs BehaviorTree 7epochs
Falcon · Inventors-Hub
Params10.3B
Context32K
Q4_K_M6.3 GB
FA
Falcon3 10B Instruct BehaviorTree 1epochs BehaviorTree 1epochs
Falcon · Inventors-Hub
Params10.3B
Context32K
Q4_K_M6.3 GB
FA
Falcon3 10B Instruct BehaviorTree 3 epochs
Falcon · Inventors-Hub
Params10.3B
Context32K
Q4_K_M6.3 GB
FA
Falcon H1R 7B
Falcon · Fedir-Ilina
Params7B
Context—
Q4_K_M4.6 GB