Falcon GGUF models
576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.
FA
Falcon3 Mamba R1 v0
Falcon · tensorblock
Params7.27B
Context1024K
Smallest2.6 GB
FA
Falcon Mamba 7b
Falcon · tiiuae
Params7.27B
Context1024K
Q4_K_M4.2 GB
FA
Falcon3 10B Base 1.58bit
Falcon · nebuxcloud
Params10.3B
Context—
Smallest2.9 GB
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
FA
Falcon3 1B Instruct 1.58bit
Falcon · nebuxcloud
Params1.67B
Context—
Smallest0.7 GB
FA
Falcon 7B Recipe Generation GGUF
Falcon · joackimagno
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon
Falcon · maddes8cht
Params7.26B
Context2K
Smallest4.2 GB
FA
Falcon 11B
Falcon · Kondara
Params11.1B
Context2K
Q4_K_M6.8 GB
FA
Falcon 7B General Recipe Generation GGUF
Falcon · joackimagno
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon3 10B Base
Falcon · devisri050
Params10.3B
Context32K
Smallest11.0 GB
FA
falcon mamba 7b instruct Q8 0
Falcon · NikolayKozloff
Params7.27B
Context1024K
Smallest7.8 GB
FA
FalconSlerp 3B
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
FA
Falcon
Falcon · WellissonSousa
Params5.47B
Context2K
Q4_K_M3.4 GB
FA
Falcon3 7B Base 1.58bit
Falcon · nebuxcloud
Params7.46B
Context—
Smallest2.2 GB
FA
Falcon3 3B Instruct 1.58bit
Falcon · nebuxcloud
Params3.23B
Context—
Smallest1.2 GB
FA
Falcon Mamba 7b
Falcon · tiiuae
Params7.27B
Context1024K
Smallest8.6 GB
FA
Falcon Mamba 7b Instruct
Falcon · tiiuae
Params7.27B
Context1024K
Smallest15.1 GB
FA
Tiiuae Falcon 7b Instruct
Falcon · tensorblock
Params7.22B
Context2K
Smallest3.9 GB
FA
Tiny Random Falcon 40b
Falcon · RichardErkhov
Params9M
Context2K
Q4_K_M0.0 GB
FA
tiiuae.Falcon3 1B Instruct
Falcon · DevQuasar-6
Params1.67B
Context8K
Q4_K_M1.1 GB
FA
Falcon2 5.5B Polish
Falcon · tensorblock
Params5.47B
Context2K
Smallest2.2 GB
FA
H2Oai H2Ogpt Gm Oasst1 En 2048 Falcon 7b v2
Falcon · tensorblock
Params7.22B
Context2K
Smallest3.9 GB
FA
Falcon H1R Uae Laws Merged
Falcon · SalahALHaismawi
Params7.59B
Context256K
Smallest15.2 GB
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB
FA
OpenAssistant falcon 40b megacode2 oasst
Falcon · RichardErkhov
Params41.3B
Context2K
Q4_K_M13.3 GB
FA
Falcon3 3B RP V0.1
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
FA
Falcon
Falcon · martintomov
Params11.1B
Context2K
Smallest11.8 GB
FA
Falcon E 1.2 3B Exp dpo
Falcon · axolotl-ai-co
Params3.05B
Context32K
Smallest0.8 GB
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
FA
Falcon Mamba 7b Instruct
Falcon · tiiuae
Params7.27B
Context1024K
Smallest14.6 GB