Falcon GGUF models
576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.
FA
Falcon H1 1.5B Base
Falcon · mradermacher
Params1.55B
Context128K
Q4_K_M0.9 GB
FA
Falcon H1 0.5B Instruct Heretic
Falcon · mradermacher
Params521M
Context16K
Q4_K_M0.3 GB
FA
Falcon3 1B Instruct Heretic
Falcon · mradermacher
Params1.67B
Context8K
Q4_K_M1.1 GB
FA
Falcon3 7B Instruct_mathqa
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon3 3B Instruct Heretic
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
FA
Falcon3 3B Instruct
Falcon · second-state
Params3.23B
Context32K
Q4_K_M2.0 GB
FA
Falcon3 Mamba 7B Base
Falcon · tiiuae
Params7.27B
Context1024K
Q4_K_M4.2 GB
FA
Falcon H1 Tiny Tool Calling 90M
Falcon · mradermacher
Params91M
Context256K
Q4_K_M0.1 GB
FA
FalconThink3 10B IT
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
FA
Falcon3 1B Base
Falcon · mradermacher
Params1.67B
Context4K
Q4_K_M1.1 GB
FA
Falcon3 1B Instruct
Falcon · mradermacher
Params1.67B
Context8K
Q4_K_M1.1 GB
FA
Falcon H1 7B Base
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
FA
LosslessMegaCoder Falcon 40b Mini
Falcon · RichardErkhov
Params41.3B
Context2K
Q4_K_M25.2 GB
FA
Falcon3 7B Instruct
Falcon · second-state
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon 7b
Falcon · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
FA
FalconSlerp6 7B
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
WizardLM Uncensored Falcon 40b
Falcon · mradermacher
Params41.8B
Context2K
Q4_K_M25.5 GB
FA
Samantha Falcon 7b
Falcon · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
FA
Falcon 40b
Falcon · RichardErkhov
Params41.8B
Context2K
Q4_K_M25.5 GB
FA
tiiuae.Falcon H1 3B Instruct
Falcon · DevQuasar
Params3.15B
Context128K
Q4_K_M1.9 GB
FA
H2Ogpt Gm Oasst1 En 2048 Falcon 7b v3
Falcon · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
FA
Falcon H1 0.5B Base
Falcon · mradermacher
Params521M
Context16K
Q4_K_M0.3 GB
FA
Falcon
Falcon · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
FA
Falcon H1 Tiny 90M Instruct
Falcon · mradermacher
Params91M
Context256K
Q4_K_M0.1 GB
FA
Falcon H1 Tiny Coder 90M
Falcon · mradermacher
Params91M
Context256K
Q4_K_M0.1 GB
FA
WizardLM Uncensored Falcon 7b
Falcon · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
FA
Falcon openR1 Merged
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon 7b Sharded
Falcon · RichardErkhov
Params6.92B
Context2K
Q4_K_M4.8 GB
FA
Falcon3 Mamba 7B Instruct
Falcon · EasierAI
Params7.27B
Context1024K
Q4_K_M4.2 GB
FA
Falcon H1R 7B
Falcon · prithivMLmods
Params7.59B
Context256K
Q4_K_M4.6 GB