Falcon GGUF models
576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.
FA
Falcon-E-MoT
Falcon · mradermacher
Params1.72B
Context32K
Q4_K_M1.0 GB
FA
Falcon H1 1.5B Instruct
Falcon · mradermacher
Params1.55B
Context128K
Q4_K_M0.9 GB
FA
tiiuae.Falcon H1 1.5B Deep Base
Falcon · DevQuasar
Params1.56B
Context128K
Q4_K_M0.9 GB
FA
Falconsai/LightDec/model.safetensors
Falcon · Falconsai
Params160M
Context—
Smallest0.3 GB
FA
Falcon H1R 7B
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
FA
Jessi v0.4 Falcon3 7b Instruct
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon Thought 7b v0
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
ssmits Falcon2 5.5B Swedish
Falcon · RichardErkhov
Params5.47B
Context2K
Q4_K_M3.4 GB
FA
Falcon2 5.5B Polish
Falcon · mradermacher
Params5.47B
Context2K
Q4_K_M3.4 GB
FA
Falcon3 7B Instruct
Falcon · gaianet
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Models Tiiuae Falcon3 1B Instruct
Falcon · MaziyarPanahi
Params1.67B
Context8K
Smallest1.2 GB
FA
Falconh1 0.5B_pruned_model_20 06 2025
Falcon · mradermacher
Params521M
Context128K
Q4_K_M0.3 GB
FA
Falcon H1R 7B Heretic V2
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
FA
Basileak Falcon7B R4 Merged
Falcon · BlackUnicornSec
Params6.92B
Context2K
Q4_K_M4.8 GB
FA
Falcon3 1B Instruct Abliterated
Falcon · mradermacher
Params1.67B
Context8K
Q4_K_M1.1 GB
FA
Falcon H1 34B Base
Falcon · mradermacher
Params33.6B
Context256K
Q4_K_M20.3 GB
FA
Falcon 7B IMDB Merged
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon H1 7B Instruct
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
FA
Falcon H1 Tiny R 90M
Falcon · mradermacher
Params91M
Context256K
Q4_K_M0.1 GB
FA
Falcon3 10B Instruct
Falcon · EasierAI
Params10.3B
Context32K
Q4_K_M6.3 GB
FA
Falcon3 7B Instruct Abliterated
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon
Falcon · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
FA
CollectiveLM Falcon 3 7B
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon H1 34B Instruct Abliterated
Falcon · mradermacher
Params33.6B
Context256K
Q4_K_M20.3 GB
FA
tiiuae.Falcon3 Mamba 7B Base
Falcon · DevQuasar-7
Params7.27B
Context1024K
Q4_K_M4.2 GB
FA
Vilsonrodrigues Falcon 7b Instruct Sharded
Falcon · tensorblock
Params6.92B
Context2K
Smallest3.7 GB
FA
Falcon
Falcon · PrunaAI
Params11.1B
Context2K
Q4_K_M6.8 GB
FA
Tiiuae Falcon 7b
Falcon · tensorblock
Params7.22B
Context2K
Smallest3.9 GB
FA
Falcon3 7B Instruct Abliterated
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon
Falcon · RichardErkhov
Params6.92B
Context2K
Q4_K_M4.8 GB