Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
Falcon-E-MoT
Falcon · mradermacher
Params1.72B
Context32K
Q4_K_M1.0 GB
GGUF
FA
Falcon H1 1.5B Instruct
Falcon · mradermacher
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use
FA
tiiuae.Falcon H1 1.5B Deep Base
Falcon · DevQuasar
Params1.56B
Context128K
Q4_K_M0.9 GB
GGUF
FA
Falconsai/LightDec/model.safetensors
Falcon · Falconsai
Params160M
Context—
Smallest0.3 GB
GGUF
FA
Falcon H1R 7B
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
ReasoningTool use
FA
Jessi v0.4 Falcon3 7b Instruct
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon Thought 7b v0
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
ssmits Falcon2 5.5B Swedish
Falcon · RichardErkhov
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon2 5.5B Polish
Falcon · mradermacher
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon3 7B Instruct
Falcon · gaianet
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Models Tiiuae Falcon3 1B Instruct
Falcon · MaziyarPanahi
Params1.67B
Context8K
Smallest1.2 GB
GGUF
FA
Falconh1 0.5B_pruned_model_20 06 2025
Falcon · mradermacher
Params521M
Context128K
Q4_K_M0.3 GB
Tool use
FA
Falcon H1R 7B Heretic V2
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
ReasoningTool use
FA
Basileak Falcon7B R4 Merged
Falcon · BlackUnicornSec
Params6.92B
Context2K
Q4_K_M4.8 GB
GGUF
FA
Falcon3 1B Instruct Abliterated
Falcon · mradermacher
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
FA
Falcon H1 34B Base
Falcon · mradermacher
Params33.6B
Context256K
Q4_K_M20.3 GB
GGUF
FA
Falcon 7B IMDB Merged
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon H1 7B Instruct
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
Tool use
FA
Falcon H1 Tiny R 90M
Falcon · mradermacher
Params91M
Context256K
Q4_K_M0.1 GB
Tool use
FA
Falcon3 10B Instruct
Falcon · EasierAI
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Falcon3 7B Instruct Abliterated
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon
Falcon · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
FA
CollectiveLM Falcon 3 7B
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
Falcon H1 34B Instruct Abliterated
Falcon · mradermacher
Params33.6B
Context256K
Q4_K_M20.3 GB
Tool use
FA
tiiuae.Falcon3 Mamba 7B Base
Falcon · DevQuasar-7
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
FA
Vilsonrodrigues Falcon 7b Instruct Sharded
Falcon · tensorblock
Params6.92B
Context2K
Smallest3.7 GB
GGUF
FA
Falcon
Falcon · PrunaAI
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
FA
Tiiuae Falcon 7b
Falcon · tensorblock
Params7.22B
Context2K
Smallest3.9 GB
GGUF
FA
Falcon3 7B Instruct Abliterated
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon
Falcon · RichardErkhov
Params6.92B
Context2K
Q4_K_M4.8 GB
GGUF

Keep browsing