Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
Falcon 7b
Falcon · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon3-10B-Instruct-1.58bit
Falcon · tiiuae
Params10.3B
Context32K
Smallest4.0 GB
Tool use
FA
Falcon3 1B MentalHealth
Falcon · mradermacher
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
FA
Falcon Mamba Tiny Dev
Falcon · RichardErkhov
Params9M
Context1024K
Q4_K_M0.0 GB
GGUF
FA
Falcon3-1B-Instruct-1.58bit
Falcon · tiiuae
Params1.67B
Context8K
Smallest1.4 GB
Tool use
FA
Falcon H1 0.5B Instruct
Falcon · mradermacher
Params521M
Context16K
Q4_K_M0.3 GB
Tool use
FA
Falcon3 10B Instruct
Falcon · second-state
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Falcon3 10B Instruct Abliterated
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Falcon3 7B Instruct_openbookqa
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon 7b Instruct
Falcon · RichardErkhov
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon H1 Tiny Multilingual 100M Instruct Abliterated
Falcon · mradermacher
Params141M
Context256K
Q4_K_M0.1 GB
Tool use
FA
Falcon 40b
Falcon · mradermacher
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
FA
Nexa_Sci_distilled_Falcon 10B
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
FA
Falcon H1R 7B Heretic
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
ReasoningTool use
FA
Falcon3-7B-Instruct-1.58bit
Falcon · tiiuae
Params7.46B
Context32K
Smallest3.3 GB
Tool use
FA
Falcon3 Mamba 7B Base
Falcon · mradermacher
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
FA
Falcon H1 3B Instruct
Falcon · mradermacher
Params3.15B
Context128K
Q4_K_M1.9 GB
Tool use
FA
Falcon H1 Tiny R 0.6B
Falcon · mradermacher
Params622M
Context256K
Q4_K_M0.4 GB
Tool use
FA
Falcon3 7B Instruct
Falcon · lmstudio-community
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon 7b
Falcon · RichardErkhov
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
tiiuae.Falcon3 10B Instruct
Falcon · DevQuasar-6
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
tiiuae.Falcon3 7B Instruct
Falcon · DevQuasar-6
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
Falcon3 3B Instruct MLX
Falcon · RichardErkhov
Params3.23B
Context32K
Q4_K_M2.0 GB
Tool use
FA
Falcon H1 3B Base
Falcon · mradermacher
Params3.15B
Context128K
Q4_K_M1.9 GB
GGUF
FA
Falcon3 3B Instruct Abliterated
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
Tool use
FA
Falcon3 7B Instruct MLX
Falcon · RichardErkhov
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon3 1B Instruct MLX
Falcon · RichardErkhov
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
FA
ssmits Falcon2 5.5B Portuguese
Falcon · RichardErkhov
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF

Keep browsing