Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
Falcon H1 1.5B Instruct
Falcon · mradermacher
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use
FA
Falcon3 10B Base
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
FA
CollectiveLM Falcon 3 7B i1
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
ssmits Falcon2 5.5B Polish
Falcon · RichardErkhov
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon3 3B Instruct
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
FA
Falcon
Falcon · DevQuasar
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
FA
FalconEye
Falcon · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool use
FA
Falcon H1 0.5B Instruct Heretic
Falcon · mradermacher
Params521M
Context16K
Q4_K_M0.3 GB
Tool use
FA
Falcon3 Mamba 7B Instruct
Falcon · tiiuae
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
FA
Falcon3 7B Instruct Heretic
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon H1 1.5B Deep Base
Falcon · mradermacher
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
FA
Falcon H1 Tiny Multilingual 100M Instruct
Falcon · Luigi
Params108M
Context256K
Smallest0.1 GB
Tool use
FA
Falcon3 3B Instruct Heretic
Falcon · ChiKoi7
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
FA
1b-instruct
Falcon · tiiuae
Params1.72B
Context32K
Smallest0.7 GB
GGUF
FA
Falcon3 10B Instruct
Falcon · lmstudio-community
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Falcon3 1B Instruct Heretic
Falcon · mradermacher
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
FA
falcon 7b german assistant v2
Falcon · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon H1 Tiny Multilingual 100M Base
Falcon · mradermacher
Params108M
Context256K
Q4_K_M0.1 GB
GGUF
FA
Falcon
Falcon · RichardErkhov
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
gguf falcon mamba 7b instruct
Falcon · Felladrin
Params7.27B
Context1024K
Smallest2.8 GB
GGUF
FA
tiiuae falcon mamba 7b instruct
Falcon · RichardErkhov
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
FA
Falcon
Falcon · xaviviro
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon H1 Tiny R 90M
Falcon · tiiuae
Params108M
Context256K
Q4_K_M0.1 GB
Tool use
FA
tiiuae.Falcon H1 7B Instruct
Falcon · DevQuasar
Params7.59B
Context256K
Q4_K_M4.6 GB
Tool use
FA
Falcon 7b Instruct
Falcon · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
tiiuae.Falcon H1 0.5B Base
Falcon · DevQuasar
Params522M
Context16K
Q4_K_M0.3 GB
GGUF
FA
Falcon3 Mamba 7B Instruct
Falcon · mradermacher
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
FA
ssmits Falcon2 5.5B Dutch
Falcon · RichardErkhov
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon3 7B Instruct Heretic v2
Falcon · ChiKoi7
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF

Keep browsing