Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
Falcon3 Mamba R1 v0
Falcon · tensorblock
Params7.27B
Context1024K
Smallest2.6 GB
Reasoning
FA
Falcon Mamba 7b
Falcon · tiiuae
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
FA
Falcon3 10B Base 1.58bit
Falcon · nebuxcloud
Params10.3B
Context—
Smallest2.9 GB
GGUF
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon3 1B Instruct 1.58bit
Falcon · nebuxcloud
Params1.67B
Context—
Smallest0.7 GB
GGUF
FA
Falcon 7B Recipe Generation GGUF
Falcon · joackimagno
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.26B
Context2K
Smallest4.2 GB
GGUF
FA
Falcon 11B
Falcon · Kondara
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
FA
Falcon 7B General Recipe Generation GGUF
Falcon · joackimagno
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
Falcon3 10B Base
Falcon · devisri050
Params10.3B
Context32K
Smallest11.0 GB
GGUF
FA
falcon mamba 7b instruct Q8 0
Falcon · NikolayKozloff
Params7.27B
Context1024K
Smallest7.8 GB
GGUF
FA
FalconSlerp 3B
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
FA
Falcon
Falcon · WellissonSousa
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon3 7B Base 1.58bit
Falcon · nebuxcloud
Params7.46B
Context—
Smallest2.2 GB
GGUF
FA
Falcon3 3B Instruct 1.58bit
Falcon · nebuxcloud
Params3.23B
Context—
Smallest1.2 GB
GGUF
FA
Falcon Mamba 7b
Falcon · tiiuae
Params7.27B
Context1024K
Smallest8.6 GB
GGUF
FA
Falcon Mamba 7b Instruct
Falcon · tiiuae
Params7.27B
Context1024K
Smallest15.1 GB
GGUF
FA
Tiiuae Falcon 7b Instruct
Falcon · tensorblock
Params7.22B
Context2K
Smallest3.9 GB
GGUF
FA
Tiny Random Falcon 40b
Falcon · RichardErkhov
Params9M
Context2K
Q4_K_M0.0 GB
GGUF
FA
tiiuae.Falcon3 1B Instruct
Falcon · DevQuasar-6
Params1.67B
Context8K
Q4_K_M1.1 GB
GGUF
FA
Falcon2 5.5B Polish
Falcon · tensorblock
Params5.47B
Context2K
Smallest2.2 GB
GGUF
FA
H2Oai H2Ogpt Gm Oasst1 En 2048 Falcon 7b v2
Falcon · tensorblock
Params7.22B
Context2K
Smallest3.9 GB
GGUF
FA
Falcon H1R Uae Laws Merged
Falcon · SalahALHaismawi
Params7.59B
Context256K
Smallest15.2 GB
ReasoningTool use
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB
GGUF
FA
OpenAssistant falcon 40b megacode2 oasst
Falcon · RichardErkhov
Params41.3B
Context2K
Q4_K_M13.3 GB
GGUF
FA
Falcon3 3B RP V0.1
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
RoleplayTool use
FA
Falcon
Falcon · martintomov
Params11.1B
Context2K
Smallest11.8 GB
GGUF
FA
Falcon E 1.2 3B Exp dpo
Falcon · axolotl-ai-co
Params3.05B
Context32K
Smallest0.8 GB
ReasoningTool use
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon Mamba 7b Instruct
Falcon · tiiuae
Params7.27B
Context1024K
Smallest14.6 GB
GGUF

Keep browsing