Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
gpt4all falcon
Falcon · tensorblock
Params7.22B
Context2K
Smallest3.9 GB
GGUF
FA
tiiuae.Falcon H1 1.5B Deep Instruct
Falcon · DevQuasar
Params1.56B
Context128K
Q4_K_M0.9 GB
GGUF
FA
Falcon3 MoE 2x7B Insruct
Falcon · mradermacher
Params13.4B
Context32K
Q4_K_M8.2 GB
Tool use
FA
FalconMind3b
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
Tool use
FA
falcon 3 3.2b instruct
Falcon · lm-kit
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
FA
Falcon3 Mamba R1 v0
Falcon · mradermacher
Params7.27B
Context1024K
Q4_K_M4.2 GB
Reasoning
FA
Samantha Falcon 7b
Falcon · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
falcon 3 7.6b instruct
Falcon · lm-kit
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon3 3B Instruct
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon3 10B Instruct Abliterated
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
tiiuae.Falcon3 7B Base
Falcon · DevQuasar-6
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
tiiuae_Falcon3 10B Instruct
Falcon · smarttasks
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Falcon H1 7B Instruct
Falcon · s3dev-ai
Params7.59B
Context256K
Q4_K_M4.6 GB
Tool use
FA
Falcon Mamba 7b Instruct
Falcon · tiiuae
Params7.27B
Context1024K
Smallest8.6 GB
GGUF
FA
tiiuae.Falcon3 3B Base
Falcon · DevQuasar-6
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params41.9B
Context2K
Smallest23.9 GB
GGUF
FA
Falcon-3B-8k-data-new-classes
Falcon · DevQuasar-7
Params3.23B
Context32K
Q4_K_M2.0 GB
Tool use
FA
Falcon 7b
Falcon · tensorblock
Params7.22B
Context2K
Smallest3.9 GB
GGUF
FA
Falconsai/LightDec_V2/model.safetensors
Falcon · Falconsai
Params160M
Context—
Smallest0.3 GB
GGUF
FA
Falcon H1 1.5B Base
Falcon · mradermacher
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
FA
Falcon
Falcon · CharlieJi
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon3-3B-Instruct-1.58bit
Falcon · tiiuae
Params3.23B
Context4K
Smallest2.2 GB
Tool use
FA
Text_Summarization
Falcon · mradermacher
Params61M
Context512
Q4_K_M0.0 GB
GGUF
FA
ssmits Falcon2 5.5B German
Falcon · RichardErkhov
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB
GGUF
FA
tiiuae.Falcon3 1B Base
Falcon · DevQuasar-7
Params1.67B
Context4K
Q4_K_M1.1 GB
GGUF
FA
FalconSlerp5 7B
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon H1 Tiny 90M Instruct Safe
Falcon · mradermacher
Params91M
Context256K
Q4_K_M0.1 GB
Tool use

Keep browsing