Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
proof v3
Falcon · Falconsai
Params160M
Context—
Smallest0.3 GB
GGUF
FA
Falcon H1R 7B
Falcon · lm-kit
Params7.59B
Context256K
Q4_K_M4.6 GB
ReasoningTool use
FA
FalconSlerp1 7B
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
tiiuae.Falcon3 3B Instruct
Falcon · DevQuasar-6
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon3 10B Instruct 1.58bit
Falcon · nebuxcloud
Params10.3B
Context—
Smallest2.9 GB
GGUF
FA
tiiuae.Falcon H1 3B Base
Falcon · DevQuasar
Params3.15B
Context128K
Q4_K_M1.9 GB
GGUF
FA
FalconSlerp3 7B
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
gguf sharded falcon mamba 7b instruct
Falcon · Felladrin
Params7.27B
Context1024K
Smallest3.2 GB
GGUF
FA
tiiuae.Falcon H1 0.5B Instruct
Falcon · DevQuasar
Params522M
Context128K
Q4_K_M0.3 GB
GGUF
FA
Falcon3-10B-Instruct-1.58bit
Falcon · alfonsogarciacaro
Params10.3B
Context32K
Smallest4.0 GB
Tool use
FA
Falcon H1 Tiny Multilingual 100M Instruct kaken cpt
Falcon · awakara
Params141M
Context256K
Q4_K_M0.1 GB
Tool use
FA
tiiuae.Falcon H1 7B Base
Falcon · DevQuasar
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
FA
Falcon3 3B Base 1.58bit
Falcon · nebuxcloud
Params3.23B
Context—
Smallest1.2 GB
GGUF
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
UltraScopeNet
Falcon · Falconsai
Params—
Context—
Smallest0.0 GB
GGUF
FA
falcon 7b
Falcon · NikolayKozloff
Params7.22B
Context—
Smallest4.1 GB
GGUF
FA
tiiuae.Falcon3 10B Base
Falcon · DevQuasar-6
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
FA
tiiuae.Falcon H1 1.5B Base
Falcon · DevQuasar
Params1.56B
Context128K
Q4_K_M0.9 GB
GGUF
FA
Jiqing Tiny_Random_Falcon
Falcon · tensorblock
Params4M
Context2K
Smallest0.0 GB
GGUF
FA
Falcon-3B-8k-data-new-classes
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
Tool use
FA
OpenLLM France Claire 7B 0.1
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon H1 Tiny R 0.6B
Falcon · Felladrin
Params622M
Context256K
Smallest0.4 GB
Tool use
FA
Falcon3 8B Franken Basestruct
Falcon · mradermacher
Params8.41B
Context32K
Q4_K_M5.1 GB
Tool use
FA
Falcon 7b Instruct
Falcon · Kondara
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon3 7B Instruct 1.58bit
Falcon · nebuxcloud
Params7.46B
Context—
Smallest2.2 GB
GGUF
FA
Falcon3Slerp1 10B
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
FA
Falcon 180B Chat
Falcon · mradermacher
Params180B
Context2K
Smallest38.3 GB
GGUF
FA
Falcon
Falcon · NikolayKozloff
Params4.94B
Context2K
Smallest5.2 GB
GGUF

Keep browsing