Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
Falcon H1 1.5B Deep Instruct mydatatune1
Falcon · awakara
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
falcon 3 10.3b instruct
Falcon · lm-kit
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
FA
Jessi v0.2 Falcon3 7b Instruct
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
ftz retrieval falcon tiny 100m
Falcon · justacoderwhocodes
Params108M
Context256K
Smallest0.1 GB
CodingTool use
FA
Falcon3 3B Instruct
Falcon · lmstudio-community
Params3.23B
Context32K
Q4_K_M2.0 GB
Tool use
FA
FalconSlerp3 10B
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Tiiuae Falcon3 Mamba 7B Instruct
Falcon · tensorblock
Params7.27B
Context1024K
Smallest2.6 GB
GGUF
FA
Models Tiiuae Falcon3 3B Instruct
Falcon · MaziyarPanahi
Params3.23B
Context32K
Smallest2.3 GB
GGUF
FA
FalconEye
Falcon · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
FA
Falcon 7B Recipe Generation FIXED
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
Falcon H1 7B Instruct
Falcon · ZeroWw
Params7.59B
Context256K
Smallest4.9 GB
Tool use
FA
Falcon H1 1.5B Instruct Adv
Falcon · mradermacher
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use
FA
FalconSlerp2 7B
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
falcon mamba 7b
Falcon · tensorblock
Params7.27B
Context1024K
Smallest2.6 GB
GGUF
FA
Jessi v0.3 Falcon3 7b Instruct
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
falcon mamba 7b instruct
Falcon · tensorblock
Params7.27B
Context1024K
Smallest2.6 GB
GGUF
FA
Falcon H1 0.5B Instruct
Falcon · ss-lab
Params521M
Context16K
Smallest0.6 GB
Tool use
FA
Falcon3 3B Instruct
Falcon · EasierAI
Params3.23B
Context32K
Q4_K_M2.0 GB
Tool use
FA
Tiiuae Falcon 40b
Falcon · tensorblock
Params41.8B
Context2K
Smallest15.8 GB
GGUF
FA
3b-instruct
Falcon · tiiuae
Params3.05B
Context32K
Smallest1.0 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.44B
Context2K
Q4_K_M5.2 GB
GGUF
FA
Falcon 180B
Falcon · mradermacher
Params180B
Context2K
Smallest38.3 GB
GGUF
FA
Falcon OPT
Falcon · mradermacher
Params1.08B
Context2K
Q4_K_M0.7 GB
GGUF
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
gguf Q3 K XL falcon mamba 7b
Falcon · Felladrin
Params7.27B
Context1024K
Smallest3.5 GB
GGUF
FA
Falcon3 3B Instruct RL CODE RL
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
CodingTool use
FA
Falcon
Falcon · LiteLLMs
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
FA
falcon3 decompiler 3b
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF

Keep browsing