Falcon GGUF models
576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.
FA
Falcon H1 1.5B Deep Instruct mydatatune1
Falcon · awakara
Params1.55B
Context128K
Q4_K_M0.9 GB
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
FA
falcon 3 10.3b instruct
Falcon · lm-kit
Params10.3B
Context32K
Q4_K_M6.3 GB
FA
Jessi v0.2 Falcon3 7b Instruct
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
ftz retrieval falcon tiny 100m
Falcon · justacoderwhocodes
Params108M
Context256K
Smallest0.1 GB
FA
Falcon3 3B Instruct
Falcon · lmstudio-community
Params3.23B
Context32K
Q4_K_M2.0 GB
FA
FalconSlerp3 10B
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
FA
Tiiuae Falcon3 Mamba 7B Instruct
Falcon · tensorblock
Params7.27B
Context1024K
Smallest2.6 GB
FA
Models Tiiuae Falcon3 3B Instruct
Falcon · MaziyarPanahi
Params3.23B
Context32K
Smallest2.3 GB
FA
FalconEye
Falcon · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
FA
Falcon 7B Recipe Generation FIXED
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon H1 7B Instruct
Falcon · ZeroWw
Params7.59B
Context256K
Smallest4.9 GB
FA
Falcon H1 1.5B Instruct Adv
Falcon · mradermacher
Params1.55B
Context128K
Q4_K_M0.9 GB
FA
FalconSlerp2 7B
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
falcon mamba 7b
Falcon · tensorblock
Params7.27B
Context1024K
Smallest2.6 GB
FA
Jessi v0.3 Falcon3 7b Instruct
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
FA
falcon mamba 7b instruct
Falcon · tensorblock
Params7.27B
Context1024K
Smallest2.6 GB
FA
Falcon H1 0.5B Instruct
Falcon · ss-lab
Params521M
Context16K
Smallest0.6 GB
FA
Falcon3 3B Instruct
Falcon · EasierAI
Params3.23B
Context32K
Q4_K_M2.0 GB
FA
Tiiuae Falcon 40b
Falcon · tensorblock
Params41.8B
Context2K
Smallest15.8 GB
FA
3b-instruct
Falcon · tiiuae
Params3.05B
Context32K
Smallest1.0 GB
FA
Falcon
Falcon · maddes8cht
Params7.44B
Context2K
Q4_K_M5.2 GB
FA
Falcon 180B
Falcon · mradermacher
Params180B
Context2K
Smallest38.3 GB
FA
Falcon OPT
Falcon · mradermacher
Params1.08B
Context2K
Q4_K_M0.7 GB
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
FA
gguf Q3 K XL falcon mamba 7b
Falcon · Felladrin
Params7.27B
Context1024K
Smallest3.5 GB
FA
Falcon3 3B Instruct RL CODE RL
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
FA
Falcon
Falcon · LiteLLMs
Params11.1B
Context2K
Q4_K_M6.8 GB
FA
falcon3 decompiler 3b
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB