Falcon GGUF models
576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.
FA
Falcon-H1-34B-Instruct
Falcon · unsloth
Params33.6B
Context256K
Q4_K_M20.3 GB
FA
Falcon3 7B Base
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Models Tiiuae Falcon3 3B Base
Falcon · MaziyarPanahi
Params3.23B
Context32K
Smallest2.3 GB
FA
Falcon3 1B Base
Falcon · mradermacher
Params1.67B
Context4K
Q4_K_M1.1 GB
FA
Falcon3 7B Instruct
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
nsfw image detection 26
Falcon · Falconsai
Params86M
Context—
Smallest0.3 GB
FA
Falcon H1 0.5B Instruct
Falcon · mradermacher
Params521M
Context16K
Q4_K_M0.3 GB
FA
Falcon H1R 7B
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
FA
Nexa_Sci_distilled_Falcon 10B
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
FA
Models Tiiuae Falcon3 10B Instruct
Falcon · MaziyarPanahi
Params10.3B
Context32K
Smallest7.1 GB
FA
gpt4all falcon
Falcon · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
FA
Falcon2 5.5B Polish i1
Falcon · mradermacher
Params5.47B
Context2K
Q4_K_M3.4 GB
FA
Falcon3 7B Instruct Heretic v2
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon3 1B Instruct
Falcon · mradermacher
Params1.67B
Context8K
Q4_K_M1.1 GB
FA
Falcon3 3B Instruct
Falcon · tiiuae
Params3.23B
Context32K
Q4_K_M2.0 GB
FA
Falcon H1 34B Instruct
Falcon · gabriellarson
Params33.6B
Context256K
Q4_K_M20.3 GB
FA
Falcon H1R 7B Heretic V2
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
FA
Falcon3 1B Base
Falcon · bartowski
Params1.67B
Context4K
Q4_K_M1.1 GB
FA
Falcon3 10B Instruct
Falcon · tiiuae
Params10.3B
Context32K
Q4_K_M6.3 GB
FA
Falcon H1 Tiny R 0.6B
Falcon · tiiuae
Params622M
Context256K
Q4_K_M0.4 GB
FA
Falcon H1 34B Instruct
Falcon · mradermacher
Params33.6B
Context256K
Q4_K_M20.3 GB
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB
FA
Falcon H1 3B Base
Falcon · mradermacher
Params3.15B
Context128K
Q4_K_M1.9 GB
FA
Jessi v0.6 Falcon3 7b Instruct
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB
FA
Falcon3 10B Instruct
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
FA
Falcon3 10B Instruct
Falcon · gaianet
Params10.3B
Context32K
Q4_K_M6.3 GB
FA
Falcon3 7B Instruct Heretic
Falcon · ChiKoi7
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon3 1B Instruct
Falcon · second-state
Params1.67B
Context8K
Q4_K_M1.1 GB