Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
Falcon-H1-34B-Instruct
Falcon · unsloth
Params33.6B
Context256K
Q4_K_M20.3 GB
Tool use
FA
Falcon3 7B Base
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
Models Tiiuae Falcon3 3B Base
Falcon · MaziyarPanahi
Params3.23B
Context32K
Smallest2.3 GB
GGUF
FA
Falcon3 1B Base
Falcon · mradermacher
Params1.67B
Context4K
Q4_K_M1.1 GB
GGUF
FA
Falcon3 7B Instruct
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
nsfw image detection 26
Falcon · Falconsai
Params86M
Context—
Smallest0.3 GB
GGUF
FA
Falcon H1 0.5B Instruct
Falcon · mradermacher
Params521M
Context16K
Q4_K_M0.3 GB
Tool use
FA
Falcon H1R 7B
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
ReasoningTool use
FA
Nexa_Sci_distilled_Falcon 10B
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
FA
Models Tiiuae Falcon3 10B Instruct
Falcon · MaziyarPanahi
Params10.3B
Context32K
Smallest7.1 GB
GGUF
FA
gpt4all falcon
Falcon · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon2 5.5B Polish i1
Falcon · mradermacher
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon3 7B Instruct Heretic v2
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon3 1B Instruct
Falcon · mradermacher
Params1.67B
Context8K
Q4_K_M1.1 GB
GGUF
FA
Falcon3 3B Instruct
Falcon · tiiuae
Params3.23B
Context32K
Q4_K_M2.0 GB
Tool use
FA
Falcon H1 34B Instruct
Falcon · gabriellarson
Params33.6B
Context256K
Q4_K_M20.3 GB
Tool use
FA
Falcon H1R 7B Heretic V2
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
ReasoningTool use
FA
Falcon3 1B Base
Falcon · bartowski
Params1.67B
Context4K
Q4_K_M1.1 GB
GGUF
FA
Falcon3 10B Instruct
Falcon · tiiuae
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Falcon H1 Tiny R 0.6B
Falcon · tiiuae
Params622M
Context256K
Q4_K_M0.4 GB
Tool use
FA
Falcon H1 34B Instruct
Falcon · mradermacher
Params33.6B
Context256K
Q4_K_M20.3 GB
Tool use
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon H1 3B Base
Falcon · mradermacher
Params3.15B
Context128K
Q4_K_M1.9 GB
GGUF
FA
Jessi v0.6 Falcon3 7b Instruct
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon3 10B Instruct
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
FA
Falcon3 10B Instruct
Falcon · gaianet
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Falcon3 7B Instruct Heretic
Falcon · ChiKoi7
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
Falcon3 1B Instruct
Falcon · second-state
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use

Keep browsing