Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
VideoThinker R1 Bias 3B
Falcon · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
ReasoningVision
FA
Falcon3 3B Base
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
FA
Falcon3 3B Instruct Heretic
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
Tool use
FA
Falcon H1 3B Instruct
Falcon · mradermacher
Params3.15B
Context128K
Q4_K_M1.9 GB
Tool use
FA
Falcon3 10B Base
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
FA
Falcon3 10B Instruct
Falcon · QuantFactory
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Falcon3 7B Base
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
Falcon3 10b Tensopolis v1
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Falcon3 3B Base
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
FA
Falcon H1 34B Instruct
Falcon · mradermacher
Params33.6B
Context256K
Q4_K_M20.3 GB
Tool use
FA
Falcon3 3B Instruct
Falcon · gaianet
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
FA
Falconsai/nsfw_image_detection/model.safetensors
Falcon · webnizam
Params86M
Context—
Smallest0.3 GB
GGUF
FA
Falcon3 Jessi v0.4 7B Slerp i1
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon3 MoE 2x7B Insruct i1
Falcon · mradermacher
Params13.4B
Context32K
Q4_K_M8.2 GB
Tool use
FA
Falcon
Falcon · DevQuasar
Params11.1B
Context2K
Q4_K_M6.9 GB
GGUF
FA
Falcon H1 0.5B Base
Falcon · mradermacher
Params521M
Context16K
Q4_K_M0.3 GB
GGUF
FA
Falcon
Falcon · RichardErkhov
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon
Falcon · RichardErkhov
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
FA
Falcon3 7B Instruct
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
Falcon
Falcon · YokaiKoibito
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
FA
tiiuae.Falcon H1 34B Base
Falcon · DevQuasar
Params33.6B
Context256K
Q4_K_M20.3 GB
GGUF
FA
Falcon
Falcon · mradermacher
Params9M
Context2K
Q4_K_M0.0 GB
GGUF
FA
VideoThinker R1 3B
Falcon · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
ReasoningVision
FA
tiiuae.Falcon H1 34B Instruct
Falcon · DevQuasar
Params33.6B
Context256K
Q4_K_M20.3 GB
GGUF
FA
Falcon3 Mamba 7B Instruct
Falcon · mradermacher
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
FA
Falcon 40b
Falcon · mradermacher
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
FA
Falcon
Falcon · bartowski
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
FA
Falcon 7b Instruct
Falcon · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon3 1B Instruct
Falcon · EasierAI
Params1.7B
Context8K
Q4_K_M1.1 GB
GGUF
FA
Falcon H1 1.5B Deep Instruct
Falcon · mradermacher
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use

Keep browsing