Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
Falcon3 1B Instruct Abliterated
Falcon · bartowski
Params1.67B
Context8K
Q4_K_M1.1 GB
GGUF
FA
Falcon3 7B Instruct
Falcon · tiiuae
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
Falcon H1 1.5B Deep Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
FA
falcon mamba 7b
Falcon · bartowski
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
FA
falcon mamba 7b instruct
Falcon · QuantFactory
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
FA
Falcon
Falcon · QuantFactory
Params6.92B
Context2K
Q4_K_M4.8 GB
GGUF
FA
Falcon-H1R-7B
Falcon · unsloth
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
FA
Falcon H1 3B Instruct
Falcon · tiiuae
Params3.15B
Context128K
Q4_K_M1.9 GB
GGUF
FA
Falcon3 10B Instruct
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
FA
gpt4all falcon i1
Falcon · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon3 10B Base
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
FA
WizardLM Uncensored Falcon 7b
Falcon · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Virtuoso Lite 2
Falcon · arcee-ai
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Falcon H1 34B Base
Falcon · mradermacher
Params33.6B
Context256K
Q4_K_M20.3 GB
GGUF
FA
Falcon H1 7B Base
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
FA
Falcon3 Mamba 7B Base i1
Falcon · mradermacher
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
FA
Falcon H1 Tiny Coder 90M
Falcon · tiiuae
Params108M
Context256K
Q4_K_M0.1 GB
Coding
FA
Falcon H1 Tiny Multilingual 100M Instruct
Falcon · mradermacher
Params108M
Context256K
Q4_K_M0.1 GB
Tool use
FA
Falcon H1R 7B Heretic
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
ReasoningTool use
FA
Falcon
Falcon · mradermacher
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon
Falcon · mradermacher
Params179B
Context2K
Smallest38.0 GB
GGUF
FA
Falcon3 1B Instruct 1.58bit
Falcon · XXXXyu
Params1.67B
Context8K
Smallest0.6 GB
Tool use
FA
Falcon H1 1.5B Deep Base
Falcon · mradermacher
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
FA
Falcon 11B
Falcon · QuantFactory
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
FA
Falcon3 7B Instruct Heretic v2
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
WizardLM Uncensored Falcon 40b
Falcon · mradermacher
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
FA
CollectiveLM Falcon 3 7B
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
Falcon3 1B Instruct
Falcon · tiiuae
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
FA
FalconThink3 10B IT i1
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
ReasoningTool use

Keep browsing