Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
Falcon
Falcon · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
FA
Falcon H1 Tiny 90M Instruct Safe
Falcon · mradermacher
Params91M
Context256K
Q4_K_M0.1 GB
Tool use
FA
Falcon3 Decompiler 3b v1.5
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
GGUF
FA
Falcon3 1B Instruct
Falcon · lmstudio-community
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
FA
Falcon H1R 7B
Falcon · s3dev-ai
Params7.59B
Context256K
Q4_K_M4.6 GB
ReasoningTool use
FA
Falcon
Falcon · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
NisoriV2llama7b
Falcon · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
FA
tiiuae falcon mamba 7b
Falcon · RichardErkhov
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
FA
Falcon3 7B Instruct
Falcon · EasierAI
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon3 7B Instruct_apps
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Jessi v0.4 Falcon3 7b Instruct
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
falcon3 7b reasoning v0.1 i1
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
ReasoningTool use
FA
yujiepan falcon mamba tiny random
Falcon · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
FA
Falcon
Falcon · Nextcloud-AI
Params7.22B
Context2K
Smallest4.2 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
FA
Falcon 7b
Falcon · polyverse
Params7.22B
Context2K
Smallest5.7 GB
GGUF
FA
Falcon H1 Tiny 90M Instruct Curriculum
Falcon · mradermacher
Params91M
Context256K
Q4_K_M0.1 GB
Tool use
FA
Falcon3 7B Base
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
Falcon3 1B Instruct Abliterated
Falcon · mradermacher
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
FA
laya v796
Falcon · Falconsai
Params421M
Context—
Smallest0.8 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon
Falcon · gorilla-llm
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon 11B
Falcon · tensorblock
Params11.1B
Context2K
Smallest4.3 GB
GGUF
FA
Falcon3 1B Instruct Heretic
Falcon · ChiKoi7
Params1.67B
Context8K
Q4_K_M1.1 GB
GGUF
FA
falcon3
Falcon · cortexso
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Tiiuae.Falcon 7b
Falcon · DevQuasar-6
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon H1 Tiny 90M Base
Falcon · mradermacher
Params91M
Context256K
Q4_K_M0.1 GB
GGUF
FA
Falcon H1 1.5B Deep Instruct
Falcon · mradermacher
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use

Keep browsing