Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
Falcon
Falcon · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon3 10B Instruct
Falcon · s3dev-ai
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Falcon3 10b Tensopolis v1
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Falcon3 Jessi v0.4 7B Slerp
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon3 7B Instruct
Falcon · s3dev-ai
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon3 3B Instruct Abliterated
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
Tool use
FA
falcon3 decompiler 7b v1
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
Falcon3 10B Instruct
Falcon · duyntnet
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Jessi v0.5 Falcon3 7b Instruct
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon3 1B Instruct
Falcon · gaianet
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
FA
Jessi v0.6 Falcon3 7b Instruct
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falconsai/Athr_Agent_Sec/model.safetensors
Falcon · Falconsai
Params—
Context—
Smallest0.0 GB
GGUF
FA
Falcon
Falcon · vsevolodl
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon
Falcon · maddes8cht
Params7.26B
Context2K
Q4_K_M5.0 GB
GGUF
FA
FalconSlerp4 7B
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
tiiuae.Falcon H1R 7B
Falcon · DevQuasar
Params7.59B
Context256K
Q4_K_M4.6 GB
ReasoningTool use
FA
Falcon H1 3b Cyber Merged
Falcon · sourcepirate
Params3.15B
Context128K
Smallest6.3 GB
Tool use
FA
Falcon H1 34B Instruct Abliterated
Falcon · mradermacher
Params33.6B
Context256K
Q4_K_M20.3 GB
Tool use
FA
Falcon3 7B Instruct
Falcon · duyntnet
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
tiiuae.Falcon H1 1.5B Instruct
Falcon · DevQuasar
Params1.56B
Context128K
Q4_K_M0.9 GB
GGUF
FA
Falcon3 3B RP V0.1 i1
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
RoleplayTool use
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon Coder 3b
Falcon · mradermacher
Params3.05B
Context32K
Smallest0.7 GB
Coding
FA
Models Tiiuae Falcon3 1B Base
Falcon · MaziyarPanahi
Params1.67B
Context4K
Smallest1.2 GB
GGUF
FA
Falconsai/LightDec_Arthur/model.safetensors
Falcon · Falconsai
Params12M
Context—
Smallest0.0 GB
GGUF
FA
falcon mamba 7b instruct IQ4 NL
Falcon · hellork
Params7.27B
Context1024K
Smallest4.2 GB
GGUF

Keep browsing