Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
Falcon 7b Instruct
Falcon · cphan-intersystems
Params7.22B
Context2K
Smallest7.7 GB
GGUF
FA
Falcon
Falcon · thesven
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
FA
Falcon3 7B Base
Falcon · polyverse
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
Falcon3 MoE 2x7B Instruct Q4 0
Falcon · houghtob123
Params13.4B
Context32K
Smallest7.6 GB
Tool use
FA
Falcon3 7B Instruct
Falcon · msyukorai
Params7.46B
Context32K
Smallest4.3 GB
Tool use
FA
Falcon H1 0.5B Instruct
Falcon · Felladrin
Params521M
Context16K
Smallest0.3 GB
Tool use
FA
Falcon3 3B Inst Attack Hyp
Falcon · medmac01
Params3.23B
Context32K
Smallest3.4 GB
Tool use
FA
Amazon FalconLite
Falcon · tensorblock
Params—
Context2K
Smallest0.0 GB
GGUF
FA
Falcon3 7B Base
Falcon · DebadityaMalakar
Params7.46B
Context32K
Smallest6.1 GB
GGUF
FA
Falcon3 10B Base
Falcon · devisri050
Params10.3B
Context32K
Smallest6.0 GB
GGUF
FA
Falcon Ja H1 1.5B GSM8K 25
Falcon · awakara
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use
FA
Falcon3 1B Instruct
Falcon · anhtuan23004
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
FA
falcon h1 1.5b deep instruct tg
Falcon · patrickdung
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use
FA
falcon3 ultraset Q4 K M
Falcon · mattritchey
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon
Falcon · thesven
Params11.1B
Context2K
Smallest6.0 GB
GGUF
FA
Falcon3 7B Instruct Abliterated
Falcon · houghtob123
Params7.46B
Context32K
Smallest4.3 GB
Tool use
FA
Falcon
Falcon · rzabounidis
Params11.1B
Context2K
Smallest9.2 GB
GGUF
FA
Falcon
Falcon · vegarab
Params7.22B
Context2K
Smallest4.2 GB
GGUF
FA
Falcon2 8B Italian Q8 0
Falcon · lukecage
Params8.11B
Context2K
Smallest8.6 GB
GGUF
FA
FalconThink3 10B IT Q4 0
Falcon · houghtob123
Params10.3B
Context32K
Smallest5.9 GB
Tool use
FA
Falcon3 2x10B MoE Instruct Q5 K M
Falcon · wahidmounir
Params18.8B
Context32K
Smallest13.4 GB
Tool use
FA
Falcon
Falcon · aadelrag
Params7.22B
Context2K
Smallest7.7 GB
GGUF
FA
falcon 7b
Falcon · medmekk
Params7.22B
Context2K
Smallest14.4 GB
GGUF
FA
ehristoforu falcon3 ultraset
Falcon · RichardErkhov
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
falcon mobile models
Falcon · Timothree33
Params1.55B
Context128K
Smallest1.1 GB
Tool use
FA
Falcon3 3B Instruct
Falcon · Felladrin
Params3.23B
Context32K
Smallest1.9 GB
Tool use
FA
Falcon3 1B Instruct
Falcon · Felladrin
Params1.67B
Context8K
Smallest1.0 GB
Tool use
FA
falcon models
Falcon · anushkrishna
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
FA
nobody falcon3 1b
Falcon · yakovganam
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
FA
noaer falcon
Falcon · Abhinav956545
Params7.22B
Context4K
Smallest2.8 GB
GGUF

Keep browsing