Falcon GGUF models
576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.
FA
Falcon 7b Instruct
Falcon · cphan-intersystems
Params7.22B
Context2K
Smallest7.7 GB
FA
Falcon
Falcon · thesven
Params11.1B
Context2K
Q4_K_M6.8 GB
FA
Falcon3 7B Base
Falcon · polyverse
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon3 MoE 2x7B Instruct Q4 0
Falcon · houghtob123
Params13.4B
Context32K
Smallest7.6 GB
FA
Falcon3 7B Instruct
Falcon · msyukorai
Params7.46B
Context32K
Smallest4.3 GB
FA
Falcon H1 0.5B Instruct
Falcon · Felladrin
Params521M
Context16K
Smallest0.3 GB
FA
Falcon3 3B Inst Attack Hyp
Falcon · medmac01
Params3.23B
Context32K
Smallest3.4 GB
FA
Amazon FalconLite
Falcon · tensorblock
Params—
Context2K
Smallest0.0 GB
FA
Falcon3 7B Base
Falcon · DebadityaMalakar
Params7.46B
Context32K
Smallest6.1 GB
FA
Falcon3 10B Base
Falcon · devisri050
Params10.3B
Context32K
Smallest6.0 GB
FA
Falcon Ja H1 1.5B GSM8K 25
Falcon · awakara
Params1.55B
Context128K
Q4_K_M0.9 GB
FA
Falcon3 1B Instruct
Falcon · anhtuan23004
Params1.67B
Context8K
Q4_K_M1.1 GB
FA
falcon h1 1.5b deep instruct tg
Falcon · patrickdung
Params1.55B
Context128K
Q4_K_M0.9 GB
FA
falcon3 ultraset Q4 K M
Falcon · mattritchey
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon
Falcon · thesven
Params11.1B
Context2K
Smallest6.0 GB
FA
Falcon3 7B Instruct Abliterated
Falcon · houghtob123
Params7.46B
Context32K
Smallest4.3 GB
FA
Falcon
Falcon · rzabounidis
Params11.1B
Context2K
Smallest9.2 GB
FA
Falcon
Falcon · vegarab
Params7.22B
Context2K
Smallest4.2 GB
FA
Falcon2 8B Italian Q8 0
Falcon · lukecage
Params8.11B
Context2K
Smallest8.6 GB
FA
FalconThink3 10B IT Q4 0
Falcon · houghtob123
Params10.3B
Context32K
Smallest5.9 GB
FA
Falcon3 2x10B MoE Instruct Q5 K M
Falcon · wahidmounir
Params18.8B
Context32K
Smallest13.4 GB
FA
Falcon
Falcon · aadelrag
Params7.22B
Context2K
Smallest7.7 GB
FA
falcon 7b
Falcon · medmekk
Params7.22B
Context2K
Smallest14.4 GB
FA
ehristoforu falcon3 ultraset
Falcon · RichardErkhov
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
falcon mobile models
Falcon · Timothree33
Params1.55B
Context128K
Smallest1.1 GB
FA
Falcon3 3B Instruct
Falcon · Felladrin
Params3.23B
Context32K
Smallest1.9 GB
FA
Falcon3 1B Instruct
Falcon · Felladrin
Params1.67B
Context8K
Smallest1.0 GB
FA
falcon models
Falcon · anushkrishna
Params7B
Context4K
Q4_K_M4.3 GB
FA
nobody falcon3 1b
Falcon · yakovganam
Params1.67B
Context8K
Q4_K_M1.1 GB
FA
noaer falcon
Falcon · Abhinav956545
Params7.22B
Context4K
Smallest2.8 GB