Falcon GGUF models
576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.
FA
Falcon3Slerp4 10B
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
FA
Falcon
Falcon · LoneStriker
Params11.1B
Context2K
Q4_K_M6.8 GB
FA
falcon mamba 7b instruct Q4 K M
Falcon · raven1027
Params7.27B
Context1024K
Q4_K_M4.2 GB
FA
Falcon
Falcon · GeorgyGUF
Params179B
Context2K
Smallest357.3 GB
FA
falcon mamba 7b Q8 0
Falcon · NikolayKozloff
Params7.27B
Context1024K
Smallest7.8 GB
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
FA
Falcon
Falcon · NikolayKozloff
Params5.47B
Context2K
Smallest3.2 GB
FA
Falcon3 1B Instruct Abliterated
Falcon · itlwas
Params1.67B
Context8K
Q4_K_M1.1 GB
FA
Katuni4Ka Tiny Random Falcon 40b
Falcon · tensorblock
Params9M
Context2K
Smallest0.0 GB
FA
falcon oracle 20b
Falcon · mikefalcos
Params20.9B
Context128K
Smallest13.8 GB
FA
Falcon3 10b Instruct Apostate
Falcon · heterodoxin
Params10.3B
Context32K
Smallest3.9 GB
FA
Falcon
Falcon · pcuenq
Params7.22B
Context2K
Smallest14.4 GB
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
FA
Falcon Mamba Tiny Dev
Falcon · erenyeager-1
Params9M
Context1024K
Q4_K_M0.0 GB
FA
Falcon H1 Tiny Multilingual 100M Instruct
Falcon · appvoid
Params108M
Context256K
Smallest0.1 GB
FA
falcon h1 tiny injection firewall
Falcon · kgptalkie
Params91M
Context256K
Smallest0.1 GB
FA
Falcon3 7B Base
Falcon · SandLogicTechnologies
Params7.46B
Context32K
Q4_K_M4.6 GB
FA
Falcon E 1.2 10B Exp
Falcon · axolotl-ai-co
Params10.3B
Context64K
Smallest3.0 GB
FA
Falcon H1 0.5B Instruct
Falcon · ggml-org
Params521M
Context16K
Smallest0.6 GB
FA
Falcon H1 Tiny 90M Instruct Curriculum Pre DPO
Falcon · appvoid
Params91M
Context256K
Smallest0.1 GB
FA
valkyria assistent model v3 Falcon3 Based
Falcon · mradermacher
Params1.67B
Context8K
Q4_K_M1.1 GB
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
FA
H2Ogpt Gm Oasst1 En 2048 Falcon 7b v3
Falcon · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
FA
Neo Falcon3 7B Instruct v0
Falcon · neopolita
Params7.46B
Context32K
Smallest14.9 GB
FA
Falcon3 3B Instruct Abliterated
Falcon · itlwas
Params3.23B
Context32K
Q4_K_M2.0 GB
FA
Falcon E 1.2 3B Exp Prequantized
Falcon · mradermacher
Params3.05B
Context32K
Smallest0.7 GB
FA
Falcon H1 0.5B Instruct
Falcon · C10X
Params521M
Context16K
Q4_K_M0.3 GB
FA
Falcon H1 7B Instruct gguf q4 k m
Falcon · keisuke-miyako
Params7.59B
Context256K
Q4_K_M4.6 GB
FA
Falcon Thought 7b v0
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB