Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
Falcon3Slerp4 10B
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Falcon
Falcon · LoneStriker
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
FA
falcon mamba 7b instruct Q4 K M
Falcon · raven1027
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
FA
Falcon
Falcon · GeorgyGUF
Params179B
Context2K
Smallest357.3 GB
GGUF
FA
falcon mamba 7b Q8 0
Falcon · NikolayKozloff
Params7.27B
Context1024K
Smallest7.8 GB
GGUF
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon
Falcon · NikolayKozloff
Params5.47B
Context2K
Smallest3.2 GB
GGUF
FA
Falcon3 1B Instruct Abliterated
Falcon · itlwas
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
FA
Katuni4Ka Tiny Random Falcon 40b
Falcon · tensorblock
Params9M
Context2K
Smallest0.0 GB
GGUF
FA
falcon oracle 20b
Falcon · mikefalcos
Params20.9B
Context128K
Smallest13.8 GB
Tool use
FA
Falcon3 10b Instruct Apostate
Falcon · heterodoxin
Params10.3B
Context32K
Smallest3.9 GB
GGUF
FA
Falcon
Falcon · pcuenq
Params7.22B
Context2K
Smallest14.4 GB
GGUF
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon Mamba Tiny Dev
Falcon · erenyeager-1
Params9M
Context1024K
Q4_K_M0.0 GB
GGUF
FA
Falcon H1 Tiny Multilingual 100M Instruct
Falcon · appvoid
Params108M
Context256K
Smallest0.1 GB
GGUF
FA
falcon h1 tiny injection firewall
Falcon · kgptalkie
Params91M
Context256K
Smallest0.1 GB
Tool use
FA
Falcon3 7B Base
Falcon · SandLogicTechnologies
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
FA
Falcon E 1.2 10B Exp
Falcon · axolotl-ai-co
Params10.3B
Context64K
Smallest3.0 GB
ReasoningTool use
FA
Falcon H1 0.5B Instruct
Falcon · ggml-org
Params521M
Context16K
Smallest0.6 GB
GGUF
FA
Falcon H1 Tiny 90M Instruct Curriculum Pre DPO
Falcon · appvoid
Params91M
Context256K
Smallest0.1 GB
GGUF
FA
valkyria assistent model v3 Falcon3 Based
Falcon · mradermacher
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
H2Ogpt Gm Oasst1 En 2048 Falcon 7b v3
Falcon · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Neo Falcon3 7B Instruct v0
Falcon · neopolita
Params7.46B
Context32K
Smallest14.9 GB
Tool use
FA
Falcon3 3B Instruct Abliterated
Falcon · itlwas
Params3.23B
Context32K
Q4_K_M2.0 GB
Tool use
FA
Falcon E 1.2 3B Exp Prequantized
Falcon · mradermacher
Params3.05B
Context32K
Smallest0.7 GB
ReasoningTool use
FA
Falcon H1 0.5B Instruct
Falcon · C10X
Params521M
Context16K
Q4_K_M0.3 GB
GGUF
FA
Falcon H1 7B Instruct gguf q4 k m
Falcon · keisuke-miyako
Params7.59B
Context256K
Q4_K_M4.6 GB
Tool use
FA
Falcon Thought 7b v0
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use

Keep browsing