Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
Falcon H1 Tiny 90M Instruct Pre DPO
Falcon · appvoid
Params91M
Context256K
Smallest0.1 GB
GGUF
FA
Falcon
Falcon · neopolita
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
FA
gpt4all falcon Q2 K
Falcon · ysn-rfd
Params7.22B
Context2K
Smallest3.9 GB
GGUF
FA
Falcon3 7B Instruct Abliterated
Falcon · Melvin56
Params7.46B
Context32K
Smallest2.9 GB
Tool use
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon3 10B Instruct Abliterated
Falcon · itlwas
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
tiiuae_Falcon3 7B Instruct
Falcon · smarttasks
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon H1R 7B Heretic V2 Q4 K M
Falcon · netcat420
Params7.59B
Context256K
Q4_K_M4.6 GB
ReasoningTool use
FA
Falcon
Falcon · martintomov
Params7.22B
Context2K
Smallest7.7 GB
GGUF
FA
Text_Summarization
Falcon · jagan546
Params61M
Context512
Smallest0.1 GB
GGUF
FA
Falcon H1 1.5B Instruct gguf q4 k m
Falcon · keisuke-miyako
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use
FA
Rombodawg LosslessMegaCoder Falcon 40b Mini
Falcon · tensorblock
Params41.3B
Context2K
Smallest15.6 GB
Coding
FA
Falcon E 1.2 3B Exp
Falcon · axolotl-ai-co
Params3.05B
Context32K
Smallest0.8 GB
ReasoningTool use
FA
Falcon3 1B Instruct gguf q4 k m
Falcon · keisuke-miyako
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
FA
distilbert/distilgpt2/model.safetensors
Falcon · Falconsai
Params88M
Context—
Smallest0.4 GB
GGUF
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon3Slerp2 10B
Falcon · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
Tool use
FA
Text_Summarization
Falcon · jagan546
Params61M
Context512
Q4_K_M0.0 GB
GGUF
FA
Falcon3 10B Base
Falcon · kaetemi
Params10.3B
Context32K
Smallest7.3 GB
GGUF
FA
Falcon H1 0.5B Instruct gguf q8 0
Falcon · keisuke-miyako
Params521M
Context16K
Smallest0.6 GB
Tool use
FA
Falcon H1 0.5B Instruct gguf q4 k m
Falcon · keisuke-miyako
Params521M
Context16K
Q4_K_M0.3 GB
Tool use
FA
Falcon E 3B
Falcon · leok7v
Params3.05B
Context32K
Smallest1.0 GB
GGUF
FA
Falcon3 3B Instruct gguf q4 k m
Falcon · keisuke-miyako
Params3.23B
Context32K
Q4_K_M2.0 GB
Tool use
FA
Falcon 7b
Falcon · kaetemi
Params7.22B
Context2K
Smallest7.7 GB
GGUF
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon H1 1.5B Deep Instruct mydata43
Falcon · awakara
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use
FA
Falcon3 1B Instruct gguf q8 0
Falcon · keisuke-miyako
Params1.67B
Context8K
Smallest1.8 GB
Tool use
FA
Falcon H1 Tiny Multilingual 100M Base
Falcon · appvoid
Params108M
Context256K
Smallest0.1 GB
GGUF
FA
Neve Cascade S 90M
Falcon · NeveAI
Params91M
Context256K
Smallest0.1 GB
Tool use

Keep browsing