Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
Falcon
Falcon · GeorgyGUF
Params179B
Context2K
Smallest146.8 GB
GGUF
FA
Falcon H1 Tiny 90M Base
Falcon · appvoid
Params91M
Context256K
Smallest0.1 GB
GGUF
FA
Falcon3 Continued 0.3 10B Base Q4 K M
Falcon · Lambent
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
FA
Falcon
Falcon · hadongz
Params7.22B
Context2K
Smallest4.2 GB
GGUF
FA
Falcon3 10B Instruct Abliterated
Falcon · Melvin56
Params10.3B
Context32K
Smallest3.9 GB
Tool use
FA
Falcon H1 1.5B Deep Instruct mydatatune
Falcon · awakara
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use
FA
Text_Summarization
Falcon · fernandoruiz
Params61M
Context512
Smallest0.0 GB
GGUF
FA
Falcon 7b
Falcon · kaetemi
Params7.22B
Context2K
Smallest4.2 GB
GGUF
FA
Falcon3 MoE 2x7B Insruct Q4 K M
Falcon · mamei16
Params13.4B
Context32K
Q4_K_M8.2 GB
Tool use
FA
falcon3 7b reasoning v0.1
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
ReasoningTool use
FA
Falcon
Falcon · NikolayKozloff
Params4.94B
Context2K
Smallest5.2 GB
GGUF
FA
Falcon3 7B Base
Falcon · polyverse
Params7.46B
Context32K
Smallest5.3 GB
GGUF
FA
Falcon Mamba 7b
Falcon · tiiuae
Params7.27B
Context1024K
Smallest15.1 GB
GGUF
FA
Falcon
Falcon · GeorgyGUF
Params179B
Context2K
Smallest190.8 GB
Embedding
FA
Falcon3 7B Instruct gguf q4 k m
Falcon · keisuke-miyako
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon H1 1.5B Deep Instruct mydata54
Falcon · awakara
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use
FA
Falcon3 1B Instruct
Falcon · itlwas
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
FA
Falcon 11B
Falcon · kaetemi
Params11.1B
Context2K
Q4_K_M6.8 GB
GGUF
FA
Shy Finetuned Falcon H1 90m GGUF q4km
Falcon · 76836-HW
Params91M
Context256K
Q4_K_M0.1 GB
Tool use
FA
Falcon H1 1.5B Deep Instruct mydata2
Falcon · awakara
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use
FA
Falcon
Falcon · ssmits
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
FA
Falcon H1 1.5B Instruct gguf q8 0
Falcon · keisuke-miyako
Params1.55B
Context128K
Smallest1.7 GB
Tool use
FA
Falcon3 7B Instruct Abliterated
Falcon · itlwas
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
FA
Falcon3 10B Base
Falcon · devisri050
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
FA
Text_Summarization
Falcon · tonyc666
Params61M
Context512
Q4_K_M0.0 GB
GGUF
FA
falcon mamba 7b instruct Q8 0
Falcon · win10
Params7.27B
Context1024K
Smallest7.8 GB
GGUF
FA
ehristoforu Falcon3 MoE 2x7B Insruct
Falcon · tensorblock
Params13.4B
Context32K
Smallest5.0 GB
Tool use
FA
gpt4all falcon Q4 K M
Falcon · raissadev
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon3 10B Base
Falcon · devisri050
Params10.3B
Context32K
Smallest5.9 GB
GGUF
FA
Falcon
Falcon · dH29010
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF

Keep browsing