Falcon GGUF models

576 GGUF models in the Falcon family, quantized by 124 uploaders. Sizes run from 4M to 180B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
FA
Falcon 1B Book Recommendation
Falcon · mradermacher
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
FA
Falcon
Falcon · r3v1
Params41.8B
Context2K
Smallest23.8 GB
GGUF
FA
Falcon H1 7B FORGE v2
Falcon · sgsystems
Params7.59B
Context256K
Smallest3.5 GB
Tool use
FA
gpt4all falcon Q4 K M
Falcon · CCSU-ML
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon H1 Tiny 90M Instruct Curriculum
Falcon · appvoid
Params91M
Context256K
Smallest0.1 GB
GGUF
FA
Falcon H1 1.5B Deep Instruct mydata76
Falcon · awakara
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use
FA
falcon mamba 7b instruct Q4 0
Falcon · blogcncom
Params7.27B
Context1024K
Smallest4.2 GB
GGUF
FA
Falcon
Falcon · ei-grad
Params7.22B
Context2K
Smallest4.2 GB
GGUF
FA
Falcon3 7B Base
Falcon · polyverse
Params7.46B
Context32K
Smallest7.9 GB
GGUF
FA
Falcon3 MoE 2x7B Insruct Q8 0
Falcon · QuiXilver777
Params13.4B
Context32K
Smallest14.2 GB
Tool use
FA
bhoomigguf
Falcon · FalconX80
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
FA
Medical_Summarization
Falcon · fernandoruiz
Params61M
Context512
Smallest0.0 GB
GGUF
FA
Falcon3 Jessi v0.4 7B Slerp Q6 K
Falcon · Serlop
Params7.46B
Context32K
Smallest6.1 GB
Tool use
FA
Falcon 7b
Falcon · polyverse
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
falcon3 3b reasoning v0.1
Falcon · mradermacher
Params3.23B
Context32K
Q4_K_M2.0 GB
ReasoningTool use
FA
Falcon E 1B
Falcon · leok7v
Params1.72B
Context32K
Smallest0.7 GB
GGUF
FA
FalconThink3 10B IT Q4 K M
Falcon · fluently-sets
Params10.3B
Context32K
Q4_K_M6.3 GB
ReasoningTool use
FA
Falcon3-10B-Instruct-1.58bit
Falcon · israellaguan
Params10.3B
Context32K
Smallest4.0 GB
Tool use
FA
bhoomi7b-30k
Falcon · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
FA
Falcon Mamba 7b
Falcon · tiiuae
Params7.27B
Context1024K
Smallest15.1 GB
GGUF
FA
Falcon3 10B Base
Falcon · polyverse
Params10.3B
Context32K
Smallest11.0 GB
GGUF
FA
Falcon3 3B RP V0.1 Q5 K M
Falcon · bunnycore
Params3.23B
Context32K
Smallest2.3 GB
RoleplayTool use
FA
Text_Summarization
Falcon · birdsbirdsbirds
Params61M
Context512
Q4_K_M0.0 GB
GGUF
FA
WizardLM Uncensored Falcon 40b
Falcon · Pakalypse
Params41.8B
Context2K
Smallest30.6 GB
GGUF
FA
Falcon 7b Instruct
Falcon · cphan-intersystems
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
FA
Falcon3 1B Base
Falcon · itlwas
Params1.67B
Context4K
Q4_K_M1.1 GB
GGUF
FA
Falcon H1 1.5B Deep Instruct mydata987
Falcon · awakara
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use
FA
Falcon H1 1.5B Deep Instruct mydata1
Falcon · awakara
Params1.55B
Context128K
Q4_K_M0.9 GB
Tool use
FA
Falcon
Falcon · r3v1
Params7.22B
Context2K
Smallest4.2 GB
GGUF
FA
falcon 7b f16
Falcon · umerfiazsubnet
Params7B
Context—
Smallest0.0 GB
GGUF

Keep browsing