GGUF models by DhruvalLabs

57 GGUF models quantized by DhruvalLabs on Hugging Face. Sizes run from 494M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LF
LFM2.5 1.2B Instruct
Lfm · DhruvalLabs
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
QW
VibeThinker 3B
Qwen · DhruvalLabs
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoningTool use
LL
Llama3 8B Chinese Chat
Llama · DhruvalLabs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NA
Nanbeige4.1 3B
Nanbeige · DhruvalLabs
Params3.93B
Context256K
Q4_K_M2.4 GB
ReasoningTool use
LL
Llama 3 8B Instruct Gradient 1048k
Llama · DhruvalLabs
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 30B A3B
Qwen · DhruvalLabs
Params30.5B
Context40K
Q4_K_M18.6 GB
ReasoningTool use
DE
DeepScaleR 1.5B Preview
DeepSeek · DhruvalLabs
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
PH
phi 1 5
Phi · DhruvalLabs
Params1.42B
Context2K
Q4_K_M0.9 GB
Coding
QW
QwQ 32B
Qwen · DhruvalLabs
Params32.8B
Context40K
Q4_K_M19.9 GB
ReasoningTool use
QW
Qwen3 30B A3B Instruct 2507
Qwen · DhruvalLabs
Params30.5B
Context256K
Q4_K_M18.6 GB
Tool use
SM
SmolLM3 3B
SmolLM · DhruvalLabs
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
MI
Mistral 7B Instruct v0.2
Mistral · DhruvalLabs
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · DhruvalLabs
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
QW
WebWorld 14B
Qwen · DhruvalLabs
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
SM
SmolLM2 1.7B Instruct
SmolLM · DhruvalLabs
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
QW
Qwen3 4B
Qwen · DhruvalLabs
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
RE
ReaderLM v2
Readerlm · DhruvalLabs
Params1.54B
Context501K
Q4_K_M1.0 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · DhruvalLabs
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
GE
Gemma 4 12b It
Gemma · DhruvalLabs
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma 3 4b It
Gemma · DhruvalLabs
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
MI
Mistral 7B v0.1
Mistral · DhruvalLabs
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · DhruvalLabs
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
QW
Qwen3.6 27B
Qwen · DhruvalLabs
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
PH
Phi 3.5 Mini Instruct
Phi · DhruvalLabs
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
MI
MiniCPM5 1B
MiniCPM · DhruvalLabs
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
MI
Zephyr 7b Beta
Mistral · DhruvalLabs
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
Baichuan 7B
Baichuan · DhruvalLabs
Params7B
Context4K
Q4_K_M0.0 GB
Coding

Keep browsing