GGUF models by DhruvalLabs
57 GGUF models quantized by DhruvalLabs on Hugging Face. Sizes run from 494M to 177B parameters. The longest trained context is 1024K tokens.
LF
LFM2.5 1.2B Instruct
Lfm · DhruvalLabs
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
VibeThinker 3B
Qwen · DhruvalLabs
Params3.09B
Context128K
Q4_K_M1.9 GB
LL
Llama3 8B Chinese Chat
Llama · DhruvalLabs
Params8.03B
Context8K
Q4_K_M4.9 GB
NA
Nanbeige4.1 3B
Nanbeige · DhruvalLabs
Params3.93B
Context256K
Q4_K_M2.4 GB
LL
Llama 3 8B Instruct Gradient 1048k
Llama · DhruvalLabs
Params8.03B
Context1024K
Q4_K_M4.9 GB
QW
Qwen3 30B A3B
Qwen · DhruvalLabs
Params30.5B
Context40K
Q4_K_M18.6 GB
DE
DeepScaleR 1.5B Preview
DeepSeek · DhruvalLabs
Params1.78B
Context128K
Q4_K_M1.1 GB
PH
phi 1 5
Phi · DhruvalLabs
Params1.42B
Context2K
Q4_K_M0.9 GB
QW
QwQ 32B
Qwen · DhruvalLabs
Params32.8B
Context40K
Q4_K_M19.9 GB
QW
Qwen3 30B A3B Instruct 2507
Qwen · DhruvalLabs
Params30.5B
Context256K
Q4_K_M18.6 GB
SM
SmolLM3 3B
SmolLM · DhruvalLabs
Params3.08B
Context64K
Q4_K_M1.9 GB
MI
Mistral 7B Instruct v0.2
Mistral · DhruvalLabs
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · DhruvalLabs
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
WebWorld 14B
Qwen · DhruvalLabs
Params14.8B
Context40K
Q4_K_M9.0 GB
SM
SmolLM2 1.7B Instruct
SmolLM · DhruvalLabs
Params1.71B
Context8K
Q4_K_M1.1 GB
QW
Qwen3 4B
Qwen · DhruvalLabs
Params4.02B
Context40K
Q4_K_M2.5 GB
RE
ReaderLM v2
Readerlm · DhruvalLabs
Params1.54B
Context501K
Q4_K_M1.0 GB
PH
Phi 3 Mini 4k Instruct
Phi · DhruvalLabs
Params3.82B
Context4K
Q4_K_M2.4 GB
GE
Gemma 4 12b It
Gemma · DhruvalLabs
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 3 4b It
Gemma · DhruvalLabs
Params3.88B
Context128K
Q4_K_M2.5 GB
MI
Mistral 7B v0.1
Mistral · DhruvalLabs
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
Phi 4 Mini Instruct
Phi · DhruvalLabs
Params3.84B
Context128K
Q4_K_M2.5 GB
QW
Qwen3.6 27B
Qwen · DhruvalLabs
Params27.3B
Context256K
Q4_K_M16.8 GB
PH
Phi 3.5 Mini Instruct
Phi · DhruvalLabs
Params3.82B
Context128K
Q4_K_M2.4 GB
MI
MiniCPM5 1B
MiniCPM · DhruvalLabs
Params1.08B
Context128K
Q4_K_M0.7 GB
MI
Zephyr 7b Beta
Mistral · DhruvalLabs
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
Baichuan 7B
Baichuan · DhruvalLabs
Params7B
Context4K
Q4_K_M0.0 GB