GGUF models by lainlives

36 GGUF models quantized by lainlives on Hugging Face. Sizes run from 752M to 30.5B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 Coder 30B A3B IT Heretic
Qwen · lainlives
Params30.5B
Context256K
Smallest32.5 GB
Coding
QW
Qwen3.5 9B Claude 4.6 HighIQ INSTRUCT HERETIC UNCENSORED
Qwen · lainlives
Params8.95B
Context256K
Q4_K_M5.6 GB
RoleplayVision
QW
Qwen3 Coder 30B A3B Instruct_Pruned_REAP 15B A3B SafeTensors
Qwen · lainlives
Params16B
Context256K
Q4_K_M9.8 GB
Coding
SP
SPark X2.5 4B
Spark · lainlives
Params4.11B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
DE
Deepseek_Ai_Deepseek_Coder_V2_Lite_Instruct Nl2Sqlpp 16bit v4.0 Cw 4K
DeepSeek · lainlives
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
SP
SPark X2.5 4B
Spark · lainlives
Params4.11B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
QW
Qwen3.5 0.8B uncensored
Qwen · lainlives
Params752M
Context256K
Q4_K_M0.5 GB
Vision
WI
WizardCoder Python 7B V1.0
Wizardcoder · lainlives
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama OuteTTS 1.0 1B
Llama · lainlives
Params1.25B
Context128K
Q4_K_M0.8 GB
GGUF
QW
Qwen3.5 9B Python Coder
Qwen · lainlives
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
QW
Qwen3.5 4B
Qwen · lainlives
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen3.5 4B Heretic
Qwen · lainlives
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
GE
Gemma3 Code Reasoning 4B
Gemma · lainlives
Params3.88B
Context128K
Q4_K_M2.5 GB
CodingReasoning
OM
QCoder
Omnicoder · lainlives
Params8.95B
Context256K
Q4_K_M5.6 GB
Coding
QW
Qwen3 Coder 30B A3B Instruct_Pruned_REAP 15B A3B SafeTensors
Qwen · lainlives
Params16B
Context256K
Smallest17.1 GB
Coding
QW
Qwen3 Coder 30B A3B IT Heretic
Qwen · lainlives
Params30.5B
Context256K
Smallest21.7 GB
Coding
QW
Qwen3 TTS 12Hz 1.7B CustomVoice
Qwen · lainlives
Params1.91B
Context—
Smallest2.4 GB
GGUF
QW
Qwen2.5 coder thinking 14b
Qwen · lainlives
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingReasoningTool use
QW
Qwen3 ASR 1.7B
Qwen · lainlives
Params2.35B
Context—
Smallest2.4 GB
GGUF
QW
Qwen3.6 27B Fable Fusion 711 Uncensored Heretic NM DAU MTP
Qwen · lainlives
Params27.3B
Context256K
Smallest10.9 GB
CodingReasoningRoleplay
QW
Qwen3 ASR
Qwen · lainlives
Params938M
Context—
Smallest0.8 GB
GGUF
QW
Qwen3-TTS-12Hz-0.6B
Qwen · lainlives
Params906M
Context—
Smallest1.3 GB
GGUF
QW
Qwen3-ASR-0.6B
Qwen · lainlives
Params938M
Context—
Smallest1.1 GB
GGUF
QW
Qwen3.5 25B REAP A3B Coding
Qwen · lainlives
Params25.1B
Context256K
Q4_K_M15.4 GB
GGUF
QW
Qwen3-ForcedAligner-0.6B
Qwen · lainlives
Params918M
Context—
Smallest0.8 GB
GGUF
QW
Qwen3 PyCoder Instruct
Qwen · lainlives
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Qwen2.5 RP 15B
Qwen · lainlives
Params14.8B
Context32K
Q4_K_M9.0 GB
RoleplayTool use
QW
Qwen3 TTS 12Hz 1.7B VoiceDesign
Qwen · lainlives
Params1.91B
Context—
Smallest2.4 GB
GGUF
QW
Qwen3-TTS-12Hz-0.6B
Qwen · lainlives
Params915M
Context—
Smallest1.3 GB
GGUF
QW
Qwen3 TTS 12Hz 1.7B Base
Qwen · lainlives
Params1.93B
Context—
Smallest2.5 GB
GGUF

About lainlives on Hugging Face

lainlives has published 36 GGUF models that ggufmodels.com tracks, across families such as Qwen, Spark and Exp. The most downloaded are Qwen3 Coder 30B A3B IT Heretic, Qwen3.5 9B Claude 4.6 HighIQ INSTRUCT HERETIC UNCENSORED and Qwen3 Coder 30B A3B Instruct_Pruned_REAP 15B A3B SafeTensors.

The quants lainlives publishes most often are Q8_0 (23), Q4_K_M (18), BF16 (18) and Q5_0 (17). Their Q4_K_M files range from 0.5 to 18.6 GB. Parameter counts run from 752M to 30.5B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has lainlives published?

36 models are listed here, mainly from the Qwen, Spark and Exp families. The most downloaded is Qwen3 Coder 30B A3B IT Heretic.

Which quants does lainlives publish?

The most common are Q8_0 (23 models), Q4_K_M (18 models), BF16 (18 models) and Q5_0 (17 models).

Keep browsing