Laguna GGUF models

70 GGUF models in the Laguna family, quantized by 50 uploaders. Sizes run from 164M to 226B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
LA
Laguna XS 2.1 APEX
Laguna · mudler
Params33.4B
Context256K
Smallest12.8 GB
Coding
LA
Laguna S 2.1
Laguna · poolside
Params118B
Context1024K
Q4_K_M96.0 GB
GGUF
LA
Laguna XS 2.1
Laguna · poolside
Params33.4B
Context256K
Q4_K_M20.3 GB
GGUF
LA
Laguna S 2.1 APEX
Laguna · Myric
Params118B
Context1024K
Smallest0.7 GB
ReasoningTool use
LA
Laguna-S-2.1
Laguna · huihui-ai
Params118B
Context256K
Smallest53.2 GB
GGUF
LA
Laguna-S-2.1
Laguna · unsloth
Params118B
Context256K
Q4_K_M73.1 GB
GGUF
LA
poolside_Laguna S 2.1
Laguna · lmstudio-community
Params118B
Context256K
Q4_K_M71.2 GB
GGUF
LA
Laguna XS 2.1
Laguna · bartowski
Params33.4B
Context256K
Q4_K_M20.5 GB
GGUF
LA
Laguna S 2.1 Uncensored APEX
Laguna · SC117
Params118B
Context1024K
Smallest2.2 GB
GGUF
LA
Laguna-XS-2.1
Laguna · ggml-org
Params33.4B
Context256K
Q4_K_M19.6 GB
GGUF
LA
Laguna XS 2.1
Laguna · mradermacher
Params33.4B
Context256K
Q4_K_M20.3 GB
GGUF
LA
Laguna S 2.1
Laguna · bartowski
Params118B
Context1024K
Q4_K_M71.8 GB
GGUF
LA
Laguna S 2.1 ROCmFP4 STRIX LEAN
Laguna · kingjones777
Params118B
Context256K
Smallest62.6 GB
ReasoningTool use
LA
Laguna S 2.1 Heretic
Laguna · mradermacher
Params118B
Context1024K
Q4_K_M71.2 GB
GGUF
LA
Laguna XS 2.1 APEX
Laguna · Myric
Params33.4B
Context256K
Smallest12.1 GB
GGUF
LA
Laguna Xs21 Hf
Laguna · AtomicChat
Params33.4B
Context256K
Q4_K_M20.3 GB
ReasoningTool use
LA
Laguna S 2.1
Laguna · AtomicChat
Params118B
Context1024K
Q4_K_M71.2 GB
ReasoningTool use
LA
Laguna XS 2.1
Laguna · mradermacher
Params33.4B
Context256K
Q4_K_M20.3 GB
GGUF
LA
Laguna S 2.1 Uncensored Heretic
Laguna · llmfan46
Params118B
Context1024K
Q4_K_M73.0 GB
Vision
LA
poolside_Laguna XS 2.1
Laguna · lmstudio-community
Params33.4B
Context256K
Q4_K_M20.3 GB
ReasoningTool use
LA
Laguna S 2.1 Uncensored
Laguna · mradermacher
Params118B
Context1024K
Q4_K_M71.2 GB
GGUF
LA
Laguna-S-2.1
Laguna · ggml-org
Params118B
Context1024K
Q4_K_M67.7 GB
ReasoningTool use
LA
Laguna S 2.1 attnQ8 DFlash Q4
Laguna · coolthor
Params118B
Context1024K
Q4_K_M0.7 GB
ReasoningTool use
LA
Laguna S 2.1 Uncensored
Laguna · mradermacher
Params118B
Context1024K
Q4_K_M71.2 GB
ReasoningTool use
LA
Piscina XS.2
Laguna · poolside-laguna-hackathon
Params33.4B
Context256K
Smallest7.6 GB
ReasoningTool use
LA
Laguna XS 2.1 CRACK S3 BF16
Laguna · dealignai
Params33.4B
Context256K
Q4_K_M21.0 GB
ReasoningTool use
LA
Laguna
Laguna · jabbatheduck
Params118B
Context1024K
Q4_K_M71.5 GB
CodingReasoningTool use
LA
poolside Laguna S 2.1
Laguna · wimmmm
Params118B
Context256K
Q4_K_M71.2 GB
ReasoningTool use
LA
Laguna-S-2.1
Laguna · vultr
Params118B
Context1024K
Q4_K_M78.3 GB
ReasoningTool use
LA
Laguna S 2.1 Heretic
Laguna · mradermacher
Params118B
Context1024K
Q4_K_M71.2 GB
ReasoningTool use

About the Laguna GGUF models

Laguna is represented on ggufmodels.com by 70 GGUF models, quantized by 50 uploaders on Hugging Face. The most downloaded are Laguna XS 2.1 APEX, Laguna S 2.1 and Laguna XS 2.1. Parameter counts run from 164M to 226B, and the longest trained context window is 1024K tokens.

A Q4_K_M file of a Laguna model is between 0.3 to 136.1 GB, which is the quant most people start with. Most files come from mradermacher (6), poolside-laguna-hackathon (3) and Lucebox (3). The quants you will meet most often are Q4_K_M (35), Q8_0 (23), Q6_K (22) and Q5_K_M (16), where the number is how many models offer that quant.

Frequently asked questions

Which Laguna GGUF should I download?

The most downloaded Laguna GGUF here is Laguna XS 2.1 APEX. Pick the size that fits your GPU first, then choose a quant: Q4_K_M is the usual starting point, and Q5_K_M or Q6_K give more quality if you have memory to spare. The VRAM pages below list what fits each GPU.

How much VRAM does a Laguna model need?

Q4_K_M files of Laguna models on this site range from 0.3 to 136.1 GB. Add the KV cache for your context length and about 0.5 GB for the runtime, which usually means 1.5 to 3 GB on top of the file at an 8K context.

Where do Laguna GGUF files come from?

The most common quantizers here are mradermacher, poolside-laguna-hackathon and Lucebox. They convert the original model and publish quantized files on Hugging Face. ggufmodels.com does not host files; every download button opens Hugging Face.

Keep browsing