Jeethu
/

gemma-2-2b-it-PLLM

Text Generation

4-bit precision

Model card Files Files and versions

4-bit OmniQuant quantized version of gemma-2-2b-it.

Downloads last month: 3

Model tree for Jeethu/gemma-2-2b-it-PLLM

Base model

google/gemma-2-2b

Finetuned

google/gemma-2-2b-it

Quantized

(169)

this model

Paper for Jeethu/gemma-2-2b-it-PLLM

OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models

Paper • 2308.13137 • Published Aug 25, 2023 • 19