Nemotron-3-Nano-4B GGUF

Recommended way to run this model:

llama-server -hf ggml-org/Nemotron-3-Nano-4B-GGUF

Links:

GGUF

Model size

4B params

Architecture

nemotron_h

Hardware compatibility

8-bit

16-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/Nemotron-3-Nano-4B-GGUF

Base model

Finetuned

Finetuned

Finetuned

Quantized

(7)

this model