NVIDIA Nemotron 3.5 Lightning

NVIDIA Nemotron 3.5 Lightning

latest
Model IDnemotron-3.5-lightning
Compare with other models

NVIDIA Nemotron 3.5 Lightning is an open 30B mixture-of-experts model with 3B active parameters, distilled from Nemotron 3 Ultra and built for the high-volume execution layer of always-on agents - tool calls, result validation, and subagent delegation.

1M Tokens ContextFast InferenceCodingFunction CallingMultilingual
Save 20%
$0.09$0.07/1M

input tokens

$0.36$0.29/1M

output tokens

Cached $0.0086$0.0069/1M cached tokens

from openai import OpenAI # Initialize the OpenAI client with Qubrid base URL client = OpenAI( base_url="https://platform.qubrid.com/v1", api_key="QUBRID_API_KEY", ) stream = client.chat.completions.create( model="nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4", messages=[ { "role": "user", "content": "Explain quantum computing in simple terms" } ], max_tokens=4096, temperature=0.6, top_p=1, stream=True, extra_body={ "enable_thinking": True, } ) for chunk in stream: if chunk.choices and chunk.choices[0].delta.content: print(chunk.choices[0].delta.content, end="", flush=True) print("\n")

Enterprise
Platform Integration

Docker

Docker Support

Official Docker images for containerized deployments

Kubernetes

Kubernetes Ready

Production-grade KBS manifests and Helm charts

SDK

SDK Libraries

Official SDKs for Python, Javascript, Go, and Java

Don't let your AI control you. Control your AI the Qubrid way!

Have questions? Want to Partner with us? Looking for larger deployments or custom fine-tuning? Let's collaborate on the right setup for your workloads.

"Qubrid AI reduced our document processing time by over 60% and significantly improved retrieval accuracy across our RAG workflows."

Enterprise AI Team

Document Intelligence Platform