training-llms-megatron

21.8k
davila7davila7

Trains large language models (2B-462B parameters) using NVIDIA Megatron-Core with advanced parallelism strategies. Use when training models >1B parameters, need maximum GPU efficiency (47% MFU on H100), or require tensor/pipeline/sequence/context/expert parallelism. Production-ready framework used for Nemotron, LLaMA, DeepSeek.

Megatron-CoreLarge-Scale TrainingNVIDIA+6
191 days ago

nemo-curator

21.8k
davila7davila7

GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs with RAPIDS. Use for preparing high-quality training datasets, cleaning web data, or deduplicating large corpora.

Data ProcessingNeMo CuratorData Curation+8
191 days ago

nemo-guardrails

21.8k
davila7davila7

NVIDIA's runtime safety framework for LLM applications. Features jailbreak detection, input/output validation, fact-checking, hallucination detection, PII filtering, toxicity detection. Uses Colang 2.0 DSL for programmable rails. Production-ready, runs on T4 GPU.

Safety AlignmentNeMo GuardrailsNVIDIA+7
191 days ago

nemo-evaluator-sdk

21.8k
davila7davila7

Evaluates LLMs across 100+ benchmarks from 18+ harnesses (MMLU, HumanEval, GSM8K, safety, VLM) with multi-backend execution. Use when needing scalable evaluation on local Docker, Slurm HPC, or cloud platforms. NVIDIA's enterprise-grade platform with container-first architecture for reproducible benchmarking.

EvaluationNeMoNVIDIA+8
191 days ago

new-sdg

753
NVIDIA-NeMoNVIDIA-NeMo

Implement a new synthetic data generator using NeMo Data Designer by defining its configuration and executing a preview job.

191 days ago

search-github

753
NVIDIA-NeMoNVIDIA-NeMo

Search GitHub issues, discussions, and PRs for content related to a topic

191 days ago

commit

753
NVIDIA-NeMoNVIDIA-NeMo

Commit current changes with a clear, descriptive message

191 days ago

create-pr

753
NVIDIA-NeMoNVIDIA-NeMo

Create a GitHub PR with a well-formatted description including summary, categorized changes, and attention areas

191 days ago

update-pr

753
NVIDIA-NeMoNVIDIA-NeMo

Update an existing GitHub PR description to reflect current changes after incorporating feedback

191 days ago

search-docs

753
NVIDIA-NeMoNVIDIA-NeMo

Search local documentation in the docs/ folder for content related to a topic

191 days ago

nemo-guardrails

376
a5c-aia5c-ai

NVIDIA NeMo Guardrails configuration for conversational safety and control

191 days ago