Skip to content

Comments

Add FLOPs tracking for nemotronh#1971

Open
tejasprabhune wants to merge 1 commit intoNVIDIA-NeMo:mainfrom
tejasprabhune:tejas/nemotron-flops
Open

Add FLOPs tracking for nemotronh#1971
tejasprabhune wants to merge 1 commit intoNVIDIA-NeMo:mainfrom
tejasprabhune:tejas/nemotron-flops

Conversation

@tejasprabhune
Copy link

What does this PR do ?

This PR adds FLOPs tracking support for Nemotron-H models (e.g. Nemotron Nano V3).

Issues

List issues that this PR closes (syntax):

n/a

Usage

  • You can potentially add a usage example below
# Add a code snippet demonstrating how to use this
nemotron_flops_config, nemotronh = convert_config_to_flops_config(nemotron_pretrained_config)

Before your PR is "Ready for review"

Pre checks:

  • Make sure you read and followed Contributor guidelines
  • Did you write any new necessary tests?
  • Did you run the unit tests and functional tests locally? Visit our Testing Guide for how to run tests
  • Did you add or update any necessary documentation? Visit our Document Development Guide for how to write, build and test the docs.

Additional Information

  • gated_linear_unit is added to FLOPSConfig as it is needed in _mlp_layer_flops in flops_formulas.py.

@tejasprabhune tejasprabhune requested a review from a team as a code owner February 17, 2026 07:44
Copy link
Contributor

@terrykong terrykong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@guyueh1 to review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants