feat: add allow_no_gpu option to skip GPU requirement during ingest#1668
Open
tomer-levin-nv wants to merge 8 commits intoNVIDIA:mainfrom
Open
feat: add allow_no_gpu option to skip GPU requirement during ingest#1668tomer-levin-nv wants to merge 8 commits intoNVIDIA:mainfrom
tomer-levin-nv wants to merge 8 commits intoNVIDIA:mainfrom
Conversation
jperez999
requested changes
Mar 20, 2026
nemo_retriever/src/nemo_retriever/utils/ray_resource_hueristics.py
Outdated
Show resolved
Hide resolved
jperez999
approved these changes
Mar 20, 2026
tomer-levin-nv
force-pushed
the
feat/allow-no-gpu-ingest
branch
2 times, most recently
from
1641ccc to
42eaec6
Compare
Adds an allow_no_gpu flag (default False) to IngestorCreateParams, BatchIngestor, and resolve_requested_plan. When True, skips the "No GPUs available" error and returns a CPU-only RequestedPlan with all GPU allocations set to 0.0. Made-with: Cursor
Made-with: Cursor
Made-with: Cursor
Made-with: Cursor
Made-with: Cursor
…rn for no-GPU path Made-with: Cursor
tomer-levin-nv
force-pushed
the
feat/allow-no-gpu-ingest
branch
from
42eaec6 to
18bb25a
Compare
Made-with: Cursor
Made-with: Cursor
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds an allow_no_gpu flag (default False) to IngestorCreateParams, BatchIngestor, and resolve_requested_plan. When True, skips the "No GPUs available" error and returns a CPU-only RequestedPlan with all GPU allocations set to 0.0.
Made-with: Cursor
Description
Checklist