Skip to content

Fix index calculation for logits_vocab#2018

Open
erip wants to merge 1 commit intoOpenNMT:masterfrom
erip:master
Open

Fix index calculation for logits_vocab#2018
erip wants to merge 1 commit intoOpenNMT:masterfrom
erip:master

Conversation

@erip
Copy link

@erip erip commented Feb 23, 2026

Attempts to fix issue with empty logits vector when beam_size > 1. Closes #1616

Attempts to fix issue with empty logits vector when beam_size > 1.
@sssshhhhhh
Copy link
Contributor

result.logits_vocab.emplace_back({is_expanded ? std::move(logits_vec[i * _beam_size + k]) : logits_vec[i]});
Should be this I think

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Output tokens logits

2 participants