Skip to content

Numeric underflow when loss gets small. #13

@dhruvrajan

Description

@dhruvrajan

When training MNIST for > 14 epochs, there seems to be an underflow problem, resulting in NaNs when the loss becomes ~ 7E-3.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions