Skip to content

Implement CosineAnnealingWarmRestarts LR Scheduler#61

Open
michaelmckinsey1 wants to merge 14 commits intoLBANN:mainfrom
michaelmckinsey1:newsched
Open

Implement CosineAnnealingWarmRestarts LR Scheduler#61
michaelmckinsey1 wants to merge 14 commits intoLBANN:mainfrom
michaelmckinsey1:newsched

Conversation

@michaelmckinsey1
Copy link
Copy Markdown
Collaborator

@michaelmckinsey1 michaelmckinsey1 commented Apr 24, 2026 •
edited
Loading

  • Depends on Improve AMP stability #60
  • Since we sometimes get dice score stuck in local minima, this scheduler will periodically reset LR to jump out of minima

@michaelmckinsey1 michaelmckinsey1 self-assigned this Apr 24, 2026
@michaelmckinsey1 michaelmckinsey1 mentioned this pull request Apr 24, 2026
Closed
2 tasks
@michaelmckinsey1 michaelmckinsey1 mentioned this pull request Apr 30, 2026
Draft
4 tasks
@michaelmckinsey1 michaelmckinsey1 marked this pull request as ready for review April 30, 2026 22:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PatrickRMiles PatrickRMiles Awaiting requested review from PatrickRMiles

At least 1 approving review is required to merge this pull request.

Assignees

@michaelmckinsey1 michaelmckinsey1

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@michaelmckinsey1