Skip to content

[FSDP2] Shard eagerly initialized optimizer state - #4142

Open
sdjasj wants to merge 1 commit into
huggingface:mainfrom
sdjasj:agent/fix-fsdp2-adagrad-state
Open

[FSDP2] Shard eagerly initialized optimizer state#4142
sdjasj wants to merge 1 commit into
huggingface:mainfrom
sdjasj:agent/fix-fsdp2-adagrad-state

Shard eager optimizer state with FSDP2 parameters

1762e3f
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs