Skip to content

Commit

Permalink
Hotfix for final step model saving
Browse files Browse the repository at this point in the history
  • Loading branch information
danbraunai committed Dec 1, 2024
1 parent 476acdd commit 9287198
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion simple_stories_train/train_llama.py
Original file line number Diff line number Diff line change
Expand Up @@ -456,7 +456,7 @@ def get_lr(it: int) -> float:
and master_process
and (
(config.intermediate_checkpoints and is_checkpoint_step(step))
or last_step
or step == config.num_iterations - 1
or train_loader_depleted
)
):
Expand Down

0 comments on commit 9287198

Please sign in to comment.