Merge requests · Administrator / metaseq

Unify code path for metaseq and metaseq-internal

!476 · created Nov 01, 2022 by Administrator cla signed
- MERGED
- 29
updated Nov 04, 2022
Support unified tokenizer file in language modeling task 0 of 4 checklist items completed

!489 · created Nov 04, 2022 by Administrator cla signed
- MERGED
- 2
updated Nov 04, 2022
Re-add supports_rename and rename to PathManager

!478 · created Nov 01, 2022 by Administrator cla signed
- MERGED
- 6
updated Nov 04, 2022
Set pretrain prob to 0 explicitly when it is specified

!487 · created Nov 03, 2022 by Administrator opt_instruct cla signed
- MERGED
- 1
updated Nov 04, 2022
[api] Fix logit outputs

!224 · created Jul 15, 2022 by Administrator cla signed
- MERGED
- 10
updated Nov 03, 2022
Only validate at validate_interval_updates and end of training

!486 · created Nov 03, 2022 by Administrator cla signed
- MERGED
- 2
updated Nov 03, 2022
Run evals during training

!411 · created Oct 14, 2022 by Administrator cla signed
- MERGED
- 21
updated Nov 02, 2022
Return on all matching checkpoint files when caching

!484 · created Nov 02, 2022 by Administrator cla signed
- MERGED
- 2
updated Nov 02, 2022
Simplify checkpoint download logic

!452 · created Oct 25, 2022 by Administrator cla signed
- MERGED
- 11
updated Nov 02, 2022
Add flash attention 0 of 4 checklist items completed

!387 · created Oct 06, 2022 by Administrator cla signed
- MERGED
- 4
updated Nov 02, 2022
Resume on requeue

!474 · created Nov 01, 2022 by Administrator opt_instruct cla signed
- MERGED
- 4
updated Nov 01, 2022
Add full_megatron_init_scalar flag

!466 · created Oct 28, 2022 by Administrator cla signed
- MERGED
- 8
updated Nov 01, 2022
Reenable test_checkpoint_saving.py 0 of 4 checklist items completed

!467 · created Oct 28, 2022 by Administrator cla signed
- MERGED
- 4
updated Oct 28, 2022
Fix extra valid at beginning

!464 · created Oct 28, 2022 by Administrator opt_instruct cla signed
- MERGED
- 2
updated Oct 28, 2022
changes for updating to megatron brnach fairseq_v3

!460 · created Oct 26, 2022 by Administrator cla signed
- MERGED
- 9
updated Oct 28, 2022
Remove different dimension args

!462 · created Oct 27, 2022 by Administrator cla signed
- MERGED
- 2
updated Oct 27, 2022
Fixing 66B checkpoint file names 0 of 4 checklist items completed

!461 · created Oct 26, 2022 by Administrator cla signed
- MERGED
- 2
updated Oct 26, 2022
fixed issue 437 and removed retired profiler

!450 · created Oct 25, 2022 by Administrator cla signed
- MERGED
- 4
updated Oct 26, 2022
remove fixed lr_schedule references

!456 · created Oct 26, 2022 by Administrator cla signed
- MERGED
- 2
updated Oct 26, 2022
Adding Peter as codeowner

!454 · created Oct 25, 2022 by Administrator cla signed
- MERGED
- 2
updated Oct 26, 2022