Merge requests · Administrator / metaseq

Automatically detect and skip loss spikes

!521 · created Nov 17, 2022 by Administrator bigbig cla signed
- MERGED
- 17
updated Dec 02, 2022
update sklearn package name in setup 0 of 4 checklist items completed

!520 · created Nov 17, 2022 by Administrator cla signed
- MERGED
- 2
updated Nov 23, 2022
[Cleanup] checkpoint_utils: remove opena pathmanager logic

!519 · created Nov 16, 2022 by Administrator cla signed
- 0
updated Nov 16, 2022
Add a script to benchmark generator

!518 · created Nov 15, 2022 by Administrator cla signed
- 10
updated Jan 06, 2023
Adding relu for seq par

!517 · created Nov 14, 2022 by Administrator cla signed
- MERGED
- 7
updated Nov 16, 2022
added way to skip batches based on Peters previous PR

!515 · created Nov 13, 2022 by Administrator cla signed
- MERGED
- 4
updated Dec 15, 2022
Add headers

!514 · created Nov 12, 2022 by Administrator cla signed
- MERGED
- 3
updated Nov 14, 2022
[qol] Slightly prettier logging.

!513 · created Nov 11, 2022 by Administrator cla signed
- CLOSED
- 5
updated Jan 16, 2023
Recommit dynamic config 0 of 4 checklist items completed

!512 · created Nov 11, 2022 by Administrator cla signed
- 0
updated Nov 22, 2022
[wip] Adding flash attention for sequence parallel 0 of 6 checklist items completed

!511 · created Nov 11, 2022 by Administrator cla signed
- 1
updated Jan 21, 2023
[distributed] Custom rendezvous

!510 · created Nov 11, 2022 by Administrator cla signed
- MERGED
- 3
updated Nov 11, 2022
Revert "Added dynamic configs (profiling) (#473)"

!509 · created Nov 11, 2022 by Administrator cla signed
- MERGED
- 3
updated Nov 11, 2022
Unify sweep.py and slurm.py between metaseq and metaseq-internal

!507 · created Nov 11, 2022 by Administrator cla signed
- 5
updated Feb 12, 2023
Switch to env init instead of tcp

!506 · created Nov 10, 2022 by Administrator cla signed
- CLOSED
- 0
updated Nov 10, 2022
Add args check for seq par

!505 · created Nov 10, 2022 by Administrator cla signed
- MERGED
- 2
updated Nov 10, 2022
Remove gloo pg for now, tcp issue

!504 · created Nov 09, 2022 by Administrator cla signed
- MERGED
- 2
updated Nov 09, 2022
Include run id in train.log

!503 · created Nov 09, 2022 by Administrator cla signed
- 1
updated Feb 12, 2023
Split to multiple sbatch copy jobs

!502 · created Nov 09, 2022 by Administrator cla signed
- MERGED
- 6
updated Nov 09, 2022
Fix verify shards - to fix resuming from checkpoint

!501 · created Nov 08, 2022 by Administrator opt_instruct cla signed
- MERGED
- 4
updated Nov 09, 2022
Allow to skip batches during training

!500 · created Nov 08, 2022 by Administrator cla signed
updated Feb 12, 2023