user avatar
Simplify inheritance layers (#639)
Nikolay Bashlykov authored
* remove LanguageModel

* remove TransformerDecoder

* remove TransforemrDecoderLayer

* lint update

* remove MultiheadAttention -> ModelParallelMultiheadAttention

* updated the test_hf_compatibility.py

* update test documentation

---------

Co-authored-by: default avatarNikolay Bashlykov <nikbash@fb.com>
905f355e
Name Last commit Last update