• dianaml0's avatar
    Add flash attention (#387) · 3f52fa9d
    dianaml0 authored
    * flash attn changes
    * allow specifying specific xformers op
    * make optional xformers import
    * change attention variant to be enum
    3f52fa9d