Sliding-window beats linear attention

 (arxiv.org)

2 points | by simonpure 3 hours ago

1 comments

  • addag 1 hour ago
    Isn't sliding-window a part of linear attention methods?