Swin Transformer

Swin Transformer (Shifted Window Transformer) is a hierarchical vision transformer that computes self-attention within local windows while allowing for cross-window connections. It introduces a shifted windowing scheme to enhance the model's ability to capture long-range dependencies and improve performance on various computer vision tasks.

Link: Link to the original paper