Skip to content

Commit 7bdd1ef

Browse files
committed
whenxuan: init the pyramid squeeze attention
1 parent 0e4bd20 commit 7bdd1ef

File tree

1 file changed

+17
-0
lines changed

1 file changed

+17
-0
lines changed
Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
import torch
2+
from torch import nn
3+
4+
5+
class PyramidSqueezeAttention(nn.Module):
6+
"""
7+
The Pyramid Squeeze Attention Module for Time Series (1D) or Image (2D) Analysis.
8+
This module implements a pyramid squeeze-and-excitation attention mechanism.
9+
10+
References: "EPSANet: An Efficient Pyramid Squeeze Attention Block on Convolutional Neural Network" by Hu Zhang, et al.
11+
12+
URL: https://arxiv.org/abs/2105.14447
13+
"""
14+
15+
def __init__(self, *args, **kwargs):
16+
super().__init__(*args, **kwargs)
17+
pass

0 commit comments

Comments
 (0)