Skip to content

Commit d68e67d

Browse files
committed
whenxuan: init the vision outlooker attention
1 parent 6ebb15e commit d68e67d

1 file changed

Lines changed: 17 additions & 0 deletions

File tree

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
import torch
2+
from torch import nn
3+
4+
5+
class VisionOutlookerAttention(nn.Module):
6+
"""
7+
The Vision Outlooker Attention Module for Visual Recognition Tasks.
8+
This module implements the attention mechanism for Time Series (1D) and Image (2D) data.
9+
10+
References: "VOLO: Vision Outlooker for Visual Recognition" by Li Yuan, Qibin Hou, et al.
11+
12+
URL: https://arxiv.org/abs/2106.13112
13+
"""
14+
15+
def __init__(self, *args, **kwargs):
16+
super().__init__(*args, **kwargs)
17+
pass

0 commit comments

Comments
 (0)