Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
# SuperCATs
For more information, check out the paper on [paper link](https://ieeexplore.ieee.org/document/9954872). Also check out project page here [Project Page link].<br>
# **SuperCATs** : Cost Aggregation with Transformers for Sparse Correspondence
For more information, check out the paper on [[paper link]](https://ieeexplore.ieee.org/document/9954872). Also check out project page here [[Project Page link]](https://ku-cvlab.github.io/SuperCATs/).<br>
*This paper is accepted in ICCE-Asia'22*

<img src="fig/result1.png" height="300" width="400"> <img src="fig/result2.png" height="300" width="400">
<img src="fig/result1.png" height="300" width="400"> <img src="fig/result2.png" height="297" width="400">

>**Cost Aggregation with Transformers for Sparse Correspondence** <br><br>
>Abstract : In this work, we introduce a novel network, namely SuperCATs, which aims to find a correspondence field between visually similar images. SuperCATs stands on the shoulder of the recently proposed matching networks, SuperGlue and CATs, taking the merits of both for constructing an integrative framework. Specifically, given keypoints and corresponding descriptors, we first apply attentional aggregation consisting of self- and cross- graph neural network to obtain feature descriptors. Subsequently, we construct a cost volume using the descriptors, which then undergoes a tranformer aggregator for cost aggregation. With this approach, we manage to replace the handcrafted module based on solving an optimal transport problem initially included in SuperGlue with a transformer well known for its global receptive fields, making our approach more robust to severe deformations. We conduct experiments to demonstrate the effectiveness of the proposed method, and show that the proposed model is on par with SuperGlue for both indoor and outdoor scenes.
Expand All @@ -15,7 +15,7 @@ Structure of Transformer Aggregator is illustrated below:
![aggregator](fig/aggregator.png)

# Training
To train the SuperGlue with default parameters, run the following command:
To train the SuperCATs with default parameters, run the following command:
```
python train.py
```
Expand Down
212 changes: 0 additions & 212 deletions sjlee_backup/IMC.py

This file was deleted.

Loading