SIFT in Rust (WIP)

Just a project to implement SIFT in Rust for https://t.me/computer_vision_uk

Convert video to frames

# Use extract-frames (https://github.com/RustedBytes/extract-frames)
extract-frames -f madrid.mp4 --multicore

# check number of frames
ls -1 frames | wc -l

Compile

cargo build --release

Run SIFT

./target/release/sift-cv frames/ keypoints/

Visualize keypoints

cd sift-viz

cargo build --release

./target/release/sift-viz --images-dir ../frames/ --json-dir ../keypoints/ --output-dir ../frames-viz

Create video from frames with keypoints

ffmpeg -framerate 1 -pattern_type glob -i "segment-*.png" -c:v libx264 -pix_fmt yuv420p output.mp4

Limitations

• Initial Image Upsampling
• Multiple Orientation Assignment
• Exact Contrast Threshold
• Interpolation of Peak Position