Skip to content

Scrape video links from YouTube Shorts, TikTok and Instagram Reels based on a specific date range

Notifications You must be signed in to change notification settings

llan0/link-fetcher

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

A lightweight script to scrape video links from YouTube Shorts and TikTok based on a specific date range.


Setup & Configuration

  1. Clone the repo
  2. Configure credentials (refer to config.example.json)
  3. Fill in credentials

YouTube: Requires Google Cloud API Key with "YouTube Data API v3" enabled
TikTok: Requires a RapidAPI key (specifically tiktok)
Instagram: Requires a RapidAPI key (specifically instagram)


Usage

Refer to the included Makefile. Results are saved to the output/ directory

make run-all
make tiktok 
make youtube
make instagram 

Project Structure

.
├── config.example.json   
├── config.json           # local config 
├── go.mod
├── go.sum
├── internal
│   ├── config
│   │   └── config.go    
│   ├── fetcher
│   │   ├── instagram.go  # Instagram implemtation  
│   │   ├── platform.go   
│   │   ├── tiktok.go     # TikTok implementation
│   │   └── youtube.go    # YouTube implementation
│   └── writer
│       └── writer.go     # unified ouptput writer 
├── main.go              
├── Makefile              
└── README.md

TODO

[ ] Better error handling
[ ] Custom output format
[ ] Unify platform logic
[ ] Add tests

About

Scrape video links from YouTube Shorts, TikTok and Instagram Reels based on a specific date range

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published