Skip to content

Commit 3b2f650

Browse files
authored
Update test_scraper.yml
1 parent e0e3983 commit 3b2f650

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

.github/workflows/test_scraper.yml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ name: test new Reddit Scraper
22

33
on:
44
schedule:
5-
- cron: "11 * * * *" # run every hour at minute 11 (UTC)
5+
- cron: "*/5 * * * *" # run every 5 minutes (UTC)
66
workflow_dispatch: # allow manual run from GitHub UI
77

88
jobs:
@@ -57,7 +57,7 @@ jobs:
5757
df = pd.concat([df_old, df_new], ignore_index=True)
5858
5959
# If you have a unique post ID column, de-duplicate by that
60-
for key in ["ID", "id", "post_id"]:
60+
for key in ["ID", "Text"]:
6161
if key in df.columns:
6262
df = df.drop_duplicates(subset=[key])
6363
break
@@ -115,7 +115,7 @@ jobs:
115115
secure: true
116116
username: ${{ secrets.SMTP_USERNAME }}
117117
password: ${{ secrets.SMTP_PASSWORD }}
118-
subject: "Reddit scraper run – CSVs ready"
118+
subject: "Reddit scraper [TEST]"
119119
to: ra.nike28@gmail.com
120120
from: ${{ secrets.SMTP_USERNAME }}
121121
body: |

0 commit comments

Comments
 (0)