Search results

Support multiple URL versions per article

Status: Open.

#15 In NewsDiffs/newsdiffs;

· carlgieringer opened on Nov 24, 2017

Address BeautifulSoup warnings

Status: Open.

#14 In NewsDiffs/newsdiffs;

· carlgieringer opened on Nov 16, 2017

Provide some means of a user verifying the scraped contents

Status: Open.

#13 In NewsDiffs/newsdiffs;

· carlgieringer opened on Nov 15, 2017

Update scraping to support checking high frequency articles before completing entire job

Status: Open.

#12 In NewsDiffs/newsdiffs;

· carlgieringer opened on Nov 15, 2017

Indicate article scrape frequency and next scrape threshold

Status: Open.

#11 In NewsDiffs/newsdiffs;

· carlgieringer opened on Nov 14, 2017

Enable users to browse past first page

Status: Open.

#10 In NewsDiffs/newsdiffs;

· carlgieringer opened on Nov 14, 2017

Ensure unicode is used for article text throughout

Status: Open.

#9 In NewsDiffs/newsdiffs;

· carlgieringer opened on Nov 14, 2017

Changes to headline are not tracked correctly

Status: Open.

#8 In NewsDiffs/newsdiffs;

· carlgieringer opened on Nov 8, 2017

OperationalError: (1203, "User newsdiffs already has more than 'max_user_connections' active connections")

bug

Status: Open.

#7 In NewsDiffs/newsdiffs;

· carlgieringer opened on Nov 6, 2017

OSError: [Errno 11] Resource temporarily unavailable: '/afs/sipb.mit.edu/contrib/newsdiffs/web_scripts/articles/2016-05'

bug

Status: Open.

#6 In NewsDiffs/newsdiffs;

· carlgieringer opened on Nov 6, 2017

OSError: [Errno 110] Connection timed out: '/afs/sipb.mit.edu/contrib/newsdiffs/web_scripts/articles/old'

bug

Status: Open.

#5 In NewsDiffs/newsdiffs;

· carlgieringer opened on Nov 6, 2017

Email scraper errors to admins

enhancement

high priority

Status: Open.

#4 In NewsDiffs/newsdiffs;

· carlgieringer opened on Nov 4, 2017