Skip to content

Download and merge cochrane systematic review databases from dynamically loaded websites

License

Notifications You must be signed in to change notification settings

wmotte/cochrane2019

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

cochrane2019

Background

The Cochrane Database of Systematic Reviews (CDSR) is the leading journal and database for systematic reviews in health care. CDSR includes Cochrane Systematic Reviews. Cochrane Reviews with one or more forest plots provide the raw data as an xml download (rm5 format).

This data is available for everyone - or for those with institutional access in case of restricted reviews - at the right side menu of each Cochrane Review page. An example is provided below:

Example of Cochrane Review with data entry in right-sided menu

Downloading the rm5 files requires ticking of a checkbox, as shown below.

Example of checkbox download

Data scraping

The dynamic loading behavior of the Cochrane pages prevent automatic downloading of rm5 files with previous developed web scrapers. The current scripts use a normal Google Chrome browser to get access to the rm5 files, but automate the procedure of scrawling to the Download section, clicking the proper button and enabling the checkbox.

A list of all Individual Cochrane Reviews have to be provided as input. Files are downloaded in Google Chrome's default Download folder (i.e. ~/Downloads).

Prerequisites

The scripts require:

  • The R statistical software with the package rentrez installed - Used to download the doi urls for all CDSRs.
  • The Javascript runtime Node.js with the package puppeteer installed.
  • Google Chrome - Either use the standard installed version or the puppeteer binary.

License

This project is licensed - see the LICENSE file for details

About

Download and merge cochrane systematic review databases from dynamically loaded websites

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published