CoronaNet Project Team April 24th, 2020
This repository contains data from the CoronaNet data collection project and also data and code to fit the model described in “A Retrospective Bayesian Model for Measuring Covariate Effects on Observed COVID-19 Test and Case Counts”, link here. Following is first a list of data for the CoronaNet project, with data dictionary, and subsequently a list of files relevant to “A Retrospective Bayesian Model for Measuring Covariate Effects on Observed COVID-19 Test and Case Counts”.
On the CoronaNet Update Tracker, you can track our policy updates by country and subnational unit.
The following plot shows our policy activity index, a set of scores produced by a dynamic measurement model from our data. It is also included in the data release and is a helpful way to reduce the data to a single score. It also permits more straightforward inter-country comparisons.
First, CoronaNet data releases:
Please note that while we make every effort to validate this data, the speed and scale with which it was collected means that we cannot validate all of it. If you find an error in the data, please file an issue on this Github page.
The format of the data is in country-day-record_id format. Some
record_id values have letters appended to indicate that the general
policy category type also has a value for type_sub_cat, which
contains more detail about the policy, such as whether health resources
refers to masks, ventilators, or hospitals. Some entries are marked as
new_entry in the entry_type field for when a policy of that type was
first implemented in the country. Later updates to those policies are
marked as updates in entry_type. To see how policies are connected,
look at the policy_id field for all policies from the first entry
through updates for a given country/province/city. If an entry was
corrected after initial data collection, it will read corrected in the
entry_type field (the original incorrect data has already been
replaced with the corrected data).
-
data/CoronaNet/data_bulk/coronanet_release[.rds/csv.gz]These files contain variables from the CoronaNet government response project, representing national and sub-national policy event data from more than 140 countries since January 1st, 2020. The data include source links, descriptions, targets (i.e. other countries), the type and level of enforcement, and a comprehensive set of policy types. For more detail on this data, you can see our codebook here. -
data/CoronaNet/data_bulk/coronanet_release_allvars[.rds/csv.gz]These files contains the government response information fromcoronanet_release.csvalong with the following datasets:- Tests from the CoronaNet testing database (see http://coronanet-project.org for more info);
- Cases/deaths/recovered from the JHU data repository (https://github.com/CSSEGISandData/COVID-19);
- Country-level covariates including GDP, V-DEM democracy scores, human rights indices, power-sharing indices, and press freedom indices from the Niehaus World Economics and Politics Dataverse (https://niehaus.princeton.edu/news/world-economics-and-politics-dataverse)
-
data/CoronaNet/data_country/coronanet_release_[country].csvFor each country incoronanet_release, we have generated a separate data file in a .csv format. -
data/CoronaNet/data_country/coronanet_release_allvars_[country].csvFor each country incoronanet_release_allvars, we have generated a separate data file in a .csv format.
record_idUnique identifier for each unique policy recordpolicy_idIdentifier linking new policies with subsequent updates to policiesrecorded_dateWhen the record was entered into our datadate_updatedWhen we can confirm the country - policy type was last checked/updated (we can only confirm policy type for a given country is up to date as of this date)date_announcedWhen the policy is announceddate_startWhen the policy goes into effectdate_endWhen the policy ends (if it has an explicit end date)entry_typeWhether the record is new, meaning no restriction had been in place before, or an update (restriction was in place but changed). Corrections are corrections to previous entries.event_descriptionA short description of the policy changedomestic_policyIndicates where policy targets an area within the initiating country (i.e. is domestic in nature)typeThe category of the policytype_sub_catThe sub-category of the policy (if one exists)type_textAny additional information about the policy type (such as the number of ventilators/days of quarantine/etc.)index_high_estThe high (95% posterior density) estimate of the country policy activity score (0-100)index_med_estThe median (most likely) estimate of the country policy activity score (0-100)index_low_estThe low (95% posterior density) estimate of the country policy activity score (0-100)index_country_rankThe relative rank by each day for each country on the policy activity scorecountryThe country initiating the policyinit_country_levelWhether the policy came from the national level or a sub-national unitprovinceName of sub-national unittarget_countryWhich foreign country a policy is targeted at (i.e. travel policies)target_geog_levelWhether the target of the policy is a country as a whole or a sub-national unit of that countrytarget_regionThe name of a regional grouping (like ASEAN) that is a target of the policy (if any)target_provinceThe name of a province targeted by the policy (if any)target_cityThe name of a city targeted by the policy (if any)target_otherAny geographical entity that does not fit into the targeted categories mentioned abovetarget_who_whatWho the policy is targeted attarget_directionWhether a travel-related policy affects people coming in (Inbound) or leaving (Outbound)travel_mechanismIf a travel policy, what kind of transportation it affectscomplianceWhether the policy is voluntary or mandatoryenforcerWhat unit in the country is responsible for enforcementlinkA link to at least one source for the policyISO_A33-digit ISO country codesISO_A22-digit ISO country codes
-
All of the fields listed above, plus
-
tests_daily_or_totalWhether a country reports the daily count of tests a cumulative total -
tests_rawThe number of reported tests collected from host country websites or media reports -
deathsThe number of COVID-19 deaths, aggregated to the country-day level (JHU CSSE data) -
confirmed_casesThe number of confirmed cases of COVID-19, aggregated to the country-day level (JHU CSSE data) -
recoveredThe number of recoveries from COVID-19, aggregated to the country-day level (JHU CSSE data) -
ccodeThe Correlates of War country code -
ifsIMF IFS country code -
Rank_FP(most recent year available from Niehaus dataset) Reporters without Borders Press Freedom Annual Ranking -
Score_FP(most recent year available from Niehaus dataset) Reporters with Borders Press Freedom Score -
state_IDC(most recent year available from Niehaus dataset) State/Provincial Governments Locally Elected -
muni_IDC(most recent year available from Niehaus dataset) Municipal Governments Locally Elected -
dispersive_IDC(most recent year available from Niehaus dataset) Dispersive Powersharing -
constraining_IDC(most recent year available from Niehaus dataset) Constraining Powersharing -
inclusive_IDC(most recent year available from Niehaus dataset) Inclusive powersharing -
sfi_SFI(most recent year available from Niehaus dataset) State fragility index -
ti_cpi_TI(most recent year available from Niehaus dataset) Corruption perceptions index -
pop_WDI_PW(most recent year available from Niehaus dataset) World Bank population -
gdp_WDI_PW(most recent year available from Niehaus dataset) World Bank GDP (total) -
gdppc_WDI_PW(most recent year available from Niehaus dataset) World Bank GDP per capita -
growth_WDI_PW(most recent year available from Niehaus dataset) World Bank GDP growth percent -
lnpop_WDI_PW(most recent year available from Niehaus dataset) Log of World Bank population -
lngdp_WDI_PW(most recent year available from Niehaus dataset) Log of World Bank GDP -
lngdppc_WDI_PW(most recent year available from Niehaus dataset) Log of World Bank GDP per capita -
disap_FA(most recent year available from Niehaus dataset) 3 category, ordered variable for disappearances index -
polpris_FA(most recent year available from Niehaus dataset) 3 category, ordered variable for political imprisonment index -
latentmean_FA(most recent year available from Niehaus dataset) the posterior mean of the latent variable index for human rights protection) -
transparencyindex_HR(most recent year available from Niehaus dataset) Transparency Index -
EmigrantStock_EMS(most recent year available from Niehaus dataset) Total emmigrant stock from -
v2x_polyarchy_VDEM(most recent year available from Niehaus dataset) Electoral democracy index -
news_WB(most recent year available from Niehaus dataset) Daily newspapers (per 1,000 people)
Files to reproduce the paper:
-
retrospective_model_paper/corona_tscs_betab.stan: This Stan model contains a partially-identified model of COVID-19 that permits relative distinctions to be made between areas/countries/states’ infection rates. The parameternum_infected_highindexes the infection rate by time point and country. As the latent process is on the logit scale, it must be converted via the inverse-logit function to a proportion. However, the resulting estimate should not be interpreted as the total infected in a country, but rather a relative ranking of which countries/areas are the most infected up to the current time point. -
retrospective_model_paper/corona_tscs_betab_scale.stan: This Stan model extends the partially-identified model with the 10% lower threshold for tests to infections ratio described in the paper. This model will produce an estimate fornum_infected_highthat when converted with the inverse-logit function will represent the proportion infected in a country conditional on the model’s prior concerning the tests to infections ratio. -
retrospective_model_paper/kubinec_model_preprint.Rmd: A copy of the paper draft with embedded R code. You can access fitted Stan model objects to compile the paper here: https://drive.google.com/open?id=1cTCQTAjH8I-11jp3CEdIJZ0NaGRAn8dT. Otherwise all Stan models must be re-fit to compile the paper. The process will take approximately 2 hours. -
retrospective_model_paper/kubinec_model_SI.Rmd: This file contains an Rmarkdown file with embedded R code showing how to simulate the model. It is the supplementary information for the paper. See the compiled .pdf version as well. -
data: The data folder contains CSVs of tests and cases for US states and other data that were used to fit the models in the paper. -
retrospective_model_paper/BibTexDatabase.bib: This file contains the Bibtex bibliography for the paper.
