Bls cpi download script #1
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* fixed sh script * fixed sh script * fixed cron schedule for oecd and noaagpcc
* ncbi taxonomy data cleaning scripts and unittest * fixed format issues * Update README.md fill in missing subsections * Update README.md add schema documentation on edges * Update format_ncbi_taxonomy_test.py update script * Update tests.sh add json tool test * Update README.md Add documentation around new schema added as part of this import * Rename ncbi_taxonomy_schema.mcf to ncbi_taxonomy_schema.mcf Fix typo in subdirectory name * Update README.md add missing enumeration generated by script to the appropriate subsection of the New Schema section * Update format_ncbi_taxonomy.py add quotes around name for generated enum * Update format_ncbi_taxonomy_test.py revert back to original test script * Update ncbi_taxonomy.tmcf * Update format_ncbi_taxonomy.py * Update ncbi_taxonomy.tmcf * Update README.md * Update README.md * NCBI Taxonomy git comments fix * type fix in README.md file * lint issue fix * Update README.md update the properties subsection to describe all properties included in the import * Update README.md update notes and caveat subsection * NCBI Taxonomy Autorefresh config update * ncbi_taxonomy code fixes * code_refactoring --------- Co-authored-by: Samantha Piekos <spiekos@google.com> Co-authored-by: Samantha Piekos <Samantha.Piekos@isbscience.org> Co-authored-by: hareesh-ms <101345004+hareesh-ms@users.noreply.github.com> Co-authored-by: Avantika Singh <avantikasi@google.com>
* USCensusPEP_Sex cloud fix 20250429 * USCensusPEP_Sex Cloud Fix * README.md update * removed print statement * removed continue statement * 20250506 changes * USPEPSex latest changes
* mount fix * mount issue fixed * lint error fix * lint fix * comment resolved * comment addressed * modified test script * error fix in test script
* WB_CommodityMarket StatVar Configuration Update * Review Comments addressed * updated pvmap
* Us_Federal_Rates Statvar Update Configurations * Us_Federal_Rates modified manifest file
* monthly_retail_sales_pr * remove schema from test data * updated pr * added manifest.json * updated pvmap and metadata * comments addressed * updated manifest.json * updated files * updated files * Logging added to the download script * ran python_format_check * remove commeted line from metadata
* Create a config override for testing * Script to run imports locally or on cloud * review comments * remove debug lines * lint
* Message of changes * Addition of persistent folder of gcs_output path * Addition of persistent folder of gcs_output path * restructured process.py * restructured process.py * restructured process.py * restructured process.py * restructured process.py * folder rename process.py, property addition in manifest.json * py files lint correction * py files lint correction * py files lint correction * try and catch block added in the main method
* Create a config override for testing * Script to run imports locally or on cloud * review comments * remove debug lines * lint * update file comments * update usage
* s_1603 * s_1603 * s_1603
* added bls_ces state download script * addressed review comments * merging state and national script to one * pr comments addressed * added raw data folder * modified readme file * clearing the folder if exists already * Update download_bls_ces_data.py adding logging.fatal * resolving lint issue * updated readme * added method doc * chunk_size was removed by mistake * moved script to us_bls folder * changed the chunk size * addressed PR review comments * adding readme.md file changes * Deleted download script from bls_ces folder * removed readme file from bls_ces * modified script name in readme
…acommonsorg#1350) * BLS_CES and BLS_CES_State autorefresh config update * updated README and added prettytable module in requirements.txt * added curator_email in manifest * Removing the download script from this PR as it is included in datacommonsorg#1319 * changed download script name in manifests * updated download scritpt name in manifest and readme files * Updated the manifest and pvmap * updated script timeout in manifest of BLS_CES_State * Updated running time in manifest * Removed many ignored series from pvmap and updated readme with how pvmap and place mapping is done * Updated test data and modified more accurate data about pvmap generation in readme * reverting requirements.txt * Updated manifest with a linebreak between two commands * Resolved conflict in bls_ces/README.md * Deleting bls_ces/README.md to resolve conflict
…monsorg#1375) * Remove AI modules fomr import-executor to reduce docker size * update libs * use dynamic imports within function * update libs
* rwanda config * rwanda config * refered ethiopia comments * refered ethiopia comments * manifest file * manifest file * manifest file * manifest file * manifest file * manifest file * manifest file * fixed pv_map as per comments
* Add support for column index based pvmap lookup * updated statvar after merging to master
- Add separate flags for genmcf, validation, differ - Add latest_version_override flag - Fail import job on validation failure - Add node_mcf to import input spec
* Allow numeric values for properties with multiple values * Ignore differ output if differ not run * fix typo
* Installing Coogle Cloud CLI * Removed already installed package * Removed echo line
* Fix Cloud Run Jobs logging severity by adding optional cloud logging configuration * Enable cloud logging flag in Cloud Run job deployments
* Installing Coogle Cloud CLI * Removed already installed package * Removed echo line * gsutil fix
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
19 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.