feat: Style Guide & Scripts for Extracting Files from Google Drive#19

Closed

avi9664 wants to merge 84 commits intomainfrom

avi-external-etl

Commits on Dec 8, 2025

adding USDA yaml schemas to test LinkML
petercarbsmith
committed
feat:Adding linkml and modifying alembic .env to ensure compatiblity. Everything works I think.
petercarbsmith
committed
adding win-64 to platforms in pixi toml
petercarbsmith
committed
total test

mglbleta
authored and
petercarbsmith
committed
test is our commit message

mglbleta
authored and
petercarbsmith
committed
Removing test file and revising docker setup instructions in README.md

mglbleta
authored and
petercarbsmith
committed
Adding notes to env.example which would've explained points I got confused on.

mglbleta
authored and
petercarbsmith
committed
potentially fixed whitespace

mglbleta
authored and
petercarbsmith
committed
Added explation for @task instruction

mglbleta
authored and
petercarbsmith
committed
trying to commit again
petercarbsmith
committed
feat: attempting to add schemas folder to datamodels module and import sqlalchemy via alembic
petercarbsmith
committed
added a jupyter notebook for playing around with connecting to db
petercarbsmith
committed
fixing alembic migration issues. Commenting out all SQLalchemy stuff for now
petercarbsmith
committed
needed to clear alembic migrations first
petercarbsmith
committed
alembic issue fixed. sqlalchemy commented out for now
petercarbsmith
committed
adding asyncpg to root pixi.toml
petercarbsmith
committed
rebasing to upstream main. Hopefully everythign still works
petercarbsmith
committed
feat: first pass at putting in new linkml schemas. They need to be checked.
petercarbsmith
committed
AI hallucinations are messing up yaml files. Attempting to fix.
petercarbsmith
committed
generated sqla from linkml.STILL NEEDS A CHECK. Next up alembic.
petercarbsmith
committed
feat: generated sqlA now is being read by Alembic and schema was successfully migrated
petercarbsmith
committed
feat: sqla to alembic complete. new pixi task. docs updated.
petercarbsmith
committed

Commits on Dec 9, 2025

quick clean up before push to upstream
petercarbsmith
committed

Commits on Dec 12, 2025

changes to pixi.toml and some comments on linkml schema
mglbleta
committed

Commits on Dec 13, 2025

added some comments to organize and ask questions
mglbleta
committed

Commits on Dec 16, 2025

Commits on Dec 17, 2025

Commits on Dec 19, 2025

Commits on Dec 22, 2025

Commits on Dec 23, 2025

fixed primary_ag_product etl pipeline, modified master flow script and docs
petercarbsmith
committed

Commits on Dec 30, 2025

holiday work. New notebook for importing gsheeets to pandas and playing around
petercarbsmith
committed

Commits on Jan 3, 2026

Commits on Jan 5, 2026

was trying to fix dev container kernel issue. Did not succeed. Also made new ETL notebook and modified some of the gsheet extraction notebook
petercarbsmith
committed

Commits on Jan 6, 2026

modified etl_notebook. Db is now running on localhost
petercarbsmith
committed

Commits on Jan 7, 2026

Commits on Jan 11, 2026

modified engine.py to get correct database url from env
avi9664
committed

Commits on Jan 15, 2026

Commits on Apr 2, 2026

Merge remote-tracking branch 'upstream/main' into avi-external-etl
avi9664
committed