scratch.txt

To get readmes for the sampled projects
for i in {0..127}; do zcat /da?_data/basemaps/gz/lc2PdatFullV"$i".s | grep -iFf 'all-selected_repositories.txt' | cut -d\; -f2,6 | awk -F\; '{print $2";"$1}' ; done | lookup/lsort 100G -t\;  > temp.out
for the 128 files; look at the last commit 2 Project map | get any and all of the projects in the sample | keep only the data we need | rearrange the columns (sort only works on the first column) | sort ; finish the loop > save in a temp file

for i in {0..127}; do cat temp.out | join -t\; - <(zcat /da?_data/basemaps/gz/t2allFullV"$i".s | grep -iF "readme") ; done > t2read
for i in {0..3}; do cat temp.out1 | join -t\; - <(zcat /da?_data/basemaps/gz/t2allFullV"$i".s | grep grep -iE ";/(readme$|readme\.)" | grep -iFf 'all-selected_repositories.txt') ; done > t2read &

sed -i 's|\r||' file


tmux (run virtual sessions)