Move Chicago Taxi Example Benchmarks to Beam orchestrator

[damccorm]

As originally implemented, the Chicago Taxi Example benchmarks for Beam Python SDK rely on on a custom bash script that runs (orchestrates) each of the pipelines that are part of the Chicago Taxi Example.

 

The TFX team recently developed a Beam-based pipeline orchestrator:  https://www.tensorflow.org/tfx/guide/beam_orchestrator

 

The example with Beam orchestrator: https://github.com/tensorflow/tfx/blob/master/tfx/examples/chicago_taxi_pipeline/taxi_pipeline_beam.py

Imported from Jira BEAM-8892. Original Jira may contain additional context.
Reported by: pabloem.

[jainsajal4594-source]

This PR replaces the custom bash orchestration in the Chicago Taxi example with the Beam-based orchestrator introduced by TFX.

This improves maintainability, scalability, and aligns the example with modern Beam orchestration practices.

Fixes: BEAM-8892