Define PathwaysJob CRD ; construct PathwaysJob object with different deployment modes.#2

Merged

RoshaniN merged 32 commits intomainfrom

develop

Mar 18, 2025

Commits on Mar 11, 2025

Initial commit
RoshaniN
committed
Initial scaffolding from Kubebuilder.
RoshaniN
committed
Simplified working Pathways spec.
RoshaniN
committed
Simplified Pathways spec with constructed JobSet object
RoshaniN
committed
Simplified Pathways spec with constructed LWS and JobSet objects.
RoshaniN
committed
Updates to Pathways LWS spec - RBAC, etc.
RoshaniN
committed
Pathways JobSet client.go example.
RoshaniN
committed
Pathways JobSet Inference using JobSet client.
RoshaniN
committed
Pathways JobSet Inference using JobSet client 2 - working after resource limits and removing tolerations.
RoshaniN
committed
Adding utils - moved RM, Proxy container specs and affinity to utils.
RoshaniN
committed
Added license automatically. Controller code, API structure.
RoshaniN
committed
Some extras.
RoshaniN
committed
Set Pathways as the owner of JobSet.
RoshaniN
committed
Renamed PathwaysAPI to PathwaysJob
RoshaniN
committed
Renamed PathwaysAPI to PathwaysJob 2, changed RBAC references.
RoshaniN
committed
Introduced WorkerSpec and ColocationPolicy.
RoshaniN
committed
Updated Pathways flags.
RoshaniN
committed
Added hostNetwork, removed resources, moved userpodspec to YAML.
RoshaniN
committed
Reconciliation - List JobSets and Create only if the JobSet does not exist.
RoshaniN
committed
Fix reconciliation logic to avoid multiple calls to createJobSet.
RoshaniN
committed
Detailing PathwaysJobStatus definitions.
RoshaniN
committed
Redefined PathwaysJobStatus.
RoshaniN
committed
Simplify and test.
RoshaniN
committed
Update port numbers, topology etc. Evaluate colocate mode.
RoshaniN
committed
Clean up for release.
RoshaniN
committed
Update README, update licenses.
RoshaniN
committed
Generic TPU type, topology and parallelisms; add input validations.
RoshaniN
committed
Install and deploy JobSet along with PathwaysJob. Add comments.
RoshaniN
committed
Add spec maps for concrete validations, fix headless mode, cleanup.
RoshaniN
committed
Adding Codeowners file.
RoshaniN
committed

Commits on Mar 17, 2025

Update images, add annotation. Update sample config YAML to use Python image.
RoshaniN
committed
Change proxy port back to 29000.
RoshaniN
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Define PathwaysJob CRD ; construct PathwaysJob object with different deployment modes.#2

Define PathwaysJob CRD ; construct PathwaysJob object with different deployment modes.#2
RoshaniN merged 32 commits intomainfrom
develop

Commits on Mar 11, 2025

Initial commit

Initial scaffolding from Kubebuilder.

Simplified working Pathways spec.

Simplified Pathways spec with constructed JobSet object

Simplified Pathways spec with constructed LWS and JobSet objects.

Updates to Pathways LWS spec - RBAC, etc.

Pathways JobSet client.go example.

Pathways JobSet Inference using JobSet client.

Pathways JobSet Inference using JobSet client 2 - working after resource limits and removing tolerations.

Adding utils - moved RM, Proxy container specs and affinity to utils.

Added license automatically. Controller code, API structure.

Some extras.

Set Pathways as the owner of JobSet.

Renamed PathwaysAPI to PathwaysJob

Renamed PathwaysAPI to PathwaysJob 2, changed RBAC references.

Introduced WorkerSpec and ColocationPolicy.

Updated Pathways flags.

Added hostNetwork, removed resources, moved userpodspec to YAML.

Reconciliation - List JobSets and Create only if the JobSet does not exist.

Fix reconciliation logic to avoid multiple calls to createJobSet.

Detailing PathwaysJobStatus definitions.

Redefined PathwaysJobStatus.

Simplify and test.

Update port numbers, topology etc. Evaluate colocate mode.

Clean up for release.

Update README, update licenses.

Generic TPU type, topology and parallelisms; add input validations.

Install and deploy JobSet along with PathwaysJob. Add comments.

Add spec maps for concrete validations, fix headless mode, cleanup.

Adding Codeowners file.

Commits on Mar 17, 2025

Update images, add annotation. Update sample config YAML to use Python image.

Change proxy port back to 29000.