Skip to content

Launching parallel tasks #13

Merged
KarenUllrich merged 8 commits intomainfrom
sweeps
Jan 9, 2026
Merged

Launching parallel tasks #13
KarenUllrich merged 8 commits intomainfrom
sweeps

Conversation

@marksibrahim
Copy link
Contributor

  • creates new config_parallel_tasks mirroring config but with additional fields for defining parallel task and app variation combinations
  • create a new slurm_cluster mode for launching on slurm
  • to ensure launcher works on SLURM updated the executable for the subprocess to use executable='/bin/bash' (thank you AI).

Tested with

  1. Check new logic works on SLURM via:
uv run launch_parallel_agents.py mode=slurm_cluster use_wandb=True agent=dummy
  1. Check existing launcher works as expected
uv run launch_agent.py mode=local use_wandb=True agent=dummy

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Meta Open Source bot. label Dec 23, 2025
@KarenUllrich
Copy link
Contributor

PR is functional for me.
I would probably call them sweeps instead of paralel. WDYT?

@KarenUllrich KarenUllrich merged commit a9cb568 into main Jan 9, 2026
2 checks passed
@KarenUllrich KarenUllrich deleted the sweeps branch January 9, 2026 02:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants