Bump ray from 2.46.0 to 2.50.0

[dependabot]

Bumps ray from 2.46.0 to 2.50.0.

Release notes

Sourced from ray's releases.

Ray-2.50.0

Release Highlights

Ray Data: This release offers many updates to Ray Data, including:

• The default shuffle strategy is now changed from sort-based to hash-based. This will result in much lower peak memory usage and improved shuffle performance for aggregations.
• We’ve added a new expression API enables predicate-based filtering, UDF transformations with with_column, and column aliasing for more powerful data transformations
• Ray Data LLM has a number of new enhancements for multimodal data pipelines, including multi-node tensor and pipeline parallelism support per replica and ability to share vLLM engines across processors.

Ray Core:

Alpha release of Ray Direct Transport (formerly GPU objects) - simply enable it by adding the tensor_transport parameter to the existing native Ray Core API. This keeps GPU data in GPU memory until a transfer is needed, avoiding expensive serialization and copies to and from the Ray object store. It uses efficient data transports such as collective communication libraries (GLOO or NCCL) or point-to-point RDMA (via NVIDIA’s NIXL) to transfer data directly between devices, including both CPUs and GPUs.

Ray Train:

Local mode support for multi-process training with torchrun, enhanced checkpoint management with new upload modes and validation functions

Ray Serve:

• Async Inference alpha release - New Ray Serve APIs for supporting long-running asynchronous inference tasks, such as for video or large document processing. Includes capabilities for using different message brokers, adapters like celery and DLQ.
• Support for replica ranks - Replica level ranks are added for supporting large-model inference use-cases such as wide Data Parallel and Expert Parallel setups.
• FastAPI factory pattern support - Enables using FastAPI plugins that are not serializable via cloudpickle.
• Throughput optimizations - Enable these using the RAY_SERVE_THROUGHPUT_OPTIMIZED environment variable.

RLLib: Add StepFailedRecreateEnv exception for users with unsatisfiable environments

Ray Serve/Data LLM:

Improvements to multi node serving, loading models from remote storages, and sharing resources for efficiency (fractional gpus, sharing gpus on a data pipeline with shared stages)

Ray Libraries

Ray Data

🎉 New Features:

• Expression and Filtering API: New expression API enables predicate-based filtering, UDF transformations with with_column, and column aliasing for more powerful data transformations (#56716, #56313, #56550, #55915, #55788, #56193, #56596)
• Added support for projection pushdown into Parquet reads (#56500)
• New download expression enables efficient loading of data from columns containing URIs with improved performance and error handling (#55824, #56462, #56294, #56852, #57146)
• New explain() API provides insights into dataset execution plans (#55482)
• Added streaming_train_test_split to avoid materialization for train/test splits (#56803)
• Ray Data LLM:
  • Enabled multi-node tensor and pipeline parallelism for LLM processing (#56779)
  • Added chat_template_kwargs parameter for customizing chat templates (#56490)
  • Added support for OpenAI's nested image URL format in multimodal pipelines (#56584)
  • vLLM engines can now be shared across sequential processors for better resource utilization (#55179)
• Enhanced Dataset.stats() output with input/output row counts per operator (#56040)
• Added new metrics for task duration, inputs per task, and output blocks (#56958, #56379)
• Time to first batch metric for better iteration performance monitoring (#55758)
• Added type-specific aggregators for numerical, categorical, and vector columns (#56610)

... (truncated)

Commits

• fc4510f [DOC-127] Cherry-pick (#54254): MVP for OSS Ray labels (#57547)
• 276c75c [Data] Fixed max_retries for hash shuffle (#57575)
• 1228933 [data] Fix errors with concatenation with mixed pyarrow native and extension ...
• 2ece9ff [2.50 CHERRY-PICK][docs] Update SLURM docs with symmetric-run (#56775) (#57565)
• e46fe7e more core code cherrypicks (#57557)
• 8f3bc35 [core] Make Unsubscribe Idempotent (#57546)
• c96f330 [data] deflake sql + consumption + execution_optimizer + issue detection mana...
• bf7133e [data] disable image_embedding_from_jsonl_fixed_size_chaos (#57544)
• 720d9c1 [core] Preserve err type in case of task cancellation due to actor death (#57...
• 93e5a96 change release version (#57536)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Superseded by #146.