Skip to content

Conversation

@dependabot
Copy link

@dependabot dependabot bot commented on behalf of github Aug 5, 2025

Bumps the dependency-packages group with 3 updates in the / directory: datasets, transformers and lm-eval.

Updates datasets from 3.2.0 to 4.0.0

Release notes

Sourced from datasets's releases.

4.0.0

New Features

  • Add IterableDataset.push_to_hub() by @​lhoestq in huggingface/datasets#7595

    # Build streaming data pipelines in a few lines of code !
    from datasets import load_dataset
    ds = load_dataset(..., streaming=True)
    ds = ds.map(...).filter(...)
    ds.push_to_hub(...)

  • Add num_proc= to .push_to_hub() (Dataset and IterableDataset) by @​lhoestq in huggingface/datasets#7606

    # Faster push to Hub ! Available for both Dataset and IterableDataset
    ds.push_to_hub(..., num_proc=8)
  • New Column object

    # Syntax:
    ds["column_name"]  # datasets.Column([...]) or datasets.IterableColumn(...)
    Iterate on a column:
    for text in ds["text"]:
    ...
    Load one cell without bringing the full column in memory
    first_text = ds["text"][0]  # equivalent to ds[0]["text"]

  • Torchcodec decoding by @​TyTodd in huggingface/datasets#7616

    • Enables streaming only the ranges you need !
    # Don't download full audios/videos when it's not necessary
    # Now with torchcodec it only streams the required ranges/frames:
    from datasets import load_dataset
    ds = load_dataset(..., streaming=True)
    for example in ds:
    video = example["video"]
    frames = video.get_frames_in_range(start=0, stop=6, step=1)  # only stream certain frames

    • Requires torch>=2.7.0 and FFmpeg >= 4

... (truncated)

Commits

Updates transformers from 4.46.0 to 4.54.1

Release notes

Sourced from transformers's releases.

Patch release 4.54.1

We had quite a lot of bugs that got through! Release was a bit rushed, sorry everyone! 🤗 Mostly cache fixes, as we now have layered cache, and fixed to distributed.

Patch release v4.53.3

Small path release 4.53.3!

A small patch for open telemetry fixes! Sorry for the delay!

** refactor: remove set_tracer_provider and set_meter_provider calls (huggingface/transformers#39422) from @​McPatate

Patch Release v4.53.2

This patch contains the following bug fixes:

  • Fix some bug for finetune and batch infer For GLM-4.1V (#39090)
  • [bugfix] fix flash attention 2 unavailable error on Ascend NPU (#39166)
  • Fix errors when use verl to train GLM4.1v model (#39199)
  • [pagged-attention] fix off-by-1 error in pagged attention generation (#39258)
  • [smollm3] add tokenizer mapping for smollm3 (#39271)
  • [sliding window] revert and deprecate (#39301)
  • fix Glm4v batch videos forward (#39172)
  • Add a default value for position_ids in masking_utils (#39310)

Patch Release v4.53.1

This patch contains several bug fixes. The following commits are included:

  • Fix: unprotected import of tp plugin (#39083)
  • Fix key mapping for VLMs (#39029)
  • Several fixes for Gemma3n(#39135)
  • [qwen2-vl] fix FA2 inference (#39121)
  • [smolvlm] fix video inference (#39147)
  • Fix multimodal processor get duplicate arguments when receive kwargs for initialization (#39125)
  • when delaying optimizer creation only prepare the model (#39152)
  • Add packed tensor format support for flex/sdpa/eager through the mask! (#39194)

Release v4.53.0

Gemma3n

... (truncated)

Commits

Updates lm-eval from 0.4.5 to 0.4.9.1

Release notes

Sourced from lm-eval's releases.

v0.4.9.1

lm-eval v0.4.9.1 Release Notes

This v0.4.9.1 release is a quick patch to bring in some new tasks and fixes. Looking aheas, we're gearing up for some bigger updates to tackle common community pain points. We'll do our best to keep things from breaking, but we anticipate a few changes might not be fully backward-compatible. We're excited to share more soon!

Enhanced Reasoning Model Handling

  • Better support for reasoning models with a think_end_token argument to strip intermediate reasoning from outputs for the hf, vllm, and sglang model backends. A related enable_thinking argument was also added for specific models that support it (e.g., Qwen).

New Benchmarks & Tasks

Fixes & Improvements

Tasks & Benchmarks:

Backend & Stability:

Housekeeping:

What's Changed

... (truncated)

Commits

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore <dependency name> major version will close this group update PR and stop Dependabot creating any more for the specific dependency's major version (unless you unignore this specific dependency's major version or upgrade to it yourself)
  • @dependabot ignore <dependency name> minor version will close this group update PR and stop Dependabot creating any more for the specific dependency's minor version (unless you unignore this specific dependency's minor version or upgrade to it yourself)
  • @dependabot ignore <dependency name> will close this group update PR and stop Dependabot creating any more for the specific dependency (unless you unignore this specific dependency or upgrade to it yourself)
  • @dependabot unignore <dependency name> will remove all of the ignore conditions of the specified dependency
  • @dependabot unignore <dependency name> <ignore condition> will remove the ignore condition of the specified dependency and ignore conditions

@dependabot dependabot bot added dependencies Pull requests that update a dependency file python Pull requests that update Python code labels Aug 5, 2025
…ory with 3 updates

Bumps the dependency-packages group with 3 updates in the / directory: [datasets](https://github.com/huggingface/datasets), [transformers](https://github.com/huggingface/transformers) and [lm-eval](https://github.com/EleutherAI/lm-evaluation-harness).


Updates `datasets` from 3.2.0 to 4.0.0
- [Release notes](https://github.com/huggingface/datasets/releases)
- [Commits](huggingface/datasets@3.2.0...4.0.0)

Updates `transformers` from 4.46.0 to 4.54.1
- [Release notes](https://github.com/huggingface/transformers/releases)
- [Commits](huggingface/transformers@v4.46.0...4.54.1)

Updates `lm-eval` from 0.4.5 to 0.4.9.1
- [Release notes](https://github.com/EleutherAI/lm-evaluation-harness/releases)
- [Commits](EleutherAI/lm-evaluation-harness@v0.4.5...v0.4.9.1)

---
updated-dependencies:
- dependency-name: datasets
  dependency-version: 4.0.0
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: dependency-packages
- dependency-name: transformers
  dependency-version: 4.54.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: dependency-packages
- dependency-name: lm-eval
  dependency-version: 0.4.9.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: dependency-packages
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot bot force-pushed the dependabot/pip/main/dependency-packages-29f6df3fde branch from 3f2ba57 to 475ee25 Compare August 19, 2025 06:24
@dependabot @github
Copy link
Author

dependabot bot commented on behalf of github Sep 15, 2025

Dependabot tried to update this pull request, but something went wrong. We're looking into it, but in the meantime you can retry the update by commenting @dependabot rebase.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python Pull requests that update Python code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant