chore(release): bump version to 0.3.2 and add tokenizers dependency

[calebevans]

Description

Explicitly require tokenizers>=0.20.0 to prevent pip from selecting v0.10.3 which needs Rust compiler for source builds. Ensures prebuilt wheels are used for installations.

Summary by CodeRabbit

• Chores
  • Updated project version to 0.3.2.
  • Added tokenizers>=0.20.0 as a dependency.

_{✏️ Tip: You can customize this high-level summary in your review settings.}

[coderabbitai]

📝 Walkthrough

Walkthrough

Version bump to 0.3.2 with addition of tokenizers>=0.20.0 as a new dependency. Version string updated in both pyproject.toml and the package's init.py file.

Changes

Cohort / File(s)	Summary
Version and Dependency Updates pyproject.toml, src/cordon/__init__.py	Version bumped from 0.3.1 to 0.3.2 across configuration and package metadata. New dependency tokenizers>=0.20.0 added to project requirements.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Poem

🐰 A tiny hop, a version bump so sweet,
New tokenizers join the meet,
From 0.3.1 to 0.3.2 we go,
Dependencies bloom, the codebase will grow! ✨

🚥 Pre-merge checks | ✅ 3

✅ Passed checks (3 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title directly and clearly summarizes the main changes: bumping version to 0.3.2 and adding the tokenizers dependency, matching the actual modifications in the changeset.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing touches

• 📝 Generate docstrings

---

---

📜 Recent review details

Configuration used: defaults

Review profile: CHILL

Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 433e9d7 and 93b7ded.

📒 Files selected for processing (2)

• pyproject.toml
• src/cordon/__init__.py

⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (6)

• GitHub Check: Test (Python 3.12)
• GitHub Check: Test (Python 3.11)
• GitHub Check: Container build
• GitHub Check: Test (Python 3.13)
• GitHub Check: Test (Python 3.10)
• GitHub Check: Pre-commit checks

🔇 Additional comments (3)

src/cordon/__init__.py (1)

5-5: LGTM!

Version string correctly updated to 0.3.2, consistent with pyproject.toml.

pyproject.toml (2)

3-3: LGTM!

Version bump to 0.3.2 is consistent with src/cordon/__init__.py.

---

19-19: Good addition to pin tokenizers floor version.

Explicitly requiring tokenizers>=0.20.0 is a sensible approach to prevent pip from resolving to older versions (like 0.10.3) that lack prebuilt wheels and require a Rust compiler. The verification confirms that tokenizers 0.20.0 has 99 prebuilt wheel distributions available, ensuring a smooth installation experience for end users.

_{✏️ Tip: You can disable this entire section by setting review_details to false in your review settings.}

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud