Skip to content

Ost 401 improving projects quality #13

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
spideystreet merged 5 commits into from
Nov 9, 2025
Merged

Ost 401 improving projects quality #13

spideystreet merged 5 commits into from
Nov 9, 2025

Conversation

@spideystreet
Copy link
Collaborator

@spideystreet spideystreet commented Nov 9, 2025 •
edited
Loading

Key changes:

  • README.md: Updated project description and quick start instructions.
  • README.md: Up new AD from the goated zinedine.
  • src/pipeline/assets/core/assets.py: Replaced manual fastText model loading with Dagster resource injection for better performance and maintainability.
  • src/pipeline/definitions.py: Registered the new FastText model resource in Dagster definitions.
  • src/pipeline/resources/fasttext_resource.py: Added FastTextModelResource, a singleton wrapper for language detection shared across assets.

Benefits: Reduces duplication, accelerates model loading, and improves dependency management for language filtering of open-source projects.

@spideystreet spideystreet requested a review from Olyxz16 November 9, 2025 17:34
@spideystreet spideystreet self-assigned this Nov 9, 2025
@spideystreet spideystreet merged commit a078914 into staging Nov 9, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Olyxz16 Olyxz16 Awaiting requested review from Olyxz16

Assignees

@spideystreet spideystreet

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@spideystreet