Skip to content

Feature/udemp media pipeline#1466

Merged
omroy07 merged 4 commits intoomroy07:mainfrom
SatyamPandey-07:feature/udemp-media-pipeline
Feb 12, 2026
Merged

Feature/udemp media pipeline#1466
omroy07 merged 4 commits intoomroy07:mainfrom
SatyamPandey-07:feature/udemp-media-pipeline

Conversation

@SatyamPandey-07
Copy link
Contributor

@SatyamPandey-07 SatyamPandey-07 commented Feb 11, 2026

  1. Core Pipeline Infrastructure
    backend/models/media_payload.py
    : Created a centralized database model to track all media uploads (DISEASE, SOIL, CROP, etc.) through their lifecycle (Pending -> Processing -> Completed/Failed).
    backend/services/pipeline_service.py
    : The central orchestrator handling:
    Ingestion: Secure file saving, metadata validation, and database registration.
    Dispatch: Triggers specific Celery tasks based on payload type.
    Result Attachment: Updates the payload with processing results and notifies the user via WebSockets.
    backend/utils/validators.py
    : A cross-module validation utility ensuring strict file integrity (MIME type, size, extension) and metadata completeness before processing begins.
    backend/api/ingestion.py
    : A standardized REST API endpoint (POST /api/v1/ingest/upload) for all media submissions, replacing disparate upload handlers.

  2. Module Integration & Refactoring
    backend/tasks/processing_tasks.py
    : Implemented the unified worker logic. It dynamically loads specialized modules (Disease, Soil) only when needed to optimize memory usage.
    Disease prediction/app.py
    : Refactored the standalone Flask app to act as a proxy to the main UDEMP pipeline. It preserves the existing frontend templates (index.html, result.html) but forwards all prediction requests to the centralized backend, ensuring data consistency and auditability.
    Soil Classification Model/main.py
    : Created a standardized Python wrapper for the soil classification logic (previously locked in notebooks), allowing the backend to programmatically invoke soil analysis.

  3. System Integration
    app.py
    : Registered the new ingestion_bp blueprint to expose the pipeline API.
    backend/models/
    init
    .py
    : Registered the
    MediaPayload
    model for database migrations.

closes #1459

@vercel
Copy link

vercel bot commented Feb 11, 2026

@SatyamPandey-07 is attempting to deploy a commit to the Om Roy's projects Team on Vercel.

A member of the Team first needs to authorize it.

@github-actions
Copy link

Thanks for creating a PR for your Issue! ☺️

We'll review it as soon as possible.
In the meantime, please double-check the file changes and ensure that all commits are accurate.

If there are any unresolved review comments, feel free to resolve them. 🙌🏼

@omroy07 omroy07 merged commit e67992c into omroy07:main Feb 12, 2026
0 of 4 checks passed
@github-actions
Copy link

🎉 Congrats @SatyamPandey-07 on getting your PR merged! 🙌
Thanks for the contribution — looking forward to more from you 🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Unified Data Extraction & Media Pipeline (UDEMP)

2 participants