Smart Document Categoriser & Extractor

Author: Bilal Mustafa
Status: 🚧 In Development
Last Updated: 28-09-2025
Live URL: LIVE URL

📋 Project Overview

Build a Flask web app where users can upload documents (PDFs, images, etc.). The app scans for viruses, extracts text using Amazon Textract, categorises the content using Amazon Comprehend, and stores metadata and files in S3. Notifications are sent via SES, and the app is containerised and deployed using ECR + ALB.

🎯 Project Goals

• Primary Goal: Create a secure document processing pipeline
• Secondary Goal: Implement intelligent document categorisation
• Final Goal: Deploy scalable containerised solution on AWS

🏗️ Architecture Components

Core Components Status

Component	Status	Notes	Documentation
Flask Frontend	🚧 Started	Simple UI for file upload and status display	Link to docs/
Virus Scanning	⏳ Not Started	ClamAV or third-party API integration	Link to docs/
File Storage (S3)	🚧 Started	Store clean files and metadata	Link to docs/
Text Extraction (Textract)	⏳ Not Started	Extract text from PDFs and images	Link to docs/
Content Analysis (Comprehend)	⏳ Not Started	Language detection, entity extraction, classification	Link to docs/
Notification System (SES)	⏳ Not Started	Email confirmations and results	Link to docs/
Containerisation & Deployment	✅ Started	Docker + ECR + Fargate + ALB	Link to docs/

Status Legend

• ⏳ Not Started - Component not yet implemented
• 🚧 In Progress - Currently working on this component
• ✅ Completed - Component fully implemented and tested
• 🔧 Needs Review - Implementation complete, needs testing/review
• ❌ Blocked - Cannot proceed due to dependencies or issues

🔧 AWS Services Implementation

Service	Purpose	Implementation Status	Configuration Notes
S3	Store uploaded documents	⏳ Not Started	Bucket name: [PRIVATE]
Textract	Extract text from documents	⏳ Not Started	Region: [PRIVATE]
Comprehend	Categorise and analyse content	⏳ Not Started	Custom classifiers: [PRIVATE]
SES	Send email notifications	⏳ Not Started	Verified email: [PRIVATE]
ECR	Store Docker images	✅ Completed	Repository: [PRIVATE]
ALB	Route traffic to Flask app	✅ Completed	Domain: document-categoriser.thecoder97.com
Fargate	Host containerised app	✅ Completed	Instance type: [FARGATE SPOT]

📁 Project Structure

document-categoriser/
├── README.md                 # This file - project overview and progress
├── OnePageIdea.md           # Original project concept
├── docs/                    # 📚 Comprehensive documentation
│   ├── README.md           # Documentation overview
│   ├── architecture/       # System design and architecture
│   │   ├── system-design.md
│   │   ├── aws-services.md
│   │   └── diagrams/
│   ├── development/        # Development guides and setup
│   │   ├── setup.md
│   │   ├── local-dev.md
│   │   └── testing.md
│   ├── deployment/         # Deployment and infrastructure
│   │   ├── docker.md
│   │   ├── aws-deployment.md
│   │   └── ci-cd.md
│   └── api/               # API documentation
│       ├── endpoints.md
│       └── schemas.md
├── src/                    # Source code
│   ├── app.py             # Main Flask application
│   ├── config/            # Configuration files
│   ├── services/          # AWS service integrations
│   ├── utils/             # Utility functions
│   └── templates/         # HTML templates
├── tests/                 # Test files
├── requirements.txt       # Python dependencies
├── Dockerfile            # Container configuration
├── docker-compose.yml    # Local development setup
└── .env.example          # Environment variables template

🚀 Development Milestones

Phase 1: Core Application Setup

• [✅] Set up Flask application structure
• [✅] Create basic file upload interface
• [✅] Implement local file handling
• [✅] Set up logging and error handling
• Target Completion: [29/09/2025]

Phase 2: AWS Integration

• [✅] Configure AWS credentials and permissions
• [✅] Implement S3 file storage
• Integrate Amazon Textract for text extraction
• Add Amazon Comprehend for content analysis
• Target Completion: [05/10/2025]

Phase 3: Security & Notifications

• Implement virus scanning (ClamAV/API)
• Set up Amazon SES for notifications
• Add input validation and sanitization
• Implement error handling and retry logic
• Target Completion: [10/10/2025]

Phase 4: Containerisation & Deployment

• [✅] Create Dockerfile and docker-compose
• [✅] Set up Amazon ECR repository
• [✅] Configure Fargate deployment
• [✅] Set up Application Load Balancer
• [✅] Implement CI/CD pipeline
• [✅] Target Completion: [21/09/2025]

📚 Documentation Structure

The docs/ folder contains comprehensive documentation organized by topic:

• docs/architecture/ - System design, AWS service configurations, and architecture diagrams
• docs/development/ - Setup guides, local development instructions, and testing procedures
• docs/deployment/ - Docker configuration, AWS deployment guides, and CI/CD setup
• docs/api/ - API endpoint documentation and data schemas

Each documentation section will be populated as you implement the corresponding components.

🛠️ Current Development Focus

Currently Working On: PHASE 2

Next Up: PHASE 3

Blockers/Issues: NONE

📈 Progress Tracking

Overall Progress: [X]% Complete

• Phase 1 (Core App): 60% ⏳
• Phase 2 (AWS Integration): 0% ⏳
• Phase 3 (Security & Notifications): 0% ⏳
• Phase 4 (Deployment): 100% ⏳

Recent Updates

• [19/09/2025] - Project template created
• [20/09/2025] - Main Project set in place
• [21/09/2025] - Project dockerised and v1 depoloyed

🔗 Quick Links

• Original Idea - The initial project concept
• Architecture Documentation - Detailed system design
• Setup Guide - Get started with development
• Deployment Guide - Deploy to AWS

📞 Notes & Decisions

Use this space to document important decisions, lessons learned, and notes as you build:

• Project Start Date - 19/09/2025

---