Skip to content

Hardhat-Enterprises/breaking-captcha

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

307 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Breaking CAPTCHA Project

Deakin University Capstone, Trimester 3, 2022

Team members:

Name Role
Luka Croote Project Lead
NGUYEN NGOC BACH LUU Text CAPTCHA R&D
Jamil Rizkallah Audio CAPTCHA R&D
Fenglu Cai Audio CAPTCHA R&D
Ridwan Ganiyu Audio CAPTCHA R&D
Koshila Dodantenna Cloud Engineer
Pavan Andaneppa Yarlagatti Cloud Engineer
Randeep Kaushal Cognitive Reasoning Captcha Research

Project Description

The goal of the Breaking CAPTCHA project is to develop machine learning, AI, and computer vision models to autonomously solve CAPTCHA problems. The final product of the project will be to provide end users with an interface to solve these CAPTCHA problems. The product will also be a pipeline that Developers can use to collaborate on ML experiments. Both These user interfaces (users and ML developers) will be the focus of future iterations.

Deliverables:

  • Machine learning model that will break Audio CAPTCHAs.
  • Progressing the development of a nonsegmentation and OCR model that will break text CAPTCHAs.
  • A showcase website where our products can be described and promoted for consumers.
  • Machine Learning pipeline that allows for better collaboration, experimentation as well as CI/CD.

Team Structure

Repository Operations/Website development:

Contributers: KOSHILA DODANTENNA (kdodantenna@deakin.edu.au)

  • Github Management (structure, maintaining, approving merge requests, etc.)
  • Website Development (design, build, test, prod)

Cloud Development

Contributers: Luka Croote (lcroote@deakin.edu.au)

  • Machine Learning pipeline
  • Existing GCP improvements
  • Product integration

Breaking Audio CAPTCHA

Contributers: RIDWAN GANIYU (rbganiyu@deakin.edu.au), JAMIL RIZKALLAH (jrizkallah@deakin.edu.au), FENGLU CAI (caife@deakin.edu.au)

  • Models to break Audio CAPTCHA

Breaking Text CAPTCHA)

Contributers: NGUYEN NGOC BACH LUU (nnluu@deakin.edu.au)

  • Models to break Text CAPTCHA

Cognitive reasoning Captcha Research

Contributers: RANDEEP KAUSHAL (rkausha@deakin.edu.au)

  • Cognitive reasoning CAPTCHA research

Resource

Usage

Please refer to the relevant Trimester folder to get the most up to date work. NOTE that previous trimester work may still be relevant and only partially continued. Hence when looking for more work to continue please do not limit yourself to only T3 etc. For instance most of the Cloud_Dev work should and can be continued going forward even though it paused largely in T3 in place of a Machine Learning and DevOps Pipeline.

History

T3 2022 is the third implementation of the Braking CAPTCHA project in Deakin University's Capstone program. This trimester the focus on model building remains, however we have an additional focus of building infrastrucure and knowledge management solutions that will transcend trimesters and improve the continuity of the Breaking CAPTCHA project in trimesters to come. This is to support the ultimate outcome of developing an interface to solce CAPTCHA's. The collection of work that was produced in T2 2022 can be found in the Project History folder.

T3 builds upon T2 by

  • Developing new Audio CAPTCHA breaking strategies and programs
  • Developing new Text CAPTCHA breaking strategies and programs
  • Developing a Machine Learning pipeline to complement both R&D and existing Cloud infrastructure
  • Research into cognitive reasoning captchas

Work Locations

  • Machine Learning Pipeline
    • Cloud_Dev/pipeline-framework
  • Audio CAPTCHA
    • Audio_CAPTCHA/...
  • Text CAPTCHA
    • Text_CAPTCHA/...

Operating GitHub (Pull requests)

Why GitHub?

GitHub is a version control system that allows for collaboration amongst team members working on a project. It is also publishing a platform that allows all members to view the changes that have been made to strcture of the project or the code. It enables us to keep track of the codebase, save our projects as it develop and revisit prior points of the project should it be required.

Collaborating Through GitHub

You can use GitHub either via its web version or desktop application. Branches are the central operating mechanism GitHub uses for collaboration. It allows us to have different versions of a repository simultaneously without making an change to the main source of code. The work done on different branches will not show up on the main branch until you merge it, allowing for experimentation with the code.

Pull requests

On the web version of GitHub, you simply have to select the branch you want to work on, be in the 'main' or other branches after which, you will select the edit icon. After adding or making any changes to the code or documentation, scroll down to bottom and select 'Create a new branch for this commit and start a pull request'. Rename the branch any way you'd like and click on 'propose changes'. The following page provides you with an option to 'leave a comment' and you should comment on the exact nature of your changes. This will help other members understand your changes more efficiently. Once done, click 'Create pull request'. It then brings you to a page where you 'push' your changes to the selected branch. Again, it provides you with an option to 'leave a comment' and once you have explained the changes made, select 'Merge pull request' and then select 'Confirm merge'. This step will merge all the changes with the main branch that was selected. Finally, select 'delete branch', which deletes the branch that was copied and you were working on prior to the merge. Go back to the main page to view your changes.

Video guide on operating GitHub

For a step-by-step guide on how to operate GitHub, you can click on this link: https://www.youtube.com/watch?v=RGOj5yH7evk. The link provides a good foundation on understanding not only GitHub but also Git.

GitHub Admin

This documentation will be updated constantly so keep an eye out!!

About

Using AI/ML/DP to break CAPTCHA prompt

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 10