A local Flask web app for parsing ChatGPT conversation transcripts and evaluating them on multiple metrics using the OpenAI API.
- Paste a ChatGPT transcript and have it automatically parsed into turns.
- Removes common boilerplate and export UI junk.
- Analyzes the transcript on:
- Fluency (0–5)
- Coherence (0–5)
- Complexity (0–5)
- Engagement (0–5)
- Frustration (0–5)
- Each metric includes:
- Score
- Confidence (0–1)
- Evidence supporting the score
- Clean, card-based UI with option to view parsed turns.
- All processing runs locally except the OpenAI API call.
- Python 3.8+
- An OpenAI API key
-
Clone the repository:
git clone https://github.com/calvinmacatantan/llm-language-learning cd llm-language-learning -
Create a virtual environment:
python -m venv .venv source .venv/bin/activate # macOS/Linux .venv\Scripts\activate # Windows
-
Install dependencies:
pip install -r requirements.txt
-
Set your API key: Create a
.envfile in the project root:echo "OPENAI_API_KEY=sk-yourkeyhere" > .env
- Run the Flask app:
python app.py
- Open your browser and go to:
http://127.0.0.1:5000 - Paste a ChatGPT transcript into the text area.
- Click Parse & Analyze.
- View the results in the UI.