🖥️ Try the application here:
👉 https://data-mentor.streamlit.app/
🖥️Read the full article on Medium:
“What’s the best career path for me in Data Science?”
This project answers that question using real job postings, NLP, and LLM-powered reasoning.
This project is an intelligent recommendation system that suggests career paths in Data Science by analyzing a user’s past experiences and matching them with real-world job market trends.
It leverages:
- LinkedIn job postings in the Data Science domain
- BERTopic for topic modeling & word cloud generation
- Google’s Gemini API for understanding user background and inferring best-fit paths
- Collect and analyze up-to-date Data Science job listings
- Discover key trends and competencies using BERTopic
- Accept a user’s personal summary (experience, skills, interests)
- Match the user profile with market demands to suggest a personalized career path
| Component | Tool / Library |
|---|---|
| Data Collection | Selenium, BeautifulSoup (LinkedIn scraping) |
| NLP Modeling | BERTopic, spaCy,N-grams,parameters |
| Semantic Reasoning | Gemini API (Google's LLM) |
| Visualization | WordCloud, c-TF-IDF |
| Deployment | Streamlit |
