Skip to content

arpit-kaushal/Web-Scraper-Scrapify-

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🚀 Scrapify - The Ultimate Web Scraper & AI Chatbot

Scrapify is a powerful web application that allows users to scrape text content from any website, summarize the extracted text, and chat with an AI using advanced language models. Whether you're conducting research, analyzing content, or just curious, Scrapify has you covered!


🌟 Features

Web Scraping - Extracts meaningful text from any webpage effortlessly.
AI-Powered Summarization - Generates concise and insightful summaries.
Smart AI Chatbot - Engage in intelligent conversations with contextual awareness.
Model Selection - Switch between Gemma2 💎 and Mixtral 🚀 for different AI experiences.


🛠️ Technologies Used

  • Flask - Backend framework
  • BeautifulSoup - Web scraping
  • Groq API - AI model integration
  • JavaScript, HTML, CSS - Frontend development

📥 Installation

Prerequisites

🔹 Python 3.x
🔹 Pip

Setup Instructions

1️⃣ Clone the repository:

git clone https://github.com/your-repo/scrapify.git
cd scrapify

2️⃣ Install dependencies:

pip install -r requirements.txt

3️⃣ Run the application:

python app.py

4️⃣ Open in browser:

http://127.0.0.1:5000/

🌍 API Endpoints

🏠 Home Page

GET /
Serves the frontend UI.

📝 Scrape & Summarize

POST /scrape

  • Request:
    { "url": "<website_url>" }
  • Response:
    {
      "scraped_text": "Extracted text from the website",
      "summary": "Summarized text output"
    }

💬 AI Chat

POST /chat

  • Request:
    { "message": "User's input", "context": "Scraped content summary" }
  • Response:
    { "response": "AI-generated reply" }

🔄 Model Selection

POST /select_model

  • Request:
    { "model": "Gemma2 💎" | "Mixtral 🚀" }
  • Response:
    { "message": "Model changed to <selected_model>" }

📌 How to Use

1️⃣ Enter a URL and click Scrape and Summarize.
2️⃣ View the extracted text and its summary.
3️⃣ Use the chatbox to interact with the AI assistant.
4️⃣ Select a different AI model for a varied experience.


About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published