Project Overview

A lightweight yet powerful automated job intelligence system that scrapes remote job opportunities every hour, stores them in a structured SQLite database, and visualizes everything through an interactive Streamlit dashboard.

Key Features

• Fully automated scraping pipeline using Playwright
• CI/CD integration with GitHub Actions
• Persistent data storage with SQLite
• Advanced search, filtering, and tagging system
• Clean, interactive Streamlit dashboard

Technical Highlights

• Modular and maintainable architecture
• Docker support for consistent deployment
• Smart duplicate detection and data cleaning
• Scheduled hourly updates

This project strengthened my skills in web scraping, automation, data pipelines, and building production-ready internal tools.