Skip to content

feat: add 3 practical web scraping scripts for #92 - #357

Open
rahulrajarapu158-arch wants to merge 1 commit into
powerexploit:masterfrom
rahulrajarapu158-arch:feat/add-web-scraping-scripts
Open

rahulrajarapu158-arch wants to merge 1 commit into
powerexploit:masterfrom
rahulrajarapu158-arch:feat/add-web-scraping-scripts

Conversation

@rahulrajarapu158-arch

Copy link
Copy Markdown

Summary

Adds 3 practical web scraping scripts to the Web-Scraping folder as requested in issue #92:

1. GitHub Trending Scraper (Web-Scraping/GitHub-Trending-Scraper/)

  • Scrapes GitHub trending repositories
  • Supports --language and --since (daily/weekly/monthly) filters
  • Displays repo name, description, stars, forks, language, and URL

2. Weather Forecast Scraper (Web-Scraping/Weather-Forecast-Scraper/)

  • Fetches 3-day weather forecast for any city using wttr.in
  • Shows current conditions + forecast table
  • No API key required

3. Hacker News Scraper (Web-Scraping/HackerNews-Scraper/)

  • Scrapes HN front page stories
  • Supports --limit, --min-score, and --json output
  • Shows title, score, author, comments, and discussion links

Test Plan

  • All scripts have proper argparse CLI interfaces
  • Error handling for network requests (timeouts, HTTP errors)
  • README.md for each script with usage examples
  • Follows repo structure (folder per script with code + docs)

Closes #92

- GitHub Trending Scraper: scrape trending repos with language/time filters
- Weather Forecast Scraper: fetch 3-day weather for any city via wttr.in
- Hacker News Scraper: scrape HN front page with score filtering and JSON output

All scripts include README docs, CLI arguments, and error handling.

Closes powerexploit#92

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add Some Cool Web-Scraping Scripts

1 participant