Skip to content

Several scripts for extracting data from common webpages.

Notifications You must be signed in to change notification settings

quy1990/crawler_script

 
 

Repository files navigation

Crawler Scripts

Several scripts for extracting data from common webpages.

  1. Spider: simple spider which can fetch all links from the given domain
  2. simple_webpage.py: fetch all links from a website (using regex)
  3. single_webpage_v2.py: fetch all links from a webpage (using BeautifulSoup)
  4. youtube_playlist.py: fetch all urls from a youtube playlist
  5. get_synonyms.py: get a list of synonyms and antonyms for a word
  6. dictionary_lookup.py: look up a word and show the definition
  7. get_weather_forecast.py: check out weather forecast

About

Several scripts for extracting data from common webpages.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%