scrapdata

Tools, tutorials, code and workflows to scrap data from websites.

1. Select the sources from where the data has to be picked.
2. Write code to frame the proper URL to download the html files having data in form of tables, divs, etc.
3. Download the articles.
4. Parse the downloaded articles and seive out(through regex and pattern matching) the data and save the output in the form of csv files.
5. Do analysis of the csv code after loading in the memory through python or R.
6. publish the results using d34js, nbviewer, etc.