Skip to content

Scrapes data from shopping websites and watches for the cheapest product. Updates in realtime with lowest priced product

Notifications You must be signed in to change notification settings

ossianpe/WebPriceScraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

WebPriceScraper

Quick description:
Scrapes Amazon for cheapest item and provides SMS/email alert.

Details:
-Main operation:
Program scrapes websites for lowest price. Properties are defined in "ScrapeDirector.java" If item is not the lowest the program will wait for a period of time and refresh the page. This activity will continue indefinitely until an item becomes available with a price equal or lower than the price the user set the parameter to.
-Upon lower priced item listing:
When the item becomes available at or less than the desired value the program will send a SMS and email alert with the defined product name, price, user feedback, condition, and description. After finding a cheaper item, the program will set the lowest price to the price of the lowest priced item - 1 cent and continue to loop for cheaper items that may be listed.

Includes user configurable parameters in ScrapeDirector:

**variable type in brackets is to be replaced with corresponding values.

	Thread parameters include:<br>
		.setProductName("[string]") //Item description to be provided in SMS/email notification<br>
		.setHomePage("[string]") //URL link on Amazon<br>
		.setPhoneNumber("[int]") //Phone number to send notification<br>
		.setEmail("[string]") //Email to send notification<br>
		.setPrice("[int]") //Highest desired price<br>
		.setRefreshRate("[int]") //Refresh page rate (in seconds)<br>

Note:
-Parameters are optional, but, obviously, if the homepage, price, refreshrate are not set the program will produce unexpected results.
-Program runs multi-threaded instances of RunThread so many different items can be watched and parameters can be set.

v2.0

Updates:

Migrated all user-programmable data into "ScrapeDirector.java". Including private data for Twillio. Director now utilizes a nested builder class for optionally determining scrape parameters. Utilized factory class for handling multiple websites. Website is parased and corresponding object is created for each scrape.

Note: Only Amazon scraper works properly.

v1.0:

Details:
-Main operation:
Program scrapes Amazon for lowest price. Price is defined in parameters. If item is not the lowest the program will wait for a period of time and refresh the page. This activity will continue indefinitely until an item becomes available with a price equal or lower than the price the user set the parameter to.
-Upon lower priced item listing:
When the item becomes available at or less than the desired value the program will send a SMS and email alert with the defined product name, price, user feedback, condition, and description. After finding a cheaper item, the program will set the lowest price to the price of the lowest priced item - 1 cent and continue to loop for cheaper items to come available.

Includes user configurable parameters in RunThread:

// Thread parameters:
// (String, //Item description to be provided in SMS/email notify
// String, //URL link on Amazon
// String, //SMS/email address to send notification
// int, //Highest desired price
// int); //Refresh Amazon page rate (in seconds)

Note: Program runs multi-threaded instances of RunThread so many different items can be watched and parameters can be set.

About

Scrapes data from shopping websites and watches for the cheapest product. Updates in realtime with lowest priced product

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published