TakeOffCrawler

TakeOffCrawler parses a text and identifies URLs, which are crawled to obtain meta-content like title and description and relevant photos.

Demo

Installation

Add to your Gemfile and run the bundle command to install it.

gem "take_off_crawler", git: "git@github.com:TakeOffLabs/TakeOffCrawler.git"

Requires Ruby 1.9.2 or later.

Usage

To use the gem, run the following command:

rails g take_off_crawler:install
rake db:migrate

This will generate a model called TakeOffCrawler::Links in which we will save all crawled links. Then pass the content of a text field to the controller and get your link objects like this:

@link = TakeOffCrawler.preview content

You can choose to display the content in whatever form you want.