Data Scraper

A guide to using Tourmaline's data scraper.

On this page, you'll lean about:

• How the data scraper works

• How to use tourmaline dscraper

tourmaline dscraper

tourmaline dscraper <URL> <PATHS_FILE> <REGEX> 

The data scraper included with Tourmaline allows you to scrape lines off of sites. It takes a list of paths to scrape from, then a regex to identify lines to return.

Optional parameters include:

• -o|--outfile <OUTFILE>: The path to the output file.

• -t|--threads <THREADS>: The number of threads to use (defaults to 12).