Skip to content

TheJoin95/skyscanner-flights-scraping

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Skyscanner Flights Scraping

Retrieve the flights data by an interactive CLI or using a custom API that is interfacing with the skyscanner scraper.

These script is just for personal use and for learning purpose, not for commercial use.

Usage & Setup

Clone this repository and then run:

npm install

Then you can choose which script to execute:

  • index.js
  • index-concurrency.js
  • index-inquirer.js

They do the same work but in some different way:

  • the index.js script accept all the params by CLI. Type node index.js -h to get some help;
  • the index-concurrency.js is a web server with a simple API endpoint to get the flights data. This script can manage concurrency of the skyscanner scraper
  • the index-inquirer.js is an interactive CLI and it's using Inquirer.js

Puppeter

Puppeter is a NodeJS library to interface with the Chromium API.

ExpressJS

Express is a fast and fancy web server in NodeJS.

I've implemented a light web server in the index-concurrency.js script that provide a simple API to get the info about the flights.

Docker

You can run these script using also Docker.

You can refer to the offical (Puppeteer repo)[https://github.com/GoogleChrome/puppeteer/blob/master/docs/troubleshooting.md#running-puppeteer-in-docker].

Contribution

Feel free to contribute by open an issue or creating a pull request.

About

A scraping tool (for personal use, not commercial) to get some information about flights

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages