crawler : Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously. You can installing crawler npm packages, there are two ways to install this module locally and globaly. -g option is specified to global. Execute the below command.
$ sudo npm install crawler $ sudo npm install -g crawler
If want to update the crawler package execute the command as below,
$ sudo npm update crawler
Update package globally,
$ npm install -g crawler
$ sudo git clone https://github.com/rektide/crawler.git
$ sudo npm install -g ./crawler
crawler@1.1.1 /usr/lib/node_modules/crawler
You can uninstall or remove this package from your node_modules run the command as below,
$ sudo npm uninstall crawler
| Package Name | crawler |
| Version | 1.1.1 |
| Description | Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously |
| Released Date | 2017-10-20T02:35:33.965Z |
| Published by | mike442144 |
| How to Learn | https://www.npmjs.com/package/crawler/tutorial |