A crawler to get news from a brazilian website.
Creating this project to learn and implement a crawler in nodejs.
To run this project, just run the below commands. Assuming you have nodejs installed.
$ git clone https://github.com/mateusduraes/crawler-br-news.git
$ cd crawler-br-news
$ npm install$ node <file.js>The output will look like the below image.
- Install typescript and tslint in project.
- Make it a command line interface.
- Write tests.
- Install husky (git hooks) and configurate precommit and prepush with tslint / 'run tests'.
- Add more brazilian websites.