Scrapper event collector
This system is made up of logstash, spring boot and rabbitmq.
The sequency of operation
0. Logstach read log files of crawler, then send data to the scrapper event collector by rest.
- The other crawler send data to the scrapper event collector by rest directly.
- The scrapper event collector save the received data from crawler and then status data of the crawler send to rabbitmq.