I offer a built-in web scraper program that I've completed for several months. The Web scraper will be linked to the target site that is specified in the program and the source code of the site will be sent to the database where the following information is processed and extracted from the entire source code:Telephone numberE-mail adressProduct priceProduct nameetc., there are several examples of various websites with different types of information for e-shops with electronics, clothing.The HTTP site can be used with Arduino and Ethernet shield W5100 or Wiznet Ethernet module W5500. For HTTPS pages, ESP8266 (eg NodeMCU) or ESP32 - DevKit can be used. All the boards read the web after the characters and the rows of the site are sent to the database where they are processed by the next PHP file on the side of the site for data slicing. So it is necessary to have a webserver on the Internet or on the local network. Data downloads PHP using regular expressions.As each of the above boards connects to the site and reads only the source code - can not run client-side scripts, so the board is not visible in different applications like Google Analytics, Smartlook, and so on, the crawler ban risk is minimized. The program works by plugging it into the Web once per hour, downloading the source code, and sending it back to parts.The ESP32 can also be connected to the corporate network under the 802.1x protocol. ESP8266 supports PSK encryption of wifi networks. I'll explain everything, show what and how it works. Uploading the program is a 20 second question. The program also includes a watchdog when it restarts the board to restart it. It's important for the information to be found in the source code of the page to retrieve the data.E-mail: martinius96@gmail.comWebsite: https://arduino.php5.sk