I want to crawl the site https://www.ups.com/de/de/shipping/surcharges/fuel-surcharges.page. There, the company is giving all fuel surcharges they are adding to invoice amounts. I need the information to correctly calculate some costs. Unfortunately, UPS is currently not willing to send me the data in a readable format on a regular basis. Thus, I thought about crawling the website and getting the information by myself.
Unfortunately, when using postman or my crawling tool rcrawler, the GET request to the site hides the data tables. How could I trick the site to return all the data as it does when using chrome browser?
Aucun commentaire:
Enregistrer un commentaire