lundi 13 août 2018

Real time web scraping with Java

I have already done a demo program to scrape through static websites, but what about websites that continuously change their data? ex. https://www.oanda.com/currency/live-exchange-rates/

How should I approach my problem?

The only way that comes in mind is to send 200 requests per second but wont I get banned?

How does the browser deal with such websites and how can I replicate that in Java code?




Aucun commentaire:

Enregistrer un commentaire