vendredi 20 février 2015

Looking for a good/reliable API for non GUI website interaction

Basically I want to gather statistics of searches on various search engines (google, yahoo, etc), I want to check how many searches of specific phrases/words wore made and store the information in a file, then use this information for article tagging on my website. Until now I was doing this by hand using Google Trends.


Basic requirements are:




  • Login




  • Manipulating HTML DOM Elements including opening spans/showing forms(basically taking any action needed to reveal the needed form)




  • Editing fields of a form(mostly for the data input)




  • Submitting forms




  • Retrieving relevant information from the webpage after form submission




Java API is prefered but not a must, basically any language will do as long as the API is "transparent" and simple enough so I wont have to spend days learning how to work with it.


I looked at this question which suggested the use of selenium for this king of purpose, it seems good enough to try it. But since its a year old question I was wondering if there are another options.





Aucun commentaire:

Enregistrer un commentaire