After wasting yet another few hours actively searching for this, and having done it countless times in the past, always fruitlessly, I now ask you:
Is there such a thing as an actual, simple list of the most popular user-agents used by real browsers (not bots)?
Today, the source I have been using for a long time stopped working. It's the only one on the entire known Internet as far as I can tell. For reference, it was: https://techblog.willshouse.com/2012/01/03/most-common-user-agents/ It now just blocks any automated requests I make to it. (They've been infected with the "CloudFlare" cancer, which has made automating anything or even surfing the net impossible.)
There are enormous amounts of very misleading search results, all leading to pages that simply don't provide this whatsoever. There are countless sites just listing every known user-agent known to man, but that's useless. I need only non-bot ones, and only the X most popular ones. Updated (not last updated in 2005). Not trapped inside CloudFlare. Not unparseable. Please.
The irony here is that the link I mentioned above actually has recently added a JSON blob, as if he wants it to be fetched automatically, but again, the page itself can no longer by fetched by any of my (paid!) proxies, and the JSON blob is embedded in a webpage instead of being its own, neat document... So I have no idea what he was thinking with that. Doesn't add up to me.
It almost feels surreal typing this question, because you'd think this would be such a common thing among programmers who simply don't want all kinds of user-agent problems when fetching data. It's bad enough to be harassed by CloudFlare and reCAPTCHA all the time to also have to worry about that user-agent string. And no, I'm not doing anything evil.
PS: I can't use "my own stats" because I have none. I don't run any websites.
Aucun commentaire:
Enregistrer un commentaire