I am using python requests to get itunes URL responses.
for some links it works and for others it doesn't, for example:
not working - https://itunes.apple.com/app/id1029783189?mt=8 (getting a 404 error)
I noticed that the difference between the 2 links is that if i paste the working one in the browser, it opens it correctly, and if i paste the non-working one, it tries to open itunes and get stuck.
I tried few user-agents, for example:
"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:57.0) Gecko/20100101 Firefox/57.0"
"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3188.0 Safari/537.36"
Since spoofing a user agent isn't enough for my python tool to appear like a web browser, Is there something else I can try?