Quantcast
Channel: Active questions tagged selenium - Stack Overflow
Viewing all articles
Browse latest Browse all 97781

Scrape JSON response with Selenium Browser

$
0
0

I want to make automaticaly the following actions: I open a web page with Google Chrome. I wait for it to render me all the needed information. Then I go to Inspect Element, tab Network, and looking at XHR requests. I find the file that I need, and I copy the content of its response (to save it in a txt file).

It's kind of web scraping, but with less effort (how I think).

The problem is that I cant find what tools allow me to do that.

I started with Python and Selenium (chrome driver). But didn't found any info, is it possible to get XHR responses or not. All the tutorials are about scraping HTML. It seems logic to be possible, but my research didn't helped.

Any idea?

Thank you.


Viewing all articles
Browse latest Browse all 97781

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>