Webscraping Without Using Selenium, dealing with JSON data in Python

Following on from my last two articles, dealing with web scraping using requests, Today we are focused on how to organize the JSON response objects we get when making those requests.

Link to the full code can be found here

https://github.com/paulc160/PP-IP-Scraper/blob/main/PP%20Ip%20Scraper.ipynb

Before you read this article go back and view my other articles particularly this one which details a couple of different methods to scrape.

How to Scrape websites WITHOUT using Selenium,Instead Using Internal APIs with Python

I am using the simplest method today, by making a get request in Python to an endpoint. We will be scraping PaddyPower here just like the last tutorial, focusing on In-Play football matches.

We begin by making the call to the endpoint as you have seen before and parsing the response page into json.

import requests
import json

# Replace 'your_endpoint_url' with the actual URL you want to call
endpoint_url =…