I'm just starting to look into this for something else. Perhaps have Claude take a screen shot and then it can convert it into text. This way it is not scraping.
Using Claude to Convert Screenshots into Text Instead of Scraping Data | CMAweekly Customer Marketing and Advocacy Slack