I have done a lot of scraping of sites for various people and websites.
The problem is that every single website in the world always changes without your knowledge.
But, most websites keep their details, like price links or whatever, so you can sort out the page
in question and scrape it using their “class” system. But, one question would be if this scraper
would be just for your own use or public consumption? If for you own use, no problem, because
if you start getting odd results, just fix the code. If it is to post on a website that others have
access to, it could be an issue.
Often, you just VIEW-SOURCE of the page in question, search for one of the items you want
to scrape and look at the code and move backwards to find the class of the items. The, you
do a global search and find all the items and write scraping code to accomplish this. The code
will not be long or take a lot of time to run once you execute it. You could post the site and what
data you want from it and I or someone here could run you up a script to do it. Just an idea!
