Web Scraping Data with Chrome extension Web Scraper: How to click to next page.

1,544 Views | 0 Replies | Last: 9 yr ago by CrottyKid
CrottyKid
How long do you want to ignore this user?
AG
Hi Guys,
You computer folks might know how to do this easier than what I'm making it, but here is the deal.

I'm using the data mining extension "Web Scraper" in Chrome to get text off of Topsy.com which displays back tweets resulting from any given search criteria. The extension simply copies the elements that you wish to copy and puts it in a table that you can download as a CSV file. Topsy only displays 10 resulting tweets per page. As such, the way I'm using Web Scraper only gives me 10 results for that particular URL. I don't know and can't figure out how to tell Web Scraper to click to the next page and do the same thing.

Do some of you have experience with this or can you suggest an easier way to do this for a non-programmer?


Thanks.
CrottyKid
How long do you want to ignore this user?
AG
Nevermind. Figured it out.
Refresh
Page 1 of 1
 
×
subscribe Verify your student status
See Subscription Benefits
Trial only available to users who have never subscribed or participated in a previous trial.