I scraped basic user info the other day of 2 million+ of a 13 million follower account in around an hour or so. I didn’t finish scraping because I didn’t need it. The OP was able to scrape 9,999,999 followers with no issues. It took a while, but yeah, thats a lot of scraping anyhow.
If you have specific needs, invest in scrapebox or something along those lines.
Sorry for jumping on your topic, but how can you use this data to your advantage? I red about Scrape Tool on Jarvee website and I am still oblivious to why I would need it/use it/want it.
If you scrape the followers of an account then you can manually filter the data in a spreadsheet instead of getting Jarvee to do it on the fly.
This gives you full control of exactly which users you engage with and allows you to refine your filters offline before you filter out a bunch of potentially good users.
As a brand, this type of filtering allows you to better target your customers.
If you are just going for numbers then it may not be super relevant to you.
Me personally, I do what @Avo mentioned. I filter my lists for spam accounts. Everyday I block at least 15 new CBD profiles becuase they are being used by chinese as spam accounts for my industry. Cant follow them! I will however scrape their following and then add that to my follow queue if they meet my criteria. I LOVE the scrape function and I’m learning to finally love Excel
no tutorial just from previous exprience. its all done manually for now. Export File->-Open in Excel->Organize based on your criteria.
For example for me, I first filter by if theyre a business account or not, delete those that are, then I organize followers by descending order, deleting any user above 1000 followers, then I organize by followings and delete any user with more than 2000 followings, from there the accounts that are left are imported into another sheet that i use as a ‘to follow’ list, i scrub the incoming info against what is already there then delete duplicates-> I’m left with a list of usernames to follow based on my criteria for that one account. Hope it makes sense.
For now all exports from jarvee I am keeping. I am trying to figure out how to put it all into one database that gets updated with the new information from recent scrapes…but from what I’ve seen I might have to create sql database, which I dont know too much about…yet
Mostly manual, but I do have follow set for pre-scrubbed hashtags but my filtering is pretty strict so it runs out of sources quickly and I have to get onto another batch of #'s
Thank you @Interneda did not know about scraping at all. Will try it today. From which account are you scraping? I wonder if I should create an account just for scraping?
Octoparse is a great tool to help with web scraping. Here is a video for your reference: https://www.youtube.com/watch?v=yu8vUFIMYzE&t Maybe you could have it a try if you get interested in it.