I tried scraping around 50,000 users, JARVEE got so slow and eventually crashed. That was on a VPS with 1gb of RAM, I now moved to a private server with 12gb.
How much RAM does your computer have?
Updated to 2.5.5.3, cannot understand why “Scrape Tool” doesn’t scrape.
I have to scrape all the followers of a 2K account, I know that is possible as few days ago I scraped a 300K account so…
Now nothing works anymore, from 2K followers sometimes it scrapes 700 out of 2K, sometimes 1.3K. I’m attaching my settings, hoping someone can help me.
First of all, you shouldn’t be using the API full emulation on an account that is dedicated to scraping.
If you go to the Social profile tab --> select the account with the issue --> Click on Actions on selected profiles --> Click on the button below a file with be generated you will most likely find some API blocks that are preventing the account from scraping. also, keep in mind that when using the Scrape additional users’ details option more API calls need to be done and more time the scraping will take.
The more accounts you have setup with the tag “scraping” in your case, the better.
The API calls will be divided across those accounts.
Make sure to enable api call limits for those scraper accounts, I show you how in my other post.
When it doesn’t scrape all the users, go into global tools, ig scrape history, and click “continue from where it left off”. It will continue scraping, but note that the continuation will be in a separate file.
Make sure the target account isn’t private either or you will get a 0.
“Click on the button below a file with be generated you will most likely find some API blocks that are preventing the account from scraping.” is it possible to resent them automatically?
Yeah I know that additional users’ details requires more API calls and I’m good with that, I don’t need to go faster, rather I need go steady (finish the job task)
Going to remove “API Full Emulation” and select “Optimize API call” then, thank you! Will keep you updated!
as you can see the block was supposed to be removed on the 2/5/2020 which is the day when you wrote your update on the forum so even if says 2/5/2020 i would keep it stopped for a few more hours or until the next day, that way i give the account some rest and made sure that the block is removed
that option should be helpful as well, what I recommend is lowering the number of users that you are scrapping, use small batches and you should get better results.