# Help with scrapers dying

**URL:** <https://mpsocial.com/t/help-with-scrapers-dying/132651>\
**Category:** Instagram Marketing\
**Created:** [July 28, 2021, 10:52pm UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651 "2021-07-28T22:52:30Z")\
**Posts on this page:** 19\
**Page:** 2

<div class="post-metadata">

**Author:** ![Tal\_Klinger](https://mpsocial.com/user_avatar/mpsocial.com/tal_klinger/32/57780_2.png) [@Tal\_Klinger](https://mpsocial.com/u/Tal_Klinger)\
**Post date:** [August 1, 2021, 3:55pm UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/21 "2021-08-01T15:55:32Z")

</div>

Have you tried increasing your main account to scrapers ratio to 1:10?

---

<div class="post-metadata">

**Author:** ![hakupila](https://mpsocial.com/user_avatar/mpsocial.com/hakupila/32/56946_2.png) [@hakupila](https://mpsocial.com/u/hakupila)\
**Post date:** [August 1, 2021, 4:20pm UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/22 "2021-08-01T16:20:39Z")

</div>

Thats what I am trying right now. I got 80 Main Accounts and 150 Scrapers but my Scrapers can’t “lift” them. So I am going to increase my Scrapers to at least 1:5 and see how it goes.

---

<div class="post-metadata">

**Author:** ![mtvtshirts.com](https://mpsocial.com/user_avatar/mpsocial.com/mtvtshirts.com/32/66207_2.png) [@mtvtshirts.com](https://mpsocial.com/u/mtvtshirts.com)\
**Post date:** [August 1, 2021, 6:31pm UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/23 "2021-08-01T18:31:52Z")

</div>

@anon95987977 which tools are you using on the main account? Maybe you can check which ones is causing the scrapers to do a lot of API calls by turning off all of them and keep only one tool

I have observed that one cycle of follow tool with basic filters causes, on scraper side, 150 API calls on average.

I also observed that 1 scraper can do 500-600 API calls per day before getting EV, PV…

Once you know the cost per cycle of each tool, you can compute how many scrapers you need and do a tradeoff between tools you want to turn on/off and cost of scrapers

---

<div class="post-metadata">

**Author:** ![anon95987977](https://mpsocial.com/letter_avatar_proxy/v4/letter/a/e9bcb4/32.png) [@anon95987977](https://mpsocial.com/u/anon95987977)\
**Post date:** [August 1, 2021, 9:52pm UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/24 "2021-08-01T21:52:34Z")

</div>

Nah. Its only 3:1

Would need thousands of scrapers to do 10:1 and would be very time consuming. My api limits are low and all my accounts do full actions on 3:1.

---

<div class="post-metadata">

**Author:** ![anon95987977](https://mpsocial.com/letter_avatar_proxy/v4/letter/a/e9bcb4/32.png) [@anon95987977](https://mpsocial.com/u/anon95987977)\
**Post date:** [August 1, 2021, 9:54pm UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/25 "2021-08-01T21:54:08Z")

</div>

The ones that usually die, die under 100 api calls. I have very low limits on my scrapers.

I think it was account quality causing issues as a lot were dying on login. Which barely has happened in the past.

---

<div class="post-metadata">

**Author:** ![mykel7mj](https://mpsocial.com/user_avatar/mpsocial.com/mykel7mj/32/56268_2.png) [@mykel7mj](https://mpsocial.com/u/mykel7mj)\
**Post date:** [August 2, 2021, 2:28am UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/26 "2021-08-02T02:28:51Z")

</div>

You can try to not use the accounts right away you have them do random actions first.

 ![image](https://mpsocial.com/uploads/default/original/3X/9/d/9dbd27634ee898f59b5a805178ee857408db9f06.png)

---

<div class="post-metadata">

**Author:** ![anon95987977](https://mpsocial.com/letter_avatar_proxy/v4/letter/a/e9bcb4/32.png) [@anon95987977](https://mpsocial.com/u/anon95987977)\
**Post date:** [August 2, 2021, 2:30am UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/27 "2021-08-02T02:30:18Z")

</div>

Wouldn’t that increase the cpu load lots? Having 100s-1000s of scrapers doing random actions? plus the mains

---

<div class="post-metadata">

**Author:** ![anon95987977](https://mpsocial.com/letter_avatar_proxy/v4/letter/a/e9bcb4/32.png) [@anon95987977](https://mpsocial.com/u/anon95987977)\
**Post date:** [August 3, 2021, 6:13pm UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/28 "2021-08-03T18:13:14Z")

</div>

Yeah I’m using that. Doesn’t seem to change much. Losing 20-30 a day with api calls maxed out at 100 day. About 5-10% of my scrapers a day.

Can use the same accounts and proxies and do full actions on api. Ie 150 follows a day. Yet if they are used as scrapers they die within a few days. So, must be the scraping use causing issues.

---

<div class="post-metadata">

**Author:** ![Brisk0](https://mpsocial.com/user_avatar/mpsocial.com/brisk0/32/36398_2.png) [@Brisk0](https://mpsocial.com/u/Brisk0)\
**Post date:** [August 4, 2021, 11:34am UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/29 "2021-08-04T11:34:47Z")

</div>

What are they doing, are they scraping as they go or you prescrape and use them for other scraper actions?

---

<div class="post-metadata">

**Author:** ![xstaC](https://mpsocial.com/user_avatar/mpsocial.com/xstac/32/53033_2.png) [@xstaC](https://mpsocial.com/u/xstaC)\
**Post date:** [August 4, 2021, 11:49am UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/30 "2021-08-04T11:49:08Z")

</div>

If I have enough scrapers, none die ever.

my settings: i use Full API on childs and 15-20 scrapers per child.

Do not use EB scraping for scrapers, my experience is they die

API only for scraping 🙂

I would assume though you may need 20-25 scrapers per child since you are using EB

I put 50 scrapers per 4G , and I also put 5 of my child accounts on the same proxies. There is no issue here

---

<div class="post-metadata">

**Author:** ![anon95987977](https://mpsocial.com/letter_avatar_proxy/v4/letter/a/e9bcb4/32.png) [@anon95987977](https://mpsocial.com/u/anon95987977)\
**Post date:** [August 4, 2021, 8:07pm UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/31 "2021-08-04T20:07:04Z")

</div>

How many child accounts do you have.

Youd need 5000+ scrapers for only 250 account?  
Seems very expensive. $1750us on scrapers for one jv licence. I have 3.

---

<div class="post-metadata">

**Author:** ![xstaC](https://mpsocial.com/user_avatar/mpsocial.com/xstac/32/53033_2.png) [@xstaC](https://mpsocial.com/u/xstaC)\
**Post date:** [August 4, 2021, 8:27pm UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/32 "2021-08-04T20:27:15Z")

</div>

It’s probably not that many actually. I use 2,700 for every 200 child accounts.

$1750 ?? My scrapers cost me $0.08 each

---

<div class="post-metadata">

**Author:** ![anon95987977](https://mpsocial.com/letter_avatar_proxy/v4/letter/a/e9bcb4/32.png) [@anon95987977](https://mpsocial.com/u/anon95987977)\
**Post date:** [August 4, 2021, 8:33pm UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/33 "2021-08-04T20:33:41Z")

</div>

For that price i isn’t too bad. Ive been trying ones from the marketplace which are more expensive but die just as fast.

Your 4g must be cheap to run that many scrapers on it?

---

<div class="post-metadata">

**Author:** ![GreyHatNik](https://mpsocial.com/letter_avatar_proxy/v4/letter/g/58956e/32.png) [@GreyHatNik](https://mpsocial.com/u/GreyHatNik)\
**Post date:** [August 4, 2021, 8:39pm UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/34 "2021-08-04T20:39:26Z")

</div>

I run a similar set-up and make my own scrapers for about $0.015 a piece. There’s virtually no reason to use 4g to automate them as they’re doomed to perish after 48 - 72 hours anyways. Keep your slaves on 4g but scrapers may as well just be sitting on DCs or at most, residential proxies.

---

<div class="post-metadata">

**Author:** ![anon95987977](https://mpsocial.com/letter_avatar_proxy/v4/letter/a/e9bcb4/32.png) [@anon95987977](https://mpsocial.com/u/anon95987977)\
**Post date:** [August 4, 2021, 8:41pm UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/35 "2021-08-04T20:41:15Z")

</div>

I use residential, DC didn’t work well for me.

I wasn’t getting any scrapers deaths for months until just this past week. Must be something new with IG

---

<div class="post-metadata">

**Author:** ![GreyHatNik](https://mpsocial.com/letter_avatar_proxy/v4/letter/g/58956e/32.png) [@GreyHatNik](https://mpsocial.com/u/GreyHatNik)\
**Post date:** [August 4, 2021, 8:46pm UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/36 "2021-08-04T20:46:07Z")

</div>

Oh yeah, there’s been a flurry of changes since the 17th. Surprised it only started hitting you just this last week.

---

<div class="post-metadata">

**Author:** ![RustyBread](https://mpsocial.com/user_avatar/mpsocial.com/rustybread/32/61249_2.png) [@RustyBread](https://mpsocial.com/u/RustyBread)\
**Post date:** [August 4, 2021, 9:20pm UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/37 "2021-08-04T21:20:55Z")

</div>

@GreyHatNik How are you able to create them for so cheap? Only $0.015 a piece

---

<div class="post-metadata">

**Author:** ![GreyHatNik](https://mpsocial.com/letter_avatar_proxy/v4/letter/g/58956e/32.png) [@GreyHatNik](https://mpsocial.com/u/GreyHatNik)\
**Post date:** [August 4, 2021, 9:33pm UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/38 "2021-08-04T21:33:06Z")

</div>

I have a partnership with a virtual sms provider

---

<div class="post-metadata">

**Author:** ![xhummus](https://mpsocial.com/user_avatar/mpsocial.com/xhummus/32/56713_2.png) [@xhummus](https://mpsocial.com/u/xhummus)\
**Post date:** [August 5, 2021, 10:13am UTC](https://mpsocial.com/t/help-with-scrapers-dying/132651/39 "2021-08-05T10:13:06Z")

</div>

Which type of proxies do you use??

[Previous page](https://mpsocial.com/t/help-with-scrapers-dying/132651.md?page=1)
