By the way, I’m from Russia and I don’t know much English. I use a translator, so I hope everything will be clear)
So hello everyone. I have been working in automation for more than 6 years. Now many guys have a lot of questions about the fact that the scrapers burn very quickly. They make about 500 + api requests and get to the checkpoint.
In fact, few people know that scrapers can be improved and made so that they can safely make from 10,000 to 20,000 api requests. So I have 3-4 scrapers tied to 12-15 accounts. And the accounts perform the entire limit of actions per day.
As you can see in the screenshots, it’s only 13: 00 in the afternoon. But the accounts have already completed most of the actions. They start work at 04: 30 in the morning and finish by 00: 00 at night.
So, how to pump paper clips?
Register the scraper via Jarvee to the mail without using the phone. That is, register only by email
Take a phone number for rent on SMS activation services. And link 1 phone number to 2 accounts. The main thing here is to find the correct prefixes. I am from Russia and use numbers with the prefixes +7 925, and +7 926. According to my tests, these are the best phone numbers. If you take the others, then in 99% you get to the check point of the 24-hour account verification.
After registering your account, add it to the scrapers in jarvee and start working. This is where the fun begins. After a certain number of api requests on these accounts, you will start receiving checkpoints again, the first one will be a captcha. After you pass it, you will be asked for your phone number again. Your task is to take numbers with good prefixes again. If there is a bad number, you will kill the account. BUT if you pass the checkpoint with a good phone number, the account will continue to work and this time it will make more api requests. (After confirmation, you need to delete the phone number in your profile so that you can enter a new one at the next request)
This way you pump the number of api requests in scrapers. The whole difficulty lies in the fact that when you pass the checkpoint on the phone on the profile for example 5-6 times, you can take a bad number and the account will die. Therefore, accounts that already make more api requests than the previous ones need to be saved. For example, I do this:
When I take the phone number. The first account where I use room is usually fresh account which only registered if the room is good and I didn’t checkpoint for 24 hours, then I take that number and use for the old profile (in 99.9% checkpoint is passed, though sometimes there is a chance to catch the secondary addition of a 24 hour test account)
Bottom line: It’s pretty simple. I think that by the end of the month I will have only 6-10 scrapers, which will make from 15 to 20 000 api requests, and will be able to process 35-45 main accounts