Python script for crawling API stops for some reason - make suggestions for improvement
- Tình trạng: Closed
- Giải thưởng: $20
- Các bài thi đã nhận: 4
- Người chiến thắng: marioada
Tóm tắt cuộc thi
We're using the below script for making requests with the crawling provider [login to view URL] (the documentation can be accessed here after having created a free account: [login to view URL]).
The script is working well in general, however with one problem remaining: It simply stops working from time to time - sometimes after having successfully crawled a couple of hundred, sometimes only after a couple of thousand URLs. But we can't get it stable to crawl a couple of 10k URLs.
Please make suggestions right in the code - including a comment that describes why you made the change. We'll then test it and award the amount if the change brings the desired result.
Looking forward to your contributions!
Các kĩ năng yêu cầu
Phản hồi của người thuê
“Mario is a great guy and a pleasure to work with!”