Jamaliaasma
Jamaliaasma asked
Member (0 upvotes)

Can crawling a test website with screaming frog will lead to server 500 issue?

i crawled my test website and after 4 hrs it is not loading plz tell me what can I do to get it back?

#crawling #server
Avatar for member Chedders
Chedders
Moderator (240 upvotes)

you have overloaded your site with requests, you need to reduce the number of threads so you don't hit it so hard.

Better still improve your website so it can handle more requests but that will depend on what setup you have. 

Good advice?
1
0
Comments 0
login to reply
It is showing the 500 server error
Can this harm the website?
I need to clarify to the website owner that is because of using screaming frog or any other issue?
Copyright ©2021 SEOChat. All Rights Reserved.