Jamaliaasma
Jamaliaasma asked
Member (0 upvotes)
over a year ago

Can crawling a test website with screaming frog will lead to server 500 issue?

i crawled my test website and after 4 hrs it is not loading plz tell me what can I do to get it back?

#crawling #server
Avatar for member Chedders
Chedders
Moderator (242 upvotes)
over a year ago

you have overloaded your site with requests, you need to reduce the number of threads so you don't hit it so hard.

Better still improve your website so it can handle more requests but that will depend on what setup you have. 

Good advice?
1
0
Comments 0
login to reply
Jamaliaasma Member
over a year ago
It is showing the 500 server error
Jamaliaasma Member
over a year ago
Can this harm the website?
Jamaliaasma Member
over a year ago
I need to clarify to the website owner that is because of using screaming frog or any other issue?
Copyright ©2022 SEOChat. All Rights Reserved. Owned and operated by Search Ventures Ltd and Chris Chedgzoy.