Matt1966
Matt1966 asked
Member (204 upvotes)

ScreamingFrog vs DeepCrawl - what is your favourite spider?

I'm a massive fan of ScreamingFrog - primarily because it's free! But I've heard great things about DeepCrawl also. 


What is your choice of Spider, and why? (doesn't necessarily have to be ScreamingFrog or DeepCrawl).

#screamingfrog#deepcrawl#spider
Avatar for member Chedders
Chedders
Moderator (163 upvotes)

I do have my own but if I am honest screamingfrog does a better and faster job so I tend to use that for most of my crawling. Yes, I could spend the time on my crawler but what's the point when screamingfrog does it so well. 

Good advice?
1
0
Comments 0
login to reply
What about with huge websites? Screaming Frog tends to struggle at XXX,XXX/X,XXX,XXX URI kind of range. Well, they do with my 16RAM PC (when executing Javascript). At that point I've got to say, DeepCrawl does seem appealing as they'll handle the crawling on their side.
Avatar for member Matt1966
Matt1966
Moderator (204 upvotes)

I'm a massive fan of ScreamingFrog - primarily because it's free! But I've heard great things about DeepCrawl also. 

What is your choice of Spider, and why? (doesn't necessarily have to be ScreamingFrog or DeepCrawl).

Good advice?
0
0
Comments 0
login to reply
Copyright ©2020 SEOChat. All Rights Reserved.