from Search Engine Roundtable https://ift.tt/34wUAUG
GoogleBot Does Not Use Nutch
Britney Muller spotted someone using Apache Nutch with a GoogleBot useragent name when crawling a site. Google has confirmed GoogleBot does not use Nutch in its useragent. Nutch is "highly extensible and scalable open source web crawler software project."
from Search Engine Roundtable https://ift.tt/34wUAUG
from Search Engine Roundtable https://ift.tt/34wUAUG
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment
Leave Post