• IphtashuFitz@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 days ago

    I’d consider search engine bots from the likes of Google, Microsoft, etc. to be benign. They provide a useful service to websites and honor robots.txt directives.

    Bots that impersonate Google etc. and/or ignore robots.txt are considered bad bots.