User-agent: ia_archiver Disallow: / User-agent: Xombot Disallow: / User-agent: Updownerbot Disallow: / User-agent: * Disallow: /search/ Disallow: /sara/ Disallow: /barb/ Disallow: /logs/ Disallow: /scripts/ Disallow: /secure/ Disallow: /shared/ Disallow: /shopadmin/ Disallow: /sls/ # Disallow: /SpryAssets/ Disallow: /test/ Disallow: /user/ Disallow: /home/ Disallow: /HDWFormCaptcha/ Disallow: /cgi-bin/ Sitemap: https://www.stuff4beauty.com/sitemap.gz