# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # Agent: Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/) # To ban all spiders from the entire site uncomment the next two lines: User-Agent: Yeti/1.0 (+http://help.naver.com/robots/) Disallow: / User-Agent: Yeti-FeedItemCrawler/1.0 (NHN Corp.; http://help.naver.com/robots/) Disallow: / User-Agent: Mozilla/5.0 (compatible; Windows NT; Yeti/1.0; NHN Corp.; http://help.naver.com/robots/) Disallow: / User-Agent: Yeti Disallow: / User-agent: NaverBot Disallow: / User-agent: yodaobot Disallow: / #China Yodao : www.yodao.com User-agent: ia_archiver Disallow: / #USA Alexa : alexa.com/