方法 修改根目录robots.txt 禁止百度蜘蛛爬行
以下是自己花了半小时 整理的 谢谢
#
# robots.txt for Anwsion
#
User-agent: *
Disallow: /app/
Disallow: /cache/
Disallow: /install/
Disallow: /models/
Disallow: /system/
Disallow: /tmp/
Disallow: /views/
Disallow: /?/admin/
Disallow: /question/id-*
Disallow: /question/id-*__column-log__rf-false
Disallow: /question/id-*__uid-focus
Disallow: /category/*__sort_type-new
Disallow: /category/*__sort_type-hot__day-30
Disallow: /category/*__sort_type-unresponsive
Disallow: /category/__sort_type-new
Disallow: /category/__sort_type-hot__day-30
Disallow: /category/__sort_type-unresponsive
Disallow: /home/explore/page-*__sort_type-new__day-0
Disallow: /home/explore/sort_type-new__page-*__category-__day-30
Disallow: /home/explore/page-*__sort_type-hot__day-30
Disallow: /home/explore/sort_type-hot__page-*__category-__day-30
Disallow: /home/explore/page-*__sort_type-unresponsive__day-0
Disallow: /home/explore/sort_type-unresponsive__page-*__category-__day-30
阅读全文
收起全文
