# Robots.txt file from http://www.5acbd.com # All robots will spider the domain1 User-agent: * Disallow:/Admin/ Disallow:/news/news_*_*.htm Disallow:/leasing/*/ Disallow:/leasing_* Disallow:/news/*/ Disallow:/art Disallow:/FileDown.aspx Disallow:/SessionUser.ashx Disallow:/admin/AmendUserInfo.aspx Disallow:/CbdInfoList3.aspx Disallow:/hot.aspx Disallow:/NewestCbdInfoList.aspx Disallow:/%3C/span%3E%3C/div%3E%20%3Cdiv%20id= Disallow:/list/ Disallow:/CbdInfoList_*.aspx Disallow:/CbdInfoListKey.aspx