# robots.txt file created at http://www.searchenginepromotionhelp.com/ # Sat, 15 Apr 2006 04:56:53 -0400 # Exclude Files From All Robots: User-agent: * Disallow: /mua ban xe con Disallow: /cho thue xe con Disallow: /mua ban phu tung Disallow: /mua ban xe cu nhap khau Disallow: /bao hiem xe co gioi Disallow: /bao hiem phuong tien Disallow: /xe hoi cu Disallow: /xe cu nhap khau Disallow: /xe con qua su dung Disallow: /nhap khau phu tung xe con Disallow: /xe cap cuu Disallow: /xe cuu homuaxe.com, banxe.com, thuexe.com, xecu.com, otocu.com, oto.com, auto.com, nhapxe.com # End robots.txt file # # robots.txt for http://www.muabanxecon.com/muabanxecon.asp # # $Id: robots.txt,v 1.41 2006/02/22 16:31:58 ted Exp $ # # For use by search.muabanxecon.com User-agent: W3C-gsa Disallow: /Out-Of-Date # W3C Link checker User-agent: W3C-checklink Disallow: # exclude some access-controlled areas User-agent: * Disallow: /2004/ontaria/basic Disallow: /Team Disallow: /chatroom Disallow: /Systems Disallow: /Web Disallow: /History Disallow: /Out-Of-Date Disallow: /2002/02/mid Disallow: /mid/ Disallow: /People/all/ Disallow: /RDF/Validator/ARPServlet Disallow: /2003/03/Translations/byLanguage Disallow: /2003/03/Translations/byTechnology Disallow: /2005/11/Translations/Query Disallow: /2003/glossary/subglossary/ #Disallow: /2005/06/blog/ #Disallow: /2001/07/pubrules-checker #shouldnt get transparent proxies but will ml links of things like pubrules Disallow: /2000/06/webdata/xslt Disallow: /2000/09/webdata/xslt Disallow: /Bugs/