# robots.txt User-agent: * Disallow: /users/* Disallow: /search* Disallow: /pages/* Disallow: /xiaozhi/* Disallow: /tag/* Disallow: /topic/* Disallow: /asynces/* Disallow: /*?* Disallow: /topics/*