# Allow Facebook's crawler User-agent: facebookexternalhit Disallow: User-agent: * Disallow: /admin/ Disallow: /manage-account/ Disallow: /filepond/ Disallow: /log/ Allow: /build/ Allow: /fonts/ Allow: /js/ Allow: /storage/car_dealer_image/ Allow: /storage/cars_image/ Disallow: /storage/ # Paginated/filter listing pages declare noindex,follow in their HTML so # Google can process the canonical/noindex signal instead of seeing a crawl block. Disallow: /en/user/ Disallow: /fa/user/ Disallow: /ps/user/ Disallow: /en/my-cars/ Disallow: /fa/my-cars/ Disallow: /ps/my-cars/ Allow: /fa/knowledge/ Allow: /en/knowledge/ Allow: /ps/knowledge/ Disallow: /fa/search? Disallow: /en/search? Disallow: /ps/search? Disallow: /manage-account/ Disallow: /fa/data-privacy/ Disallow: /en/data-privacy/ Disallow: /ps/data-privacy/ Sitemap: https://www.motar24.com/fa/sitemap.xml Sitemap: https://www.motar24.com/en/sitemap.xml Sitemap: https://www.motar24.com/ps/sitemap.xml