User-agent: * Allow: /wp-admin/admin-ajax.php Disallow: /wp-admin/ User-agent: * Disallow: /*.html$ User-agent: SemrushBot allow: / User-agent: SemrushBot-SA allow: / User-agent: SemrushBot-BA allow: / User-agent: SemrushBot-SI allow: / User-agent: SemrushBot-SWA allow: / User-agent: SemrushBot-CT allow: / User-agent: SemrushBot-BM allow: / User-agent: SplitSignalBot allow: /