Back to skills directory

Honest robots.txt

New

robots.txt 只写你真想拦的爬虫路径,不要靠它藏密钥或后台。敏感接口仍要鉴权。

Honest robots.txt is an Agent skill for Writing. robots.txt 只写你真想拦的爬虫路径,不要靠它藏密钥或后台。敏感接口仍要鉴权。 Tags: robots.txt · 爬虫 · SEO.

WritingAuthor: 编辑整理Visit

What is Honest robots.txt

Honest robots.txt packages a Writing workflow for agents. robots.txt 只写你真想拦的爬虫路径,不要靠它藏密钥或后台。敏感接口仍要鉴权。

Install Honest robots.txt in Cursor / Claude / Codex

Claude Code Install with the command on this page, or place the skill in ~/.claude/skills or project .claude/skills so Claude can detect Honest robots.txt.

Cursor After the install command writes the skill directory, invoke Honest robots.txt by name in the Cursor agent.

Codex Install into the Codex skills directory and call it by name. If only a generic command is listed, run it locally and confirm Codex can see the skill.

This page has no install command. Check the project home for how to install Honest robots.txt.

Please visit the Project Home to see installation and usage instructions.

How to Use

Claude Code: Place the skill in ~/.claude/skills (personal) or the project .claude/skills directory, and Claude will auto-detect it.

Cursor / Windsurf: After installing via npx skillsadd, the skill directory is placed in the configured path.

Codex CLI: After installation it loads automatically from the skills directory and is invoked by name.

Tags

robots.txt爬虫SEO

Similar recommendations

FAQ

What is Honest robots.txt for?

Honest robots.txt is a Writing skill. robots.txt 只写你真想拦的爬虫路径,不要靠它藏密钥或后台。敏感接口仍要鉴权。

Can Claude, Cursor, and Codex all use Honest robots.txt?

Yes if the client supports Agent Skills and has loaded the skill directory. Check the project home for compatibility notes.

What similar skills exist?

Related items come from the same Writing group so you can pick a closer workflow.