<rss xmlns:atom="http://www.w3.org/2005/Atom" version="2.0">
    <channel>
        <title>robots.txt - 标签 - 木木飞</title>
        <link>https://www.mmfei.com/tags/robots.txt/</link>
        <description>robots.txt - 标签 - 木木飞</description>
        <generator>Hugo -- gohugo.io</generator><language>zh-CN</language><managingEditor>wlfkongl@gmail.com (mmfei)</managingEditor>
            <webMaster>wlfkongl@gmail.com (mmfei)</webMaster><lastBuildDate>Thu, 19 Nov 2026 14:10:00 &#43;0700</lastBuildDate><atom:link href="https://www.mmfei.com/tags/robots.txt/" rel="self" type="application/rss+xml" /><item>
    <title>robots.txt 与 sitemap 不是收录开关：静态博客的抓取排查清单</title>
    <link>https://www.mmfei.com/2026/11/robots%E4%B8%8Esitemap%E6%8A%93%E5%8F%96%E6%8E%92%E6%9F%A5%E6%B8%85%E5%8D%95/</link>
    <pubDate>Thu, 19 Nov 2026 14:10:00 &#43;0700</pubDate>
    <author>作者</author>
    <guid>https://www.mmfei.com/2026/11/robots%E4%B8%8Esitemap%E6%8A%93%E5%8F%96%E6%8E%92%E6%9F%A5%E6%B8%85%E5%8D%95/</guid>
    <description><![CDATA[把文章放进 sitemap，再在 robots.txt 写一句 Allow，并不能保证 Google 收录。前者提供发现网址的线索，后者表达爬虫能否抓取；页面是否被抓取、如何被索引]]></description>
</item></channel>
</rss>
