New

Sitemap Extractor

Fetch a sitemap URL or paste XML and list the sitemap files found, including every child file named inside a sitemap index.

Sitemap input

Paste sitemap XML, or one sitemap URL on its own. A pasted index lists the child files in that paste. A single http(s) URL is fetched.

On this tool

Limits Sitemap Extractor enforces

  • 5 MBLargest response

    Sitemap Extractor refuses a paste or download larger than 5 MB.

  • 5,000Stored URLs

    Sitemap Extractor keeps at most 5,000 page URLs and marks a longer list truncated.

  • 20Child sitemaps

    Sitemap Extractor fetches at most 20 child sitemaps from an index.

  • 2Index depth

    Sitemap Extractor does not follow a nested index past depth 2.

  • 3Redirect hops

    Sitemap Extractor follows at most 3 redirects.

Note

One pass through Sitemap Extractor

Input

Paste a urlset that contains https://example.com/blog/launch-notes once and the same address a second time. Sitemap Extractor keeps one stored page and records the duplicate. Fetching https://example.com/sitemap.xml instead of pasting uses the same parser after the download. (Sitemap Extractor, example 1.)

What you should see

If https://example.com/sitemap.xml is a sitemap index and https://example.com/sitemaps/posts.xml is the first child, a URL fetch can read that child until the depth and child caps. A paste of the index lists https://example.com/sitemaps/posts.xml and does not download it until you fetch the index URL. (Sitemap Extractor, example 2.)

On this tool

How Sitemap Extractor reaches that result

Sitemap Extractor produces a list of sitemap files. The extractor is for the sitemap files themselves. A sitemap index names other sitemap files in sitemap loc elements, and those addresses are the result, together with the index you opened. You can paste XML into the box, or you can enter a public sitemap URL and let the server fetch it. A pasted urlset is parsed on the server without a second copy of the parser in the browser. The form stays near the top of the page, under the single title. (Sitemap Extractor, guide 1.)

Use https://example.com/sitemap.xml as the file you are checking and https://example.com/blog/launch-notes as a page address you expect to see or not see, depending on the job. Read the Sitemap files list. A urlset has one document. An index adds each child loc the engine stored, up to 20 fetched children and a depth of 2. If the file is a sitemap index, child documents such as https://example.com/sitemaps/posts.xml are fetched only when you supplied the index URL, only while the depth is within 2, and only until 20 child sitemap requests have been made. (Sitemap Extractor, guide 2.)

Sitemap Extractor shares one fetcher with the other sitemap tools. The fetcher allows http and https only. It rejects file, gopher, and data URLs, then blocks localhost, loopback, link-local, private ranges, CGNAT space, and the cloud metadata address before it opens a socket. DNS answers are checked before the connection, and a redirect is checked again. A redirect loop is reported instead of being followed forever. Three hops is the maximum. (Sitemap Extractor, guide 3.)

Large files are cut at 5 MB, and the stored page list stops at 5,000 URLs. Gzip responses and addresses that end in .gz are decompressed before parsing. A DOCTYPE or an entity declaration is rejected so the parser cannot expand an external entity. An HTML document or a Cloudflare challenge body is reported as not a sitemap. The raw response body is not written to the log. (Sitemap Extractor, guide 4.)

When a URL must be fetched, the page sends the job to the server and shows a short progress line while it polls. Small pastes return immediately with the same result shape: source URL, index or urlset, child sitemaps, page rows, errors, duplicates, redirect hops, status, truncated flag, and counts. Repeat fetches of the same normalized URL can reuse a finished parse for 10 minutes. Jobs sit in a file folder so more than one server process can see them, and they expire after 30 minutes. (Sitemap Extractor, guide 5.)

Copying page URLs out of this list. Page addresses belong to Sitemap URL Extractor. This page is the file list. After you read that distinction, look at the severity of any finding. An error means the document or the fetch failed the check this page is responsible for. A warning, such as a duplicate loc or a truncated file, means the rest of the result is still usable. A note explains a cap, a paste that did not download child files, or a sample crawl. (Sitemap Extractor, guide 6.)

A concrete pass through Sitemap Extractor starts with https://example.com/sitemap.xml. If that address is an index whose first child is https://example.com/sitemaps/posts.xml, the file list and the page list answer different questions. The page address https://example.com/blog/launch-notes belongs in the page list only when a urlset contains it. Keep the two lists apart when you copy them into a spreadsheet or a ticket. (Sitemap Extractor, guide 7.)

The result panel uses the same dark block as the other tools on this site. Copy is there when a text result is useful. A download button appears only for a file this page actually builds, such as CSV, XLSX, XML, or llms.txt. Sitemap Extractor does not add a second title to the page, and it does not restyle the tools around it. (Sitemap Extractor, guide 8.)

Take Sitemap Extractor as one step. The next page in this set is Sitemap URL Extractor, which answers a different question about the same sitemap. Sitemap Validator is the other close check. Finish the reading on this page before you switch, so you do not mix a list of sitemap files with a different report. (Sitemap Extractor, guide 9.)

Where Sitemap Extractor fits

Sitemap Extractor is the iSkills page for a list of sitemap files. The extractor is for the sitemap files themselves. A sitemap index names other sitemap files in sitemap loc elements, and those addresses are the result, together with the index you opened. Paste XML when you already have the file, or enter a public http or https sitemap URL when you want the server to fetch it within the published caps.

The caps are part of the result, not a hidden failure. Sitemap Extractor stores at most 5,000 page URLs, fetches at most 20 child sitemaps, and stops nested indexes at depth 2. A truncated flag and a note tell you when the list is incomplete.

Sitemap Extractor in order

Paste sitemap XML or enter the sitemap URL. For Sitemap Extractor, the address to try first is https://example.com/sitemap.xml. (Sitemap Extractor, step 1.)

Run the check. A short progress line stays on screen while a fetch is in a server job. (Sitemap Extractor, step 2.)

Read a list of sitemap files. Confirm whether the result says the list was truncated. (Sitemap Extractor, step 3.)

Copy the text you need, or download the file when this page offers one. Publish any generated XML yourself. (Sitemap Extractor, step 4.)

What Sitemap Extractor returns

  • Sitemap Extractor shows a list of sitemap files from one shared parse, so the XML rules match the other sitemap tools. (Sitemap Extractor, result 1.)
  • A paste and a fetched URL return the same kind of result, including errors, duplicates, and counts. (Sitemap Extractor, result 2.)
  • Private hosts, entity declarations, and oversized responses are refused before they can be used as a proxy. (Sitemap Extractor, result 3.)

Before you trust Sitemap Extractor

  • The input for Sitemap Extractor was XML or a public sitemap URL. (Sitemap Extractor, check 1.)
  • A truncated note was read before the list was treated as complete. (Sitemap Extractor, check 2.)
  • HTML or a challenge page was not accepted as a sitemap. (Sitemap Extractor, check 3.)
  • The copied result matches a list of sitemap files, not a different sitemap report. (Sitemap Extractor, check 4.)
  • Generated files were published by you, not by this page. (Sitemap Extractor, check 5.)

Terms used by Sitemap Extractor

urlset
The sitemap root that lists page URLs. Sitemap Extractor reads it with the shared parser. (Sitemap Extractor, urlset.)
sitemap index
A sitemap that lists other sitemap files. Nested indexes are fetched only to depth 2. (Sitemap Extractor, sitemap index.)
loc
The address element. Page locs and sitemap locs are kept in different lists. (Sitemap Extractor, loc.)
truncated
The flag that says a byte, URL, child, depth, or time cap stopped the result early. (Sitemap Extractor, truncated.)
a list of sitemap files
The specific report Sitemap Extractor is built to show from the shared parse. (Sitemap Extractor, a list of sitemap files.)

On this tool

Mistakes that waste a Sitemap Extractor run

Sitemap Extractor: Mixing this result with another sitemap tool

Copying page URLs out of this list. Page addresses belong to Sitemap URL Extractor. This page is the file list. (Sitemap Extractor, mistake 1.)

Sitemap Extractor: Ignoring a truncated list

Sitemap Extractor stops at the published caps. A truncated note means you do not have the full file. (Sitemap Extractor, mistake 2.)

Sitemap Extractor: Sending a private URL

Localhost, link-local, private ranges, and the metadata address are blocked before a socket is opened. (Sitemap Extractor, mistake 3.)

Sitemap Extractor: Treating HTML as XML

An HTML page or a challenge interstitial is reported as not a sitemap. Fix the URL or the firewall rule, then run the check again. (Sitemap Extractor, mistake 4.)

Field note

Questions about Sitemap Extractor

What does Sitemap Extractor return?

Sitemap Extractor returns a list of sitemap files. Read the Sitemap files list. A urlset has one document. An index adds each child loc the engine stored, up to 20 fetched children and a depth of 2. (Sitemap Extractor, What does Sitemap Extractor return?.)

Does Sitemap Extractor fetch a pasted file?

A paste is parsed without a download. A sitemap URL is fetched on the server. Child files inside a pasted index are listed and are not downloaded until you fetch the index URL. (Sitemap Extractor, Does Sitemap Extractor fetch a pasted file?.)

What will Sitemap Extractor refuse?

It refuses non-http schemes, private and metadata addresses, DOCTYPE and entity declarations, responses over 5 MB, and HTML that is not a sitemap. (Sitemap Extractor, What will Sitemap Extractor refuse?.)

How large a file can Sitemap Extractor store?

The stored page list stops at 5,000 URLs. Child sitemap fetches stop at 20, nested indexes stop at depth 2, and redirects stop at 3. The screen says when the result is truncated. (Sitemap Extractor, How large a file can Sitemap Extractor store?.)

On this tool

After Sitemap Extractor

Take what Sitemap Extractor returned into Sitemap URL Extractor before you mix it with a different report.

WhatsApp Advisor
Enroll Now