Sitemap URL Extractor

Sitemap URL Extractor produces a flat list of page URLs. The URL extractor stores page loc values and drops a repeated loc after the first copy. Image and video tags stay attached to the page row, but the flat list you copy is the page address. You can paste XML into the box, or you can enter a public sitemap URL and let the server fetch it. A pasted urlset is parsed on the server without a second copy of the parser in the browser. The form stays near the top of the page, under the single title. (Sitemap URL Extractor, guide 1.)

Sitemap URL Extractor shares one fetcher with the other sitemap tools. The fetcher allows http and https only. It rejects file, gopher, and data URLs, then blocks localhost, loopback, link-local, private ranges, CGNAT space, and the cloud metadata address before it opens a socket. DNS answers are checked before the connection, and a redirect is checked again. A redirect loop is reported instead of being followed forever. Three hops is the maximum. (Sitemap URL Extractor, guide 3.)

When a URL must be fetched, the page sends the job to the server and shows a short progress line while it polls. Small pastes return immediately with the same result shape: source URL, index or urlset, child sitemaps, page rows, errors, duplicates, redirect hops, status, truncated flag, and counts. Repeat fetches of the same normalized URL can reuse a finished parse for 10 minutes. Jobs sit in a file folder so more than one server process can see them, and they expire after 30 minutes. (Sitemap URL Extractor, guide 5.)

A concrete pass through Sitemap URL Extractor starts with https://example.com/sitemap.xml. If that address is an index whose first child is https://example.com/sitemaps/pages.xml, the file list and the page list answer different questions. The page address https://example.com/pricing belongs in the page list only when a urlset contains it. Keep the two lists apart when you copy them into a spreadsheet or a ticket. (Sitemap URL Extractor, guide 7.)

Take Sitemap URL Extractor as one step. The next page in this set is Sitemap Extractor, which answers a different question about the same sitemap. Sitemap to CSV is the other close check. Finish the reading on this page before you switch, so you do not mix a flat list of page URLs with a different report. (Sitemap URL Extractor, guide 9.)

Use https://example.com/sitemap.xml as the file you are checking and https://example.com/pricing as a page address you expect to see or not see, depending on the job. The count is stored URLs, not the raw number of loc tags. A duplicate is listed under Duplicates and is not repeated in the page list. If the file is a sitemap index, child documents such as https://example.com/sitemaps/pages.xml are fetched only when you supplied the index URL, only while the depth is within 2, and only until 20 child sitemap requests have been made. (Sitemap URL Extractor, guide 2.)

Large files are cut at 5 MB, and the stored page list stops at 5,000 URLs. Gzip responses and addresses that end in .gz are decompressed before parsing. A DOCTYPE or an entity declaration is rejected so the parser cannot expand an external entity. An HTML document or a Cloudflare challenge body is reported as not a sitemap. The raw response body is not written to the log. (Sitemap URL Extractor, guide 4.)

Expecting child sitemap files to appear as pages. Those files are fetched only so their page loc values can be collected. After you read that distinction, look at the severity of any finding. An error means the document or the fetch failed the check this page is responsible for. A warning, such as a duplicate loc or a truncated file, means the rest of the result is still usable. A note explains a cap, a paste that did not download child files, or a sample crawl. (Sitemap URL Extractor, guide 6.)

The result panel uses the same dark block as the other tools on this site. Copy is there when a text result is useful. A download button appears only for a file this page actually builds, such as CSV, XLSX, XML, or llms.txt. Sitemap URL Extractor does not add a second title to the page, and it does not restyle the tools around it. (Sitemap URL Extractor, guide 8.)