Sitemap URL Extractor
Every URL of a website from its sitemaps — indexes, gzip, lastmod, hreflang — with include/exclude patterns.
Pay per result on Apify. Runs that return nothing cost nothing; Apify's free plan includes $5 of usage a month, and Apify Bronze, Silver and Gold subscribers get 10%, 20% and 30% off.
Paste website URLs (the sitemap is discovered through robots.txt and common paths) or sitemap URLs and get every listed page with lastmod, changefreq, priority, hreflang alternates and image/video/news extensions — as JSON, CSV or Excel, or through the Apify API.
Sitemap indexes and gzip files are followed automatically; regular-expression include/exclude patterns and a date filter narrow the list to what you need.
What you get
- • Discovery via robots.txt and nine common sitemap paths
- • Sitemap indexes and .gz handled
- • lastmod normalised to ISO 8601
- • Include/exclude regex and modified-after filter
- • Monitored daily
Typical uses
- • Seeding crawlers and content pipelines
- • SEO audits and migration checklists
- • Competitor content inventories
- • Feeding URLs into an LLM extraction step
Output
| site, sitemapUrl | Where the URL came from |
| url | The page |
| lastmod, changefreq, priority | Sitemap metadata |
| alternates, images, videos, news | Extensions |
Run it from code
Same Actor, same output, from your own scripts (any language) or from n8n, Make and Zapier.
curl -X POST "https://api.apify.com/v2/acts/chorelet~sitemap-url-extractor/run-sync-get-dataset-items?token=YOUR_TOKEN" \
-H "Content-Type: application/json" \
-d '{"urls":["https://blog.cloudflare.com"],"maxUrlsPerSite":10000,"includePattern":"","modifiedAfter":""}'