Real run

XML Sitemap URL Audit

Sample 1 · 2026-10-29 · Grok Bot executor subagent (model family not disclosed)

Bot page

URL table

Sitemap: https://www.northfieldoutdoor.example/sitemap-products.xml. Crawl: Screaming Frog list mode, 2026-10-27. Class order applied: Error, Redirect, Noindex, Non canonical, Keep.

Row URL Status Canonical Robots Class Action
U1 https://www.northfieldoutdoor.example/tents/alpine-2 200 self index,follow Keep Keep
U2 https://www.northfieldoutdoor.example/tents/alpine-3 200 self index,follow Keep Keep
U3 https://www.northfieldoutdoor.example/tents/ridge-1 301 to /tents/ridge-1-ul n/a n/a Redirect Remove; target already listed as U4
U4 https://www.northfieldoutdoor.example/tents/ridge-1-ul 200 self index,follow Keep Keep
U5 https://www.northfieldoutdoor.example/bags/summit-20 404 n/a n/a Error Remove
U6 https://www.northfieldoutdoor.example/bags/summit-20?color=red 200 https://www.northfieldoutdoor.example/bags/summit-20-v2 index,follow Non canonical Remove; canonical already listed as U7
U7 https://www.northfieldoutdoor.example/bags/summit-20-v2 200 self index,follow Keep Keep
U8 https://www.northfieldoutdoor.example/stoves/flint 200 self noindex,follow Noindex Remove, or change the page to index if you want it in search
U9 http://www.northfieldoutdoor.example/stoves/ember 301 to https version n/a n/a Redirect Remove; https target already listed as U10
U10 https://www.northfieldoutdoor.example/stoves/ember 200 self index,follow Keep Keep
U11 https://www.northfieldoutdoor.example/packs/trail-40 500 n/a n/a Error Fix the server error if the product is live; otherwise remove
U12 https://www.northfieldoutdoor.example/packs/trail-30 200 self index,follow Keep Keep

Counts by class

Rule: total = Keep + Error + Redirect + Noindex + Non canonical.

Class Rows Count
Keep U1, U2, U4, U7, U10, U12 6
Error U5, U11 2
Redirect U3, U9 2
Noindex U8 1
Non canonical U6 1

6 + 2 + 2 + 1 + 1 = 12, which equals the 12 URL rows you sent.

Remove or replace list

  • Remove U3, U5, U6, U8 and U9. No replacement needs adding, because each redirect or canonical target (U4, U7, U10) is already in the file as a 200, self canonical, indexable URL.
  • U11 (500 server error): ask the developer whether /packs/trail-40 is a live product. If yes, fix the error and keep it; if no, remove it.
  • U8 (/stoves/flint, noindex): remove it from the sitemap unless the noindex is a mistake. Tell me which.
  • Protocol: U9 is the only http URL. Your preferred form is https with www; every other row already uses it.

File checks

Check Measured Limit Result
URLs in file 12 50,000 URLs Pass
Size, uncompressed bytes (gzip size not counted) 9 KB 50MB Pass
Longest loc value, characters 62 (U6) under 2,048 Pass
Index file no not needed at this size Pass

lastmod: Google ignores priority and changefreq and uses lastmod only when it is consistently and verifiably accurate. Every row shows 2026-10-01. Against the edits you know of: - U1 alpine-2: lastmod 2026-10-01, real change 2026-06-12. Mismatch: lastmod is later than the real change. - U12 trail-30: lastmod 2026-10-01, real change 2026-10-01. Match. - Other 10 rows: lastmod not checked (no real dates given). One date on every row suggests the generator stamps a build date; please confirm.

Method notes

  • Classes come only from the status, canonical and robots values in your crawl. I have no Search Console data, so this report says nothing about which URLs are indexed.
  • Character count for the loc check was measured by script on the longest URL.
  • No priority or changefreq values are recommended.

Needs your decision

  • Approve the removals (U3, U5, U6, U8, U9) before the sitemap generator is changed.
  • Decide U8 (keep noindex or not) and U11 (live product or not).
  • Confirm before the sitemap is resubmitted in Search Console.