Skip to content

Clean a URL batch before IndexNow submission

Paste or import a list of URLs to remove duplicates, identify invalid values, and separate URLs by hostname entirely in your browser.

This tool runs entirely in your browser. Your URL list is never uploaded, stored, or sent to a server.

Paste a URL list

Use one URL per line, or separate URLs with spaces and commas. You can also import a plain-text or CSV file.

Submission groups

Each group contains URLs from one hostname. Copy only one group for each IndexNow request.

Paste or import URLs to create submission groups.

When to use this tool

IndexNow rejects a request whose URLs do not all belong to the declared host, and duplicates burn quota without doing anything. This tool turns a pasted list into something submittable.

  • Exports from a CMS or crawler

    Lists copied out of a spreadsheet or crawl report usually carry blank lines, tracking parameters and mixed hosts.

  • Multi-domain properties

    One request covers one host. Split a combined list before you submit rather than after a 422.

  • Lists over 10,000 URLs

    The protocol caps a request at 10,000 URLs. The summary tells you when a list needs splitting.

  • Hand-assembled lists

    Manually gathered URLs are where typos and missing schemes hide.

How to build a clean batch

Parsing, deduplication and grouping all happen as you type. Nothing is uploaded at any point.

  1. 1

    Paste or import the list

    One URL per line, or separated by spaces and commas. Plain-text and CSV files can be imported directly.

  2. 2

    Read the summary

    Valid, duplicate and invalid counts update live, along with how many distinct hosts the list covers.

  3. 3

    Fix the invalid entries

    Values that are not http(s) URLs are listed separately so you can correct them at the source.

  4. 4

    Send one group to the submitter

    Each group holds a single host. Copy a group, or send the first one straight into the submission form.

What usually goes wrong

http and https treated as one URL

They share a hostname but are different URLs. Submit the canonical scheme only — in practice, https.

www and apex treated as interchangeable

www.example.com and example.com are separate hosts to IndexNow, and each needs its own key file.

Tracking parameters left in place

A URL with ?utm_source is a different URL. Submitting both wastes quota and can read as spam.

Redirecting or missing URLs in the batch

Notifying an engine about a URL that does not resolve is noise. Submit destinations, not redirects.

Frequently asked questions

Why must all URLs share one host?
The key file proves ownership of a single host, so an engine only accepts URLs on that host within the same request.
Does the tool request or validate the URLs?
No. It checks syntax and grouping only, and never fetches the URLs. Nothing leaves your browser.
Are duplicates removed automatically?
Yes. Exact duplicates are collapsed and the count is reported, so you can see how noisy the source list was.
What counts as invalid?
Anything that is not an absolute http or https URL — relative paths, bare domains without a scheme, and empty lines.
Can I submit more than 10,000 URLs?
Not in one request. Split the list and submit sequentially; the summary warns you when you are over the limit.