What Is a Sitemap? Types, Limits and How to Create One

A sitemap is a file that lists the pages, videos and other files on your site so search engines can crawl it more efficiently. XML sitemaps are for search engines; HTML sitemaps are pages for visitors.

Google says a small, well-linked site (about 500 pages or fewer) may not need one, and that submitting one is only a hint. After submitting, confirm pages with the Google Index Checker.

What Is a Sitemap?

A sitemap is a file that lists the pages, videos, and other assets on your website, along with the links between them. It helps search engines like Google crawl and index your site more efficiently. A sitemap provides useful details about the content, such as the page’s last modified date or any translations available.

A sitemap tells search engines which pages and files you think are important, but it does not guarantee they will be crawled or indexed.

Types Of Sitemap

There are two main types of sitemaps: HTML sitemaps and XML sitemaps. Each type serves a different purpose.

HTML Sitemaps are designed for users. They offer a clear, easy-to-navigate page listing all the important website pages. Visitors can use the HTML sitemap to find content quickly.

XML Sitemaps are made for search engines, not for visitors. They provide information about the site’s pages, videos, and other files. XML sitemaps help search engines crawl and index the website more effectively.

There are several types of XML sitemaps, each serving a specific function.

• Image Sitemaps list images on a website. These sitemaps help search engines find and index images, improving image search results.
• Mobile Sitemaps are rarely needed now. If a page has separate mobile and desktop URLs, Google recommends listing only one version in your sitemap.
• News Sitemaps are used by websites that publish news content. They help search engines find and index news articles quickly, ensuring the content is included in news search results.
• Video Sitemaps help search engines index video content. These sitemaps include information like the video’s location, title, and description

What Is The Appearance Of A Sitemap?

Below are the common forms of sitemaps and their appearances:

1. HTML Sitemaps for Humans

HTML sitemaps are designed for website visitors to navigate easily. These sitemaps are usually text-based, arranged in a hierarchical structure, and often located in the footer of a website. They list all the pages of the site in a structured way, often categorized under headings like “Products,” “Services,” or “About Us.”

For example:

This structure serves as an additional navigational aid, helping users quickly find specific pages.

2. XML Sitemaps for Search Engines

XML sitemaps are text files formatted with specific tags to organize website URLs and metadata for search engine bots. They don’t aim to be visually appealing but rather functional and easy for machines to interpret.

For example:

3. 2D Visual Sitemaps for Teams

These are graphic representations of a website’s structure, used for planning and collaboration. They look like flowcharts or diagrams, with boxes representing pages and lines connecting them to show pathways. Teams use them to design intuitive navigation paths.

When Do You Need a Sitemap?

If the following criteria match your website, then you need a sitemap.

• Your Website is Large: A big website with many pages can make it hard for Google to crawl everything. A sitemap helps ensure that all pages, especially new ones, are easy for search engines to find.
• Your Site is New with Few Backlinks: Google may miss your pages if other sites aren’t linking to yours. A sitemap helps search engines find your content even if you lack backlinks.
• Your Content is Rich in Media: If your site has many images or videos, a sitemap can help Google understand and index these materials, boosting visibility on Google Search.
• Google News Features Your Site: For sites featured in Google News, a sitemap is useful for quickly indexing new articles. It helps ensure that Google shows your latest content in search results.
• Frequent Content Updates: If you publish new content often, a sitemap helps search engines find and index new material faster.

When You Don’t Need a Sitemap?

You can avoid the sitemap if the below criteria match with your website:

• Your Site is Small: If your website has 500 pages or fewer, Google can likely find and index them without a sitemap.
• You Don’t Have Much Media Content: You might not need a sitemap if your site doesn’t rely on many media, like videos or images. If media isn’t central to your search results, Google can still index your content without one.
• Internal Linking is Strong: With plenty of internal links connecting your site’s pages, Googlebot can easily access every key page. This strong internal linking structure reduces the need for a sitemap.

Why a Sitemap is Important for Your Website?

A sitemap is an essential tool that helps search engines understand and navigate your website effectively.

Improves Search Engine Indexing

One of the primary roles of a sitemap is to help search engines like Google find and index your site’s content. With a sitemap, Googlebot and other search engines can easily locate your pages, helping improve their chances of appearing in search results. If a website is new or very complicated, it may have trouble becoming properly indexed without this.

Boosts SEO Performance

A sitemap helps Google discover your URLs. It does not guarantee that pages are crawled or indexed, so treat it as a discovery aid, not a ranking tactic.

Supports User Navigation

HTML sitemaps (not XML ones) can also help visitors, especially on large or multi-department websites.

Conveys Page-Specific Information to Search Engines

Sitemaps also communicate specific details about your pages to search engines. Google uses the last-modified date if it is consistently and verifiably accurate, and it can read alternate language versions of pages. It ignores change-frequency values.

Helps New Sites Gain Visibility

New sites with limited backlinks benefit significantly from a sitemap. Since newer sites typically lack the external links needed for search engines to discover them quickly, a sitemap can act as a bridge, enabling search engines to find and crawl the site.

Page Priority Values Are Ignored by Google

The sitemap protocol lets you add a priority value to each URL, but Google ignores priority and changefreq. To show Google which pages matter, link to them clearly from your navigation and related pages.

How To Create A Sitemap For Your Website?

Creating a sitemap lets you guide search engines on which URLs (canonical URLs) to show in search results. If you have identical content accessible through multiple URLs, choose the preferred one for the sitemap.

Depending on your site’s size and structure, you can create a sitemap by:

• Having your content management system generate it automatically.
• Manually creating sitemaps with only a few URLs.
• Automating the process for larger sitemaps with hundreds of URLs.

Manually Creating A Sitemap

Creating a sitemap manually is possible for websites with a manageable number of pages. Here’s a step-by-step guide to manually creating a sitemap:

Step 1: Open a Text Editor

Use a plain text editor like Notepad (Windows) or Nano (Linux, macOS). Avoid word processors as they may add unwanted formatting.

Step 2: Understand the Sitemap Structure

A standard XML sitemap follows a specific format. Each URL is enclosed within <url> tags and includes essential tags like <loc> (location) and optional tags like <lastmod> (last modification date).

Step 3: Start Writing the Sitemap

• Begin by adding the XML declaration and opening the <urlset> tag. For each page, include its URL and any additional details, as shown below:

Step 4: Save the File

Save the file with a .xml extension, for example, sitemap.xml. Ensure the file name follows valid URL naming conventions.

Step 5: Upload the File

Use an FTP client or your hosting platform’s file manager to upload the sitemap file to your website’s root directory (e.g., https://example.com/sitemap.xml).

Step 6: Submit the Sitemap

Submit the sitemap to search engines like Google via Google Search Console. Go to the Sitemaps section, enter the file URL, and click Submit.

Notes for Larger Sitemaps

Manually creating sitemaps for large websites takes time and effort to maintain. For such cases, using automated tools or plugins is more practical.

Sitemap Generated By CMS

Creating a sitemap using a Content Management System (CMS) like WordPress, Wix, or Blogger is typically straightforward, as many CMS platforms automatically generate sitemaps.

WordPress

WordPress automatically generates a sitemap if you’re using version 5.5 or later. To locate your sitemap, go to:

If you’re using a plugin like Yoast SEO or Rank Math, these tools also provide customizable sitemaps. Once the plugin is installed, you can find your sitemap in the plugin settings. For example, Yoast SEO creates a sitemap accessible at:

Example Plugin Settings in Yoast SEO:

1. Navigate to SEO > General.
2. In the Features tab, toggle XML Sitemaps on.
3. Save changes and check your sitemap link.

2. Wix

Wix automatically generates a sitemap for all sites. To access it:

1. Go to your site’s settings in the Wix dashboard.
2. Find the SEO section, which displays your sitemap URL. This is typically structured like:

Wix updates your sitemap whenever you add new pages, meaning search engines stay updated without additional work on your part.

3. Blogger

Blogger doesn’t create an XML sitemap in the traditional sense but generates an RSS feed, which functions as a sitemap. To access it:

Add /sitemap.xml or /feeds/posts/default?orderby=updated to the end of your Blogger URL, like so:

This feed helps search engines detect new posts, though it lacks advanced sitemap features. For a true XML sitemap, consider using third-party tools that generate XML files based on your blog’s feed.

Tips for Verifying Your Sitemap

• Google Search Console: For all CMS platforms, you can confirm that your sitemap is working by submitting it in Google Search Console. In the Sitemaps section, enter your sitemap URL and click Submit.

Sitemaps Generate By Tools

Various tools and methods can create sitemaps automatically, saving time and reducing the chance of missing pages.

CMS Plugins and Built-in Tools

If you’re using a CMS like WordPress, Joomla, or Shopify, plugins and built-in features can generate sitemaps automatically. For instance, WordPress offers plugins like Yoast SEO and Rank Math, which create and update sitemaps automatically.

Example: Generating a Sitemap in Yoast SEO (WordPress)

1. Install and activate the Yoast SEO plugin.
2. Go to SEO > General in your dashboard.
3. Toggle the XML Sitemap feature on.
4. Visit https://yourdomain.com/sitemap_index.xml to view your sitemap.
5. Dedicated Sitemap Generator Tools

For larger websites or those without a CMS, online sitemap generator tools like Screaming Frog SEO Spider or XML-Sitemaps.com can create a sitemap quickly.

Example with XML-Sitemaps.com

1. Visit XML-Sitemaps.com.
2. Enter your website’s URL and start the crawl.
3. After the tool completes scanning, download the generated XML file and upload it to your server.
4. Automated Scripts for Custom Sites

For highly customized sites or websites with hundreds of pages, developers can automate sitemap creation by writing scripts that extract URLs from a site’s database.

Example Script in Python:

This example shows a Python script that generates an XML sitemap by looping through URLs and saving them in a file.

Managing Large Sitemaps

If your sitemap exceeds Google’s size limit (50,000 URLs or 50MB uncompressed), split it into multiple smaller sitemaps, then create an index sitemap to reference each part.

After submitting: use the Google Index Checker to see which of your sitemap URLs Google has indexed.

How To Submit Your Sitemap To Google?

Submitting a sitemap is only a hint: Google says it does not guarantee that Google will download the sitemap or use it for crawling. Here are a few effective methods:

1. Submit via Google Search Console

• Log in to your [Google Search Console](https://search.google.com/search-console/).
• Navigate to the **Sitemaps** section on the left sidebar.
• Enter the URL of your sitemap (e.g., `https://example.com/sitemap.xml`) and click Submit.
• Here, you can track when Google last accessed your sitemap and view any errors.

2. Use Your `robots.txt` File

Add a sitemap URL to your `robots.txt` file to guide Google to it during crawls. Place this line anywhere in the `robots.txt` file: “Sitemap: https://example.com/sitemap.xml

3. Programmatic Submission via API

For developers, the Google Search Console API allows for programmatically submitting a sitemap, which is especially useful for frequent updates.

4. Utilize Atom or RSS Feeds

If you use Atom or RSS feeds, use WebSub to notify Google and other search engines about updates to your content.

Multiple-Sitemap Cross-Submission: How To Do It?

Cross-submitting sitemaps for multiple websites are useful if you manage several related sites or subdomains and want Google and other search engines to index each one accurately. Google says you can cross-submit if you have verified ownership of every site in Search Console, or if each site’s robots.txt file points to a sitemap hosted in one place. Here is how:

Use Google Search Console for Each Site

Each site or subdomain should have its own Google Search Console property. For each property, submit the sitemap specific to that site.

Steps for Google Search Console:

• Log into Google Search Console and select the property for the first site.
• Navigate to the Sitemaps section and enter the sitemap URL (e.g., https://site1.com/sitemap.xml).
• Repeat this process for each site or subdomain you manage.

Add Cross-Site Sitemaps in the robots.txt Files.

If you host sitemaps for several sites in one place, each site’s robots.txt file should reference its own sitemap, even when that file lives on another site you control.

Example for site1.com robots.txt:

3. Create a Master Sitemap for All Sites

A master sitemap can include links to all individual sitemaps for your sites, enabling Google to see the connections between them. Place this master sitemap on a primary domain, and then link each site’s robots.txt file to it.

Example Master Sitemap (sitemap_index.xml):

Link this master sitemap in each site’s robots.txt file:

4. Submit Master Sitemap in Google Search Console

Submit the master sitemap URL in Google Search Console for each site.

Check your pages: the Website SEO Audit flags missing sitemaps, blocked pages and other crawl problems.

Some Best Practices For Creating A Sitemap

Below are eight recommended sitemap practices that can enhance your site’s visibility and indexing in search results:

1. Use Fully Qualified, Absolute URLs

Always include absolute URLs (i.e., URLs that include the full domain) in your sitemap. For example, instead of using /mypage.html, use https://www.example.com/mypage.html. Google says it will try to crawl URLs exactly as listed, so a relative URL such as /mypage.html will not work.

2. Set Canonical URLs Correctly

A sitemap should contain only the canonical URLs for your pages, not duplicate or alternate versions. The canonical URL is the preferred URL that you want search engines to index. For example, if you have both a mobile and desktop version of a page, choose one URL to include in the sitemap.

3. Use UTF-8 Encoding

Sitemaps should always be encoded in UTF-8 to ensure that search engines can read them properly. Most sitemap generators and CMS plugins automatically handle this, but if you’re creating a sitemap manually, double-check the encoding to prevent errors in processing.

4. Place the Sitemap in the Root Directory

Placing your sitemap at the root of your website’s domain (e.g., https://www.example.com/sitemap.xml) gives it the broadest reach, allowing search engines to understand that it applies to all pages on your site. Sitemaps stored in subdirectories may only affect pages within that directory, limiting their indexing scope.

5. Mind Sitemap Size Limits

Sitemaps are limited to 50,000 URLs or 50MB (uncompressed). If your site exceeds these limits, split it into multiple sitemaps and link them in a sitemap index file. This index file acts as a master list that organizes multiple sitemaps, allowing search engines to locate and index them easily.

Example of a Sitemap Index File:

6. Update Sitemaps Regularly

Sitemaps should be updated whenever new pages are added, old pages are removed, or existing pages are significantly changed. An outdated sitemap could prevent search engines from discovering your latest content or, worse, lead them to pages that no longer exist.

7. Submit Your Sitemap in Google Search Console

Submitting a sitemap in Search Console shows you when Googlebot accessed it and any processing errors.

Steps to Submit in Search Console:

1. Log in to Google Search Console and choose the property.
2. Go to the Sitemaps section and enter your sitemap URL.
3. Click Submit to allow Google to start crawling.

8. Limit the URLs to Essential Content

Sitemaps should contain only pages you want to appear in search results. Avoid adding “noindex” pages, private or test pages, and filtered or duplicate content.

For instance, if your site includes blog categories or search filters that create duplicate or similar pages, exclude these from your sitemap.

Bonus: Priority and Change Frequency Tags (Google Ignores Them)

The optional priority and changefreq tags are part of the sitemap protocol, but Google ignores them, so you can leave them out. Keep lastmod accurate instead.

Clean the URL list: run sitemap URLs through the Redirect Checker and keep only URLs that return 200 and are the canonical version.

How to Troubleshoot Your Sitemap: Common Issues and Solutions

1. Problem: Sitemap Not Found by Google
   Solution: If Google Search Console shows a “Sitemap couldn’t be fetched” error, confirm that the sitemap URL is correct and accessible. Ensure your sitemap is located at https://www.example.com/sitemap.xml or in an accessible location. You can also check your robots.txt file to confirm it’s correctly referencing the sitemap. If the sitemap URL works but Google still can’t access it, try resubmitting in Search Console and verifying that there are no server errors or permissions blocking Googlebot.
2. Problem: URLs in Sitemap Aren’t Indexed
   Solution: If pages listed in your sitemap aren’t getting indexed, verify that these pages aren’t blocked by your robots.txt file or set with a “noindex” meta tag. This could prevent search engines from indexing them. Next, confirm that the pages are loading correctly and that there are no errors when accessing them. In Search Console, check the Page indexing report for the reasons Google gives for not indexing these URLs, such as crawl errors or duplicate content.
3. Problem: Sitemap Contains Broken Links
   Solution: Broken links in a sitemap lead to crawl errors and can reduce Google’s efficiency in indexing your site. Regularly scan your sitemap using online tools like Screaming Frog or Dead Link Checker to identify broken links. Once identified, remove these links from the sitemap or replace them with valid URLs. You can also use the Page indexing report in Search Console to see URLs Google could not fetch.
4. Problem: Sitemap Exceeds Size Limits
   Solution: Sitemaps have a limit of 50MB or 50,000 URLs. If your sitemap exceeds this, split it into multiple sitemaps and link them in a sitemap index file. Each smaller sitemap should contain a manageable number of URLs. For example, if you have 100,000 URLs, split them into two sitemaps, each with 50,000 URLs, and link them through a sitemap index file. Submit this index file to Search Console for easier management and tracking.
5. Problem: Incorrect Encoding or Format
   Solution: Google requires sitemaps to be encoded in UTF-8 and follow the XML format precisely. If there’s an encoding issue, it can prevent Google from reading your sitemap. Open the sitemap in a text editor and ensure it starts with the following declaration:
   <?xml version=”1.0″ encoding=”UTF-8″?>

Additionally, check that the sitemap structure matches XML standards. If you encounter formatting errors, consider regenerating the sitemap using a plugin or tool, such as Yoast SEO for WordPress, which automatically handles encoding and formatting.

1. Problem: Duplicate URLs in Sitemap
   Solution: Duplicates can confuse search engines and waste crawl resources. Ensure that only canonical URLs are in your sitemap and avoid listing alternate URLs, such as both mobile and desktop versions of a page. Remove any duplicate URLs and keep only the most relevant version. Tools like Screaming Frog and XML sitemap validators can help identify duplicate entries.

Final Words

A sitemap is essential for guiding search engines and users through your website. It helps search engines discover URLs but does not guarantee indexing. Whether in XML for search engines or HTML for users, sitemaps are critical in organizing website content.

Creating a sitemap can be done manually for small sites or using tools for larger ones, making it easier to maintain accuracy.

FAQs

What is a sitemap in SEO?

A sitemap is a file listing the URLs, videos and other files you want search engines to know about, optionally with details such as last-modified dates and language versions. Search engines read it to crawl your site more efficiently. It helps discovery but does not guarantee crawling or indexing.

Do I need a sitemap?

Google says you may not need one if your site is small (about 500 pages or fewer) and fully reachable through internal links. A sitemap helps most on large sites, new sites with few external links, and sites with lots of video, images or news content.

How many URLs can a sitemap contain?

One sitemap file can hold up to 50,000 URLs or 50 MB uncompressed, whichever limit you reach first. If you exceed either, split the URLs across several sitemaps and list them in a sitemap index file, then submit the index file to Google.

Does Google use priority and changefreq in a sitemap?

No. Google ignores the priority and changefreq values. It does use lastmod, but only if the date is consistently and verifiably accurate, meaning it matches real, significant changes to the page. Leave lastmod out rather than setting it automatically to the current date.