What are Sitemaps?

Sitemaps are a protocol in XML format designed to inform search engines about the URLs on a website that are available for web crawling. By using sitemaps, webmasters can include critical information about each URL, such as:

• Last Updated: When the URL was last modified.
• Change Frequency: How often the content at the URL is expected to change.
• Priority: The importance of the URL in relation to other URLs on the site.

This additional information allows search engines to crawl the site more efficiently and helps them discover URLs that might be isolated from the main content of the site.

Features

The app offers a variety of configuration settings that allow users to customize sitemap generation to their specific needs:

• Keywords to skip: The application allows defining specific keywords to be ignored during the crawling procedure. This is particularly useful for excluding irrelevant pages.
• Allowed external links: The configuration offers the possibility to enable or disable crawling of external links. This gives users control over whether they want to have only internal links in their sitemap.
• Change frequency: Users can specify how often the content of their pages is expected to change (daily, weekly or monthly). This setting helps search engines to better assess the relevance of the pages.
• Maximum number of URLs: The app allows setting the maximum number of URLs to be captured during the crawling process. This is especially useful for large websites to keep the sitemap organized.
• Dynamic file names: The generated sitemap is saved under a dynamically created file name. This ensures easy management and traceability.