Crawlability · 16 Sep 2026
Sitemap URLs with Noindex: Resolving the Conflict
A sitemap entry and a noindex directive send different signals; align them with the page's intended indexability.
Read guide →NOTABIS SEO / LEARN
Practical guides for the SEO findings NOTABIS measures. Learn what an issue means, how to verify it, when it is intentional, and how to fix it safely.
Crawlability · 16 Sep 2026
A sitemap entry and a noindex directive send different signals; align them with the page's intended indexability.
Read guide →Crawlability · 16 Sep 2026
Authentication redirects protect private routes but can hide public pages when middleware is too broad. NOTABIS records final URLs and page context so private intent can be separated from accidental redirects.
Read guide →Crawlability · 16 Sep 2026
Different URLs can serve the same or similar content through parameters, old routes, print views, or tracking. Align canonical, redirect, link, and sitemap signals around each variant’s intended purpose.
Read guide →Crawlability · 16 Sep 2026
An XML sitemap lists public URLs or child sitemaps to support discovery. NOTABIS validates access, XML structure, headers, namespaces, and URL reconciliation without treating a sitemap as an indexing guarantee.
Read guide →Crawlability · 16 Sep 2026
Robots.txt controls crawler access, while noindex tells a crawler that it may fetch a page but should not include it in search. They are different controls for different goals.
Read guide →Crawlability · 16 Sep 2026
An edge-blocked audit received a firewall, CDN, WAF, or anti-bot response instead of the site page. NOTABIS recognises selected 403/429 and challenge responses, then stops normal scoring.
Read guide →Crawlability · 16 Sep 2026
NOTABIS reviews URLs longer than 2,000 characters or with more than five query parameters. These are diagnostic thresholds, not universal SEO limits; inspect the purpose and canonical strategy of each variant.
Read guide →Crawlability · 16 Sep 2026
NOTABIS reports an invalid sitemap namespace when a declared sitemap uses a non-standard non-empty default namespace. Correct the root namespace before relying on the file for discovery.
Read guide →Crawlability · 16 Sep 2026
A sitemap content-type issue occurs when a parseable sitemap response does not advertise an XML content type. NOTABIS flags the header separately from XML validity and URL quality.
Read guide →Crawlability · 16 Sep 2026
An accessible sitemap is a public XML file that an audit can fetch and parse as a valid urlset or sitemap index. NOTABIS records this as a passed availability check, not a guarantee of indexing.
Read guide →Crawlability · 16 Sep 2026
NOTABIS reports robots.txt unavailable when its request fails before a usable response can be processed. The finding concerns crawl-policy retrieval and does not by itself remove pages from search.
Read guide →Crawlability · 16 Sep 2026
A page-wide nofollow directive tells crawlers not to follow links from that response. NOTABIS checks robots meta and X-Robots-Tag directives, so the report is distinct from individual rel="nofollow" links.
Read guide →Crawlability · 16 Sep 2026
NOTABIS reports a deep crawl page when its measured shortest internal-link path is more than five levels from the submitted URL. Use the finding to review discoverability and site architecture.
Read guide →Crawlability · 9 Sep 2026
A sitemap-unavailable finding means a declared sitemap could not be fetched or processed during the audit. Check the exact URL, response, content type, XML, redirects, and access controls before changing your site.
Read guide →Crawlability · 9 Sep 2026
A noindex directive asks compliant search crawlers not to include a page in search results. It is correct for many private or utility pages, but harmful when placed on a public page that should be discoverable.
Read guide →Run a NOTABIS SEO audit to crawl your pages and connect measured findings with practical guidance.
Run an audit →