What is the search crawler?

Pinned

37 Comments

  • Gorka Cardona-Lauridsen
    Zendesk Product Manager

    Korak Purkayastha You can have multiple crawlers from the same or multiple Zendesk accounts using the same sitemap- I.e. indexing the same external website. Only things you need to be aware off is that:

    1. The sitemap always needs to be hosted on the same domain as the pages it points to.
    2. You need to add the domain verification tag for each crawler to the homepage of the domain.

    The above goes for both when you have multiple crawlers crawling the same site or only one crawler crawling a site.

    0
  • Jordan Brown

    Gorka Cardona-Lauridsen when will you post about the error Locale not detected?

    0
  • Korak Purkayastha

    Gorka Cardona-Lauridsen We started seeing "Locale not detected" error a few days ago for all pages from the site which the crawler was able to index previously. I confirmed that there was no changes to the "lang" tag and it still matches with the locale enabled in Guide. Could you shed some light on what might be causing this? I also reached out to Zendesk Support about this, but haven't seen any resolution so far.

    1
  • Gorka Cardona-Lauridsen
    Zendesk Product Manager

    Jordan Brown and Korak Purkayastha

    Appologies for the long turn around. Here's the post about how language detection works.
    We recently made some changes to the language detection and that's probably why you experience the changes.

    TLDR is that we look for a locale in the lang tag, Content-language header and <meta tag> in that order and we match the first found with any exact match in the translations you've set up any help center in the account to be in. If not locale is detected we use CLD to determine the language and we match that to all locales you have enables that has that language.

    If there is no match to HC locales as described or no locale or language can be determined the page returns the error "Locale not detected".

    0
  • Gorka Cardona-Lauridsen
    Zendesk Product Manager

    Korak Purkayastha

    I confirmed that there was no changes to the "lang" tag and it still matches with the locale enabled in Guide.

    Is it still happening?

    If it is, could you let me know which account it is and enable account access for us?

    0
  • Korak Purkayastha

    Gorka Cardona-Lauridsen It is now resolved. Thank you.

    0
  • Walter

    Hi Gorka Cardona-Lauridsen,

    Regarding the product limits mentioned here.

    Product limits

    • General Federated search limit of 50000 external records.
    • Record max title length - 255 characters
    • Record max body length - 10000 characters

    Does this mean that each External Content Source can have up to 50,000 records?  Or that the Federated Search can only get up to 50,000 results from all active External Content Sources?

    0

Please sign in to leave a comment.

Powered by Zendesk