We are trying to implement checking for broken links, using gitlab ci/cd in our service - https://support.moysklad.ru/. Verification is implemented by executing the GET request and reading the response code. We always get 403 when executing a request.
In some cases it was possible to eliminate this by adding header - "User-Agent"
Is it possible to whitelist our broken link checking bot?
Please sign in to leave a comment.