Using WebCrawler to crawl wikis

How do I use the WebCrawler to crawl specific amazon internal wiki sites that I already have access to. I’ve tried a number of configurations but the WebCrawler is failing because of authentication issues. It seems like this should be straight forward.

Hi @desalvow,

Welcome to the Quick Community! Could you please specify or share a screenshot of the error(s) that you are receiving? This will help me get a better idea of why this issue is occurring.

Thank you!

Hi @desalvow,

Just checking back in since this thread hasn’t received a response in a while. Were you able to see my most recent reply and/or find a solution yourself in the meantime? Please help the community by marking this answer as “Solution” or following up in general within the next 3 business days!

Thank you!