Open topic with navigation

# Crawl Parameters

The parameters in this section configure how the connector crawls the Web.

Depth

FollowFlash

FollowRobotProtocol

IgnoreCanonicalLinks

SpiderUrlCantHaveRegex

SpiderUrlMustHaveRegex

StayOnSite

© 2016 Hewlett Packard Enterprise Development LP | Send documentation feedback to HPE Close We welcome your comments! To open the configured email client on this computer, open an email window. Otherwise, copy the information below to a web mail client, and send this email to AutonomyTPFeedback@hpe.com. Product: Topic Title: Help Topic: Feedback:

_HP_HTML5_bannerTitle.htm