WEBCRAWL_RECURSEFLAGS enumeration

Obsolete. Contains the flags for the default link crawling agent included with the Information Delivery API.

Syntax

typedef enum WEBCRAWL_RECURSEFLAGS { 
  WEBCRAWL_DONT_MAKE_STICKY    = 0x0001,
  WEBCRAWL_GET_IMAGES          = 0x0002,
  WEBCRAWL_GET_VIDEOS          = 0x0004,
  WEBCRAWL_GET_BGSOUNDS        = 0x0008,
  WEBCRAWL_GET_CONTROLS        = 0x0010,
  WEBCRAWL_LINKS_ELSEWHERE     = 0x0020,
  WEBCRAWL_IGNORE_ROBOTSTXT    = 0x0080,
  WEBCRAWL_ONLY_LINKS_TO_HTML  = 0x0100
} WEBCRAWL_RECURSEFLAGS;

Constants

  • WEBCRAWL_DONT_MAKE_STICKY
    Instructs the agent to cache the downloaded resources normally. If this value is not set, the agent makes the entries "sticky," which prevents them from being removed during a normal cleanup operation.

  • WEBCRAWL_GET_IMAGES
    Instructs the agent to download any images associated with the resource.

  • WEBCRAWL_GET_VIDEOS
    Instructs the agent to download any videos associated with the resource.

  • WEBCRAWL_GET_BGSOUNDS
    Instructs the agent to download any background sounds associated with the resource.

  • WEBCRAWL_GET_CONTROLS
    Instructs the agent to download any controls associated with the resource.

  • WEBCRAWL_LINKS_ELSEWHERE
    Instructs the agent to follow links that go to sites outside of the site where the resource resides.

  • WEBCRAWL_IGNORE_ROBOTSTXT
    Instructs the agent to ignore any robot scripts.

  • WEBCRAWL_ONLY_LINKS_TO_HTML
    Instructs the agent to not download links to known non-HTML files.

Remarks

Windows Internet Explorer 7 and later. This information is obsolete and should not be used.

Requirements

Minimum supported client

Windows XP

Minimum supported server

Windows 2000 Server

Header

Subsmgr.h