Uses of Class
com.norconex.collector.http.robot.RobotsMeta
-
Packages that use RobotsMeta Package Description com.norconex.collector.http.pipeline.importer com.norconex.collector.http.robot com.norconex.collector.http.robot.impl -
-
Uses of RobotsMeta in com.norconex.collector.http.pipeline.importer
Methods in com.norconex.collector.http.pipeline.importer that return RobotsMeta Modifier and Type Method Description RobotsMeta
HttpImporterPipelineContext. getRobotsMeta()
Methods in com.norconex.collector.http.pipeline.importer with parameters of type RobotsMeta Modifier and Type Method Description void
HttpImporterPipelineContext. setRobotsMeta(RobotsMeta robotsMeta)
-
Uses of RobotsMeta in com.norconex.collector.http.robot
Methods in com.norconex.collector.http.robot that return RobotsMeta Modifier and Type Method Description RobotsMeta
IRobotsMetaProvider. getRobotsMeta(Reader document, String documentUrl, ContentType contentType, Properties httpHeaders)
Extracts Robots meta information for a page, if any. -
Uses of RobotsMeta in com.norconex.collector.http.robot.impl
Methods in com.norconex.collector.http.robot.impl that return RobotsMeta Modifier and Type Method Description RobotsMeta
StandardRobotsMetaProvider. getRobotsMeta(Reader document, String documentUrl, ContentType contentType, Properties httpHeaders)
-