Uses of Class
com.norconex.collector.http.robot.RobotsMeta
-
Packages that use RobotsMeta Package Description com.norconex.collector.http.pipeline.importer com.norconex.collector.http.robot com.norconex.collector.http.robot.impl -
-
Uses of RobotsMeta in com.norconex.collector.http.pipeline.importer
Methods in com.norconex.collector.http.pipeline.importer that return RobotsMeta Modifier and Type Method Description RobotsMetaHttpImporterPipelineContext. getRobotsMeta()Methods in com.norconex.collector.http.pipeline.importer with parameters of type RobotsMeta Modifier and Type Method Description voidHttpImporterPipelineContext. setRobotsMeta(RobotsMeta robotsMeta) -
Uses of RobotsMeta in com.norconex.collector.http.robot
Methods in com.norconex.collector.http.robot that return RobotsMeta Modifier and Type Method Description RobotsMetaIRobotsMetaProvider. getRobotsMeta(Reader document, String documentUrl, ContentType contentType, Properties httpHeaders)Extracts Robots meta information for a page, if any. -
Uses of RobotsMeta in com.norconex.collector.http.robot.impl
Methods in com.norconex.collector.http.robot.impl that return RobotsMeta Modifier and Type Method Description RobotsMetaStandardRobotsMetaProvider. getRobotsMeta(Reader document, String documentUrl, ContentType contentType, Properties httpHeaders)
-