Class TurWCPluginProcess
java.lang.Object
com.viglet.turing.connector.plugin.webcrawler.TurWCPluginProcess
-
Field Summary
Fields -
Constructor Summary
ConstructorsConstructorDescriptionTurWCPluginProcess(int timeout, String referrer, TurWCAllowUrlRepository turWCAllowUrlRepository, TurWCNotAllowUrlRepository turWCNotAllowUrlRepository, TurWCFileExtensionRepository turWCFileExtensionRepository, TurWCAttributeMappingRepository turWCAttributeMappingRepository, TurWCStartingPointRepository turWCStartingPointsRepository, TurConnectorContext turConnectorContext) -
Method Summary
Modifier and TypeMethodDescriptionstatic StringgetCRC32Checksum(byte[] bytes) voidstart(TurWCSource turWCSource)
-
Field Details
-
MAILTO
- See Also:
-
TEL
- See Also:
-
JAVASCRIPT
- See Also:
-
A_HREF
- See Also:
-
ABS_HREF
- See Also:
-
WILD_CARD
- See Also:
-
AUTHORIZATION
- See Also:
-
BASIC
- See Also:
-
WEB_CRAWLER
- See Also:
-
-
Constructor Details
-
TurWCPluginProcess
public TurWCPluginProcess(@Value("${turing.wc.timeout:5000}") int timeout, @Value("${turing.wc.referrer:https://www.google.com}") String referrer, TurWCAllowUrlRepository turWCAllowUrlRepository, TurWCNotAllowUrlRepository turWCNotAllowUrlRepository, TurWCFileExtensionRepository turWCFileExtensionRepository, TurWCAttributeMappingRepository turWCAttributeMappingRepository, TurWCStartingPointRepository turWCStartingPointsRepository, TurConnectorContext turConnectorContext)
-
-
Method Details
-
start
-
getCRC32Checksum
-