Reference :: Processing

Prerequisites

In preparation to this topic, the following 2 pages should be read first:

Processing related services offer the following features

  • Sending files for processing. (including metadata)
  • Dealing with multiple file sources.
  • Query file content for external processing.
  • Store final processing results (to be used by GRID internal processing routines).
  • Manage the processing state via jobs (includes state monitoring from external).
  • Trigger reprocessing on existing content.

Primary Interfaces

Processing is only implemented as SOAP interfaces and has 3 main areas of usage:

  • Monitoring currently processed jobs.
  • Harvesting (sending of files attached to their source information)
  • Storing processing results.

While monitoring is relatively easy and does only require the knowledge of job related methods, all other areas require an in-depth knowledge of the complete data model used inside the processing SOAP service.

  • Monitoring:
    Study all methods matching get*Job*() contained within /ws/level-0/internal/processing. The Job type can be found within the following class diagram.
  • Harvesting:
    Study all methods contained within /ws/level-0/internal/processing except the methods storeProcessingResultsAndFinalizeJobs(...).
    Note: Under normal circumstances, methods of the service /ws/level-0/internal/sources are not required for processing. Sources are attached via the assign*() methods that are part of the processing service.
  • Store Processing Results:
    Study the complete data model used within the ACL service methods and get familiar with the method storeProcessingResultsAndFinalizeJobs(...) offered within /ws/level-0/internal/processing.