job.configuration.results.results_manifest package

Submodules

job.configuration.results.results_manifest.results_manifest module

This module is concerned with the scale output manifest. Scale jobs are expected to produce an output manifest. Scale needs to parse this manifest to bring the information into the system. The output files should match the job interface

class job.configuration.results.results_manifest.results_manifest.ResultsManifest(json_manifest=None)

Bases: object

Represents the interface for executing a job

add_files(files_array)

adds the files to the manifest if they are not already in the manifest. If there is already an entry for that file name it will be ignored :param files_array: an array of files that should be added to the manifest :type files_array: an array of the format RESULTS_MANIFEST_SCHEMA[“definitions”][“files”]

get_files()

gets the output files associated with this manifest :return: an array of dictionaries. Each dictionary describes a file in the manifest. The format of the dict is described by results_manifest.RESULTS_MANIFEST_SCHEMA[“definitions”][“files”] :rtype: array of dict

get_json_dict()

Return the json dictionary associated with this manifest

Returns:json dict representing this manifest
Return type:dict
get_parse_results()

gets the parsed input files associated with this manifest :return: an array of dictionaries. Each dictionary describes the location of a geojson associated with an input filein the manifest. The format of the dict is descibed by results_manifest.RESULTS_MANIFEST_SCHEMA[“definitions”][“parse_results”] :rtype: array of dict

validate(output_file_definitions)

Validates the results manifest against given output file definitions. This does not validate that the parse_data matches the job data inputs.

Parameters:output_file_definitions (dict of tuples) – A dictionary with each output param name mapped to a tuple with (is_multiple (bool), required(bool))

job.configuration.results.results_manifest.results_manifest_1_0 module

This module is concerned with the scale output manifest. Scale jobs are expected to produce an output manifest. Scale needs to parse this manifest to bring the information into the system. The output files should match the job interface

class job.configuration.results.results_manifest.results_manifest_1_0.ResultsManifest(json_manifest)

Bases: object

Represents the interface for executing a job

add_files(files_array)

adds the files to the manifest if they are not already in the manifest. If there is already an entry for that file name it will be ignored :param files_array: an array of files that should be added to the manifest :type files_array: an array of the format RESULTS_MANIFEST_SCHEMA[“definitions”][“files”]

get_files()

gets the output files associated with this manifest :return: an array of dictionaries. Each dictionary describes a file in the manifest. The format of the dict is described by results_manifest.RESULTS_MANIFEST_SCHEMA[“definitions”][“files”] :rtype: array of dict

get_json_dict()

Return the json dictionary associated with this manifest

Returns:json dict representing this manifest
Return type:dict
get_parse_results()

gets the parsed input files associated with this manifest :return: an array of dictionaries. Each dictionary describes the location of a geojson associated with an input filein the manifest. The format of the dict is descibed by results_manifest.RESULTS_MANIFEST_SCHEMA[“definitions”][“parse_results”] :rtype: array of dict

validate(output_file_definitions)

Validates the results manifest against given output file definitions. Throws a :class job.configuration.results.exceptions.ResultsManifestAndInterfaceDontMatch: if the manifest doesn’t match the outputs. This does not validate that the parse_data matches the job data inputs. :param output_file_definitions: A dictionary with each output param name mapped to a tuple with (is_multiple (bool), required(bool)) :type output_file_definitions: dict of tuples

Module contents