Scale Documentation

Scale is an open source system that provides management of automated processing on a cluster of machines. It allows users to define jobs, which can be any type of script or algorithm. These jobs run on ingested source data and produce product files. The produced products can be disseminated to appropriate users and/or used to evaluate the producing algorithm in terms of performance and accuracy.

Scale was developed at the National Geospatial-Intelligence Agency (NGA).

• Overview
• Command Line Client
  • Overview
  • Creating New Job Types
• Algorithm Integration into Scale
  • Making a Scale-compatible Algorithm
  • Capturing your algorithm outputs with a Scale Results Manifest
  • Encapsulating your algorithm in a Docker container
  • Adding your new job into a Scale job type
  • Adding your new job into a Scale recipe
  • Results Manifest
• Architecture
  • Overview
  • Jobs and Recipes
  • ElasticSearch Logs
  • Messaging System
  • Import/Export
  • Scan
  • Strike
  • Triggers
  • Workspaces
  • Django/Code Base
• REST API
  • API Versions
  • Current v6 Services
• Install
• Development

Indices and tables

• Index
• Module Index
• Search Page