Command Dispatch System Administrator’s Guide

About this Document

Welcome to the GeoCue Command Dispatch System Administrator’s Guide.

This document supplements the GeoCue User Guide and contains advanced information for the GeoCue Command Dispatch System (CDS). This guide is aimed at advanced users of the Command Dispatch System. Note that most information in this guide is not required for routine dispatched and distributed processing.

Contents

1 Introduction
1.1 Installation
1.2 Licensing

2 Terminology
2.1 Dispatch vs. Distributed
2.2 Tasks and Subtasks
2.3 Machine Resources
2.4 Command Resources
2.5 Processing Priority
2.6 Processing Groups
2.7 Clouds (Machine Clusters)
2.8 Priority Weights
2.9 Machine Restriction Time
2.10 Processing Group Restriction Time

3 Dispatching and Monitoring Tasks (Commands)
3.1 Dispatch Invocation
3.2 The Dispatch Dialog
3.2.1 Schedule
3.2.2 Machine Mode
3.2.3 Cloud Mode
3.3 Machine/Cloud Tables
3.3.1 Machine Table Fields
3.3.2 Cloud Table Fields
3.3.3 Override Auto-Start Next Step
3.4 Command Dispatch System Tool Tray Tool
3.5 Monitoring Dispatched Tasks
3.5.1 Tasks Table
3.5.2 Sub Task Dispatch Status Summary
3.5.3 Subtasks Table
3.6 Clearing Rows from the Tasks Pane
3.7 Rescheduling a Task
3.8 Pausing a Task
3.9 Terminating a Task
3.10 Modifying a Subtask (GeoCue Administrators Only)
3.11 Creating Entity Queues
3.12 Monitoring Machine Activity

4 Configuring Machines
4.1 Adding Machines to the CDS
4.2 Machine Resources
4.3 Setting Machine Configuration Parameters
4.4 Machine Schedules
4.5 Machine Loading
4.6 Machine Group/Cloud Membership

5 Configuring Commands
5.1 Enabling Dispatch
5.2 Restrict to Single Instance
5.3 Auto Kill Size
5.4 Caching
5.5 Machines
5.6 Maximum Failures Allowed
5.7 Predicted Sizes
5.8 Equilibrium Time

6 Configuring Priority
6.1 Priority Algorithm
6.2 Setting Priority Weights
6.2.1 Entity Priority Weight
6.2.2 Project and Processing Group Priority Weight, Clipping
6.3 Setting Relative Priority
6.3.1 Entity Relative Priority
6.3.2 Project Relative Priority
6.3.3 Processing Group Relative Priority

7 Configuring Processing Groups
7.1 Processing Groups Overview
7.2 Creating Groups
7.3 Configuring Resource Groups
7.3.1 Setting Resource Allocations (non-scheduled)
7.3.2 Reserving Resources
7.3.3 Scheduling Resources
7.4 The RESERVED Group
7.5 Processing Groups Considerations

8 Reserving Machine Resources for non-CDS Use
8.1 Reserving Machine Resources
8.2 Scheduling the RESERVED Group
8.3 An Example

9 Configuring Clouds
9.1 Configuring Clouds
9.2 Processing Groups and Cloud
9.3 The Universal Group/Cloud
9.4 Summary

10 Configuring Commands within Processing Groups/Clouds
10.1 Allocating Resources at the Command Level
10.2 Reserving Command Resources
10.3 Scheduling Command Resources

11 Troubleshooting
11.1 Tasks Remain in a Pending State

12 Command Dispatch System Internals
12.1 Processing Granularity
12.2 Machine Assignment
12.2.1 Machine Dispatch Mode
12.2.2 Cloud Dispatch Mode
12.3 Subtask Queuing
12.4 Machine (Node) Selection
12.5 Subtask Execution
12.6 How the CDS Dispatches With Processing Groups
12.6.1 Dispatch Queue Entry
12.6.2 Processing Groups and Dispatch
12.6.3 Dispatch Pass One
12.6.4 Dispatch Pass Two
12.6.5 Starvation Prevention
12.7 Subtask Completion Processing

13 Concluding Remarks

14 Acronyms

Share

GeoCue Support has written 725 articles