3DOrchestrate can be configured to use a third-party distributed resource management system to optimize the utilization of compute resources for high-performance computing tasks. Once the system is configured, you can set DRM options for individual Automation Process Composer adapters (via the Affinities tab on the Activity Options dialog box). Enabling the third-party DRM feature can significantly enhance the scheduling capabilities of the 3DOrchestrate engine, particularly for process simulations with time-consuming, resource-intensive work items. When using the default DRM option, the 3DOrchestrate engine requires that stations be running and awaiting work items sent from the 3DOrchestrate server. When using the third-party DRM option, the 3DOrchestrate engine uses the DRM to launch 3DOrchestrate station processes as needed on selected compute nodes. Each process is then connected to the 3DOrchestrate, runs a single work item, and is terminated. Each work item dispatched with the DRM corresponds to a single DRM job. This configuration gives the third-party DRM direct control over the station processes that are actually doing work, both for resource management and accounting purposes, and allows the 3DOrchestrate server to use the DRM's sophisticated scheduling capabilities to select the optimal node for each piece of work. Unlike the default DRM system, a third-party DRM imposes some scheduling and process-launching overhead on each 3DOrchestrate work item. However, for compute-intensive, long-running work items the improved scheduling and job management that third-party DRM provides greatly outweighs this overhead. For simulation processes composed of significant numbers of small, short-running work items, a third-party DRM can reduce 3DOrchestrate engine job throughput when used exclusively. Your administrator can configure custom DRM options that you can select from the Resource manager menu in the Affinities tab. For example, you might have an option to select a LSF network of hosts that serve as 3DOrchestrate stations. See Using Distributed Resource Management in the 3DOrchestrate - Installation and Administration Guide for more information. |