EnFuzion 8.0 User Manual

Axceleon


Table of Contents
Preface
1. Overview of EnFuzion
The Power of Many
Basic EnFuzion Concepts
Parametric Execution
Run
Submit Computers
Root Computers
Node Computers
User
Using EnFuzion
EnFuzion Installation and Configuration
Executing Runs and Jobs
Root - Node Communication
Starting Nodes
Handling of Network Failures
Security Issues
Submit Environment
Directory Layout
Executables
Configuration Files
Root Environment
User Account
Directory Layout
Executables
Configuration Files
Node Environment
User Account
Directory Layout
Executables
Configuration Files
Job Execution Environment
Handling of Job Execution Errors
2. Tutorial
Quick EnFuzion Setup Instructions for Windows NT/2000/XP
Installation of the EnFuzion Root
Installation of an EnFuzion Node
License Installation
EnFuzion Configuration
Execution of a Sample Parametric Study
Using the Web Based GUI
Quick EnFuzion Setup Instructions for Linux/Unix
Installation of the EnFuzion Root
Installation of an EnFuzion Node
License Installation
Node Configuration For Remote Access
EnFuzion Configuration
Execution of a Sample Parametric Study
Using the Web Based GUI
Creating The Sample Parametric Study
Introduction to Parametric Studies
Description of the Sample Parametric Study
Creating the Sample Plan File
Creating the Sample Run File
Creating Your Own Parametric Study
3. Windows NT/2000/XP Installation and Operation
Installing EnFuzion Software on Windows NT/2000/XP
Reinstalling EnFuzion
Installing EnFuzion on Multiple Computers
Installing Only EnFuzion Root Software
Installing Only EnFuzion Node Software
Installing Only EnFuzion Submit Software
Handling of Installation Problems
Installing EnFuzion License
Installing EnFuzion as a Network Service
Network Service Installation
The enfstartup Program
The enfboot.bat Batch File
The Setup Program
Network Installation on Windows NT/2000/XP
The Netsetup Program
Remote Installation
Installation in a Mixed Windows NT/2000/XP and Linux/Unix Environment
Modifying the Installation Defaults
Removal of EnFuzion Software from Windows NT/2000/XP
Windows NT/2000/XP Specific Issues of EnFuzion Operation
Starter Service
The Enfkill Utility
Performance Considerations
4. Linux/Unix Installation and Operation
Installing EnFuzion Software on Linux/Unix
Installing EnFuzion Root Software
Installing EnFuzion Node Software
Installing EnFuzion Submit Software
Reinstalling EnFuzion
Installing EnFuzion on Multiple Computers
Handling of Installation Problems
Installing EnFuzion License
Enabling Linux/Unix Node Computers for EnFuzion Use
Configuring EnFuzion Nodes for Remote ssh Access
Installing EnFuzion as a Network Service
Network Service Installation on Red Hat Linux
Manual Network Service Installation
Network Installation on Linux/Unix
Enfinstall Program
Remote Installation
Testing Remote EnFuzion Operation
Installation in a Mixed Linux/Unix and Windows NT/2000/XP Environment
Removal of EnFuzion Software from Linux/Unix
Linux/Unix Specific Issues of EnFuzion Operation
Performance Considerations
5. Submit Configuration
Specifying the EnFuzion Service Address
The submit.config File
6. Root Configuration
Specifying EnFuzion Nodes
The enfuzion.nodes File
Windows Based Nodes
Linux/Unix Based Nodes
Custom Node Start
Specifying Node Port Number
Independent Node Start
Connecting Node to the EnFuzion Root
Specifying Root Configuration Options
The root.options File
Specifying Available Third Party Software Licenses
Enforcing Privileges
Rejecting Anonymous Run Submission
Prevent Execution of User Programs on the EnFuzion Root System
Port Number for the Eye
Port Number for Node Connections
Port Number for Job Execution
Port Number for Node Starter Connections
Queueing Policy
Deleting Obsolete User Directories
Allowing Remote Access to the Dispatcher Interface
Restricting Access to the Dispatcher Interface
Restricting Node Access to the Dispatcher
Restricting Access to the Eye
Starting the Eye
Terminating the Eye
Off Periods
Specifying Mail Server System
Specifying Mail Service Port
Specifying Mail Sender
Concurrent Node Activations
Node Restart Period
Heartbeat Period
Disconnect Period
Complete Logs
Maximum Dispatcher Log Size
Maximum Datastream Job Size
Sample root.options File
Specifying User Identities
The users File
Specifying Groups
The groups File
Specifying Administrators
The admins File
Specifying User Accounts for Job Execution on Nodes
The user.accounts File
Root Based Security Features
Encrypted Passwords in enfuzion.nodes
7. Node Configuration
Specifying Node User Accounts
Specifying Node Configuration Options
The node.config File
Requested Concurrent Jobs
Node Port
Connect
Connect Host
Connect Port
Connect Retry
Connect Delay
Batch
Node Port Message
Hello Message
Sample node.config File
Specifying Load Monitoring Options
The enfuzion.options File
File Syntax
Priority of User Processes
Screen Saver
Idle Time
Temporary Disk Space
Working Disk Space
Properties
Used Virtual Memory Space
Stop Virtual Memory Limit
Available Main Memory
Stop Main Memory Limit
Busy Load Limit
Stop Load Limit
Busy CPU Usage
Stop CPU Usage
Busy Processor Queue
Stop Processor Queue
Off and On Periods
Stop Processes
User Busy Condition
User Stop Condition
Stop Action
Requested Concurrent Jobs
Log File Size
Log File Fraction
Node Directory
Termination Signal
Mouse Device
Console Device
Sample enfuzion.options File
Node Based Security Features
Trusted Hosts and Executables
User Defined Decryption Primitives
Root Authentication
8. Run Description
Introduction
Command Line Programs
Scripts
Parametric Executions
Creating a Plan File
Specifying Input Values
Description of Plan Files
Description of Run Files
Variables
Variable Types
Scope
Retrieving and Setting Values
Options
Parameters
Multiple Runs
Priorities
Preemption
Persistence
Resource Management
Requirements
Properties
Requirement Matching
Timeouts/Error Handling
User Errors
Timeout for Run Execution
Timeout for Job Execution
Timeout for User Programs
Multiple Job Executions
Timeout for Datajob Execution
Timeouts for Persistent User Programs
Completed Run Directories
Datajobs
Specifying Datajobs
Executing Datajobs
9. Run Execution
The Dispatcher
The Dispatcher Options
Single and Multiple Run Execution
Handling of the Eye by the Dispatcher
Submitting a Run
User Assignment
Submission from a Web Browser
Submission from a Command Line
Submission from a Custom Program
Resubmitting Unfinished Jobs
Monitoring Execution
Dispatcher Logs
Monitoring from a Web Browser
Monitoring from a Command Line
Monitoring from a Custom Program
Retrieving Results
Retrieving Files on the EnFuzion Root System
Retrieval with a Web Browser
Retrieval from a Command Line
Retrieval with a Custom Program
Producing Accounting Reports
Reports from a Web Browser
Reports from a Command Line
10. Interfacing with the Dispatcher
Graphical Web Based Interface
The Eye
Using the Eye
Handling of Privileges
Access Control
Command Line Interface
The enfsub Program
The Enfcmd Program
Handling of Privileges
Access Control
Application Programming Interface
Connecting with the Dispatcher
Description of Commands
Handling of Privileges
Access Control
Using the Programming Interface From C
11. Program Reference
Enfacct
Enfcmd
Enfdispatcher
The Enfexecute
The Eye
Enfgenerator
Enfinstall
Enfkey
Enfkill
Enfmail
Enfnodeserver
Enfpreparator
Enfprotectpass
Enfpurge
Enfreport
Enfstartup
Enfsub
Netsetup
The Setup Program
Starter Service
Uninstall
A. Frequently Asked Questions
1. EnFuzion root programs are not working. How can I proceed?
2. An EnFuzion node is not working. How can I proceed?
3. The license is not working. How can I proceed?
4. Load monitoring is not working. How can I proceed?
5. My application is not executing properly on nodes. What should I do?
6. Does EnFuzion require Windows NT Server for its operation?
7. Does EnFuzion work in mixed Unix and Windows NT/2000/XP networks?
8. How can I configure EnFuzion to use Linux/Unix and Windows NT/2000/XP at the same time?
9. I am unable to access a Windows NT/2000/XP network drive.
10. Can I avoid plain text passwords in the network configuration file enfuzion.nodes?
11. How can I configure EnFuzion to avoid conflict with a user working on a node?
12. How can I configure EnFuzion to execute two simultaneous jobs on a dual processor host?
13. How do I manually install EnFuzion on Linux/Unix?
14. What are the default installation directories under Unix?
15. The installation program on Linux/Unix complains about incorrect user or password on a remote machine. What should I do?
16. How does EnFuzion on Linux/Unix communicate with remote machines?
17. How does EnFuzion compare to batch queue managers?
18. Where can I learn about the early technology behind EnFuzion?
Index
List of Tables
8-1. Available Parameters
List of Figures
2-1. Sample Parametric Study - Plan File sample.pln
2-2. Sample Parametric Study - Range Parameters
2-3. Sample Parametric Study - Oneof Select Parameter
2-4. Sample Parametric Study - Anyof Select Parameter
2-5. Sample Parametric Study - Common Input Files
2-6. Sample Parametric Study - File Based Parameter Values
2-7. Sample Parametric Study - Template File
2-8. Sample Parametric Study - Resulting File
2-9. Sample Parametric Study - Command Line Parameter Values
2-10. Sample Parametric Study - Executing User Application
2-11. Sample Parametric Study - Results Files
2-12. Wizard - Introduction Window
2-13. Wizard - Parameter Description
2-14. Wizard - Parameter Values
2-15. Wizard - Select Parameter
2-16. Wizard - Common Input Files
2-17. Wizard - File Based Parameters
2-18. Wizard - User Commands
2-19. Wizard - Result Files
2-20. Wizard - Final Plan
2-21. Sample Parametric Study - Application Specific User Interface
8-1. Phases of Standard EnFuzion Computation
8-2. Preparator Description Dialog
8-3. Entering a Preprocessing Command
8-4. Entering an Input File
8-5. Entering a Parameter Substitution
8-6. Entering a User Command
8-7. Entering an Output File
8-8. Entering a Post Processing command
8-9. Sample Output Plan from Preparator
8-10. Application Specific Interface in Generator
8-11. Interface with All Parameters Defined
10-1. The Eye Home Page
10-2. The Run Submission Page
10-3. Submission of Data Files
10-4. Successful Run Submission
10-5. The Cluster Status Page
10-6. The Run List Page
10-7. Detailed Run Information
10-8. The Completed Jobs Page
10-9. The Node List Page
10-10. Detailed Node Information
10-11. The Executing Jobs Page
10-12. The Run Results page
10-13. Run Directory
10-14. The Used Nodes Page
10-15. The Accounting Page
10-16. The Report Layout Page
10-17. Run Report
10-18. Node Report