Version 9 (modified by 12 years ago) (diff) | ,
---|
-
GIMI Acceptance Test Plan
- Process
- Assumptions and Dependencies
- Aggregate and Service Managers
- Experiment control tools
- Target resource configurations
- Target software configurations
- Extensions
- Required services
-
Test Descriptions
- One Aggregate, Common node inside the slice
- One Aggregate, Common node outside the slice
- Two Aggregates, Common node in each aggregate
- Two Aggregates, One common node outside the slice
- Two Aggregates, One common node in one aggregate
GIMI Acceptance Test Plan
The GIMI tests will build on the GPO ExoGENI test plan.
Process
- Select aggregate manager
- Select target resource configuration
- Select target software configuration
- Select tools
- Select extension
- Run scripts
- get resources
- load software
- configure software
- test functions
- evaluate performance
Assumptions and Dependencies
The following assumptions are made for all tests described in this plan:
GPO ProtoGENI credentials from https://pgeni.gpolab.bbn.com are used for all tests.
GPO ProtoGENI is the Slice Authority for all tests.
All Service Manager (SM) requests MUST be made MUST be made via the Omni command line tool which uses the GENI AM API.
In all scenarios, one experiment is always equal to one slice.
Compute resources are VMs unless otherwise stated.
Aggregate and Service Managers
ExoSM (Service Manager) BBN ExoGENI Aggregate Manager RENCI ExoGENI Aggregate Manager
Experiment control tools
OMNI
OMF EC
iREEL Portal
iRODS client i-commands
Target resource configurations
1. One aggregate (RENCI or BBN ExoGENI Rack)
- Common node in slice, 2 MPs
- Common node out of slice, 2 MPs
2. Two aggregates (one slice, both RENCI and BBN ExoGENI Racks)
- 1 Common node and 1-2 MPs in each aggregate
- Common node outside of slice, 1-2 MPs in each aggregate
- Common node in one aggregate, 1-2 MPs in each aggregate (possible?)
Target software configurations
1. Installation
a. Static install (full images)
- how many different images?
- with rspec
b. Dynamic install (packages on top of generic images)
- which images will be supported?
- with rspec?
2. Measurement configuration
- What are the configuration parameters?
3. Add experimenter applications
- use OMF EC enable/disable app and I&M services
Extensions
1. Push measurement data from MC to iRODS server
2. Pull measurement data from iRODS server to user workspace
- analyze and visualize the data
3. Push the analysis data from user workspace to iRODS server
Required services
- OMF Messaging Server
- iRODS Server
- iREEL Web Server
Test Descriptions
One Aggregate, Common node inside the slice
Static Install
GIM-1A-IS-1. Slice/Sliver Setup
This test creates a slice on one ExoGENI aggregate with 3 VMs using a static image with GIMI I&M packages installed. One of the VMs will be the common (OML server) node and the other two VMs will be measurement points.
Prerequisites:
- ExoSM has made available a static image (images?) with GIMI I&M packages installed.
- The resource allocated for the MC is externally accessible by SSH and HTTP.
- A messaging (XMPP) server is available and accessible by all nodes in the slice. (Is this required for slice set-up?)
Procedure:
- Using OMNI, allocate three VMs from the same ExoGENI AM to a slice.
- Generate and install necessary certificates on the nodes?
- Enable required services (examples?) on the MC and MP nodes.
- Verify full connectivity of the slice (ping and ssh)
- Verify required services have been enabled
GIM-1A-IS-2 Basic Measurements
This case tests basic measurement configuration on the measurement points. Need to be more specific here
Prerequisites:
- An ExoGENI slice has been created and verified with 3 VMs using a static image with GIMI I&M packages installed.
Procedure:
- Configure basic measurement services to run on the MPs using OMF EC and push results to the MC.
- Start, Stop, Restart basic measurement services using OMF EC.
- Verify that processes are being controlled correctly.
- Start basic measurement services.
- Verify that all tests/processes are executing successfully.
- Verify that expected data is collected on the MC
GIM-1A-IS-3 Send Measurement Data to iRODS
GIM-1A-IS-4 Visualize Results
GIM-1A-IS-5 Send Analysis Data to iRODS
Dynamic Install/Debian
GIM-1A-IS-6. Slice/Sliver Setup
This test creates a slice on one ExoGENI aggregate with 3 VMs using a Debian image with GIMI I&M packages installed dynamically. One of the VMs will be the common (OML server) node and the other two VMs will be measurement points.
Prerequisites:
- ExoSM has made available a Debian image on which to install the GIMI I&M packages.
- The GIMI I&M packages are available on a public web server?
- The resource allocated for the MC is externally accessible by SSH and HTTP.
- A messaging (XMPP) server is available and accessible by all nodes in the slice. (Is this required for slice set-up?)
Procedure:
- Using OMNI, allocate three VMs from the same ExoGENI AM to a slice.
- Install the GIMI I&M packages.
- Generate and install necessary certificates on the nodes?
- Enable required services (examples?) on the MC and MP nodes.
- Verify full connectivity of the slice (ping and ssh)
- Verify required services have been enabled
GIM-1A-IS-7 Basic Measurements
This case tests basic measurement configuration on the measurement points. Need to be more specific here
Prerequisites:
- An ExoGENI slice has been created and verified with 3 VMs using a Debian image with GIMI I&M packages installed.
Procedure:
- Configure basic measurement services to run on the MPs using OMF EC and push results to the MC.
- Start, Stop, Restart basic measurement services using OMF EC.
- Verify that processes are being controlled correctly.
- Start basic measurement services.
- Verify that all tests/processes are executing successfully.
- Verify that expected data is collected on the MC
GIM-1A-IS-8 Send Measurement Data to iRODS
GIM-1A-IS-9 Visualize Results
GIM-1A-IS-10 Send Analysis Data to iRODS
One Aggregate, Common node outside the slice
Static Install
GIM-1A-OS-1. Slice/Sliver Setup
This test creates a slice on one ExoGENI aggregate with 2 VMs using a static image with GIMI I&M packages installed. Both VMs will be measurement points. The common (OML server) node will be located outside the slice (in the user workspace?).
Prerequisites:
- ExoSM has made available a static image (images?) with GIMI I&M packages installed.
- The common node is configured outside the slice and is externally accessible by SSH and HTTP.
- The common node is accessible by the VMs within the slice (which ports?).
- A messaging (XMPP) server is available and accessible by all nodes in the slice. (Is this required for slice set-up?)
Procedure:
- Using OMNI, allocate two VMs from the same ExoGENI AM to a slice.
- Generate and install necessary certificates on the nodes?
- Enable required services (examples?) on the MP nodes.
- Verify full connectivity of the nodes within the slice (ping and ssh) as well as connectivity to the common node outside the slice.
- Verify required services have been enabled.
GIM-1A-OS-2 Basic Measurements
This case tests basic measurement configuration on the measurement points. Need to be more specific here
Prerequisites:
- An ExoGENI slice has been created and verified with 2 VMs using a static image with GIMI I&M packages installed.
- The common (OML server) node is located on a node outside the slice and externally accessible.
- The common node is accessible by the VMs within the slice (which ports?).
- A messaging (XMPP) server is available and accessible by all nodes in the slice. (Is this required for slice set-up?)
Procedure:
- Configure basic measurement services to run on the MPs using OMF EC and push results to the MC.
- Start, Stop, Restart basic measurement services using OMF EC.
- Verify that processes are being controlled correctly.
- Start basic measurement services.
- Verify that all tests/processes are executing successfully.
- Verify that expected data is collected on the MC.
GIM-1A-OS-3 Send Measurement Data to iRODS
GIM-1A-OS-4 Visualize Results
GIM-1A-OS-5 Send Analysis Data to iRODS
Dynamic Install/Debian
GIM-1A-OS-6. Slice/Sliver Setup
This test creates a slice on one ExoGENI aggregate with 2 VMs using a Debian image with GIMI I&M packages installed dynamically. Both VMs will be measurement points. The common (OML server) node will be located outside the slice (in the user workspace?).
Prerequisites:
- The aggregate/rack has made available a Debian image on which to install the GIMI I&M packages.
- The GIMI I&M packages are available on a public web server?
- The common node is configured outside the slice and is externally accessible by SSH and HTTP.
- The common node is accessible by the VMs within the slice (which ports?).
- A messaging (XMPP) server is available and accessible by all nodes in the slice. (Is this required for slice set-up?)
Procedure:
- Using OMNI, allocate two VMs from the same ExoGENI AM to a slice.
- Install the GIMI I&M packages.
- Generate and install necessary certificates on the nodes?
- Enable required services (examples?) on the MC and MP nodes.
- Verify full connectivity of the nodes within the slice (ping and ssh) as well as connectivity to the common node outside the slice
- Verify required services have been enabled.
GIM-1A-OS-7 Basic Measurements
This case tests basic measurement configuration on the measurement points. Need to be more specific here
Prerequisites:
- An ExoGENI slice has been created and verified with 2 VMs using a Debian image with GIMI I&M packages installed.
- The common (OML server) node is located on a node outside the slice and externally accessible.
- The common node is accessible by the VMs within the slice (which ports?).
- A messaging (XMPP) server is available and accessible by all nodes in the slice. (Is this required for slice set-up?)
Procedure:
- Configure basic measurement services to run on the MPs using OMF EC and push results to the MC.
- Start, Stop, Restart basic measurement services using OMF EC.
- Verify that processes are being controlled correctly.
- Start basic measurement services.
- Verify that all tests/processes are executing successfully.
- Verify that expected data is collected on the MC
GIM-1A-OS-8 Send Measurement Data to iRODS
GIM-1A-OS-9 Visualize Results
GIM-1A-OS-10 Send Analysis Data to iRODS
Two Aggregates, Common node in each aggregate
Static Install
GIM-2A-2CN-1. Slice/Sliver Setup
This test creates a slice on two ExoGENI aggregates with 3 VMs in each aggregate using a static image with GIMI I&M packages installed. One of the VMs in each aggregate will be the common (OML server) node and the other two VMs in each aggregate will be measurement points.
Prerequisites:
- ExoSM has made available a static image (images?) with GIMI I&M packages installed.
- The resources allocated for the MCs are externally accessible by SSH and HTTP.
- A messaging (XMPP) server is available and accessible by all nodes in the slice. (Is this required for slice set-up?)
Procedure:
- Using OMNI, allocate three VMs from each ExoGENI AM to a slice.
- Generate and install necessary certificates on the nodes?
- Enable required services (examples?) on the MC and MP nodes.
- Verify full connectivity of the slice (ping and ssh)
- Verify required services have been enabled
GIM-2A-2CN-2 Basic Measurements
This case tests basic measurement configuration on the measurement points. Need to be more specific here
Prerequisites:
- An ExoGENI slice has been created and verified with 2 common node VMs and 4 MP VMs using a static image with GIMI I&M packages installed.
- A messaging (XMPP) server is available and accessible by all nodes in the slice.
Procedure:
- Configure basic measurement services to run on the MPs using OMF EC and push results to the appropriate MC (MPs push to the MC in the same aggregate).
- Start, Stop, Restart basic measurement services using OMF EC.
- Verify that processes are being controlled correctly.
- Start basic measurement services.
- Verify that all tests/processes are executing successfully.
- Verify that expected data is collected on each of the MCs
GIM-2A-2CN-3 Send Measurement Data to iRODS
GIM-2A-2CN-4 Visualize Results
GIM-2A-2CN-5 Send Analysis Data to iRODS
Dynamic Install/Debian
GIM-2A-2CN-6. Slice/Sliver Setup
This test creates a slice on two ExoGENI aggregates with 3 VMs in each aggregate using a Debian image with GIMI I&M packages installed dynamically. One of the VMs in each aggregate will be the common (OML server) node and the other two VMs in each aggregate will be measurement points.
Prerequisites:
- ExoSM has made available a Debian image on which to install the GIMI I&M packages.
- The GIMI I&M packages are available on a public web server?
- The resources allocated for the MCs are externally accessible by SSH and HTTP.
- A messaging (XMPP) server is available and accessible by all nodes in the slice. (Is this required for slice set-up?)
Procedure:
- Using OMNI, allocate three VMs from each ExoGENI AM to a slice.
- Install the GIMI I&M packages.
- Generate and install necessary certificates on the nodes?
- Enable required services (examples?) on the MC and MP nodes.
- Verify full connectivity of the slice (ping and ssh)
- Verify required services have been enabled
GIM-2A-2CN-7 Basic Measurements
This case tests basic measurement configuration on the measurement points. Need to be more specific here
Prerequisites:
- An ExoGENI slice has been created and verified with 2 common node VMs and 4 MP VMs using a Debian image with GIMI I&M packages installed.
- A messaging (XMPP) server is available and accessible by all nodes in the slice.
Procedure:
- Configure basic measurement services to run on the MPs using OMF EC and push results to the appropriate MC (MPs push to the MC in the same aggregate).
- Start, Stop, Restart basic measurement services using OMF EC.
- Verify that processes are being controlled correctly.
- Start basic measurement services.
- Verify that all tests/processes are executing successfully.
- Verify that expected data is collected on each of the MCs
GIM-2A-2CN-8 Send Measurement Data to iRODS
GIM-2A-2CN-9 Visualize Results
GIM-2A-2CN-10 Send Analysis Data to iRODS
Two Aggregates, One common node outside the slice
Static Install
GIM-2A-CNOS-1. Slice/Sliver Setup
This test creates a slice on two ExoGENI aggregates with 2 VMs in each aggregate using a static image with GIMI I&M packages installed. The two VMs in each aggregate will be measurement points. The common (OML server) node will be located outside the slice (in the user workspace?).
Prerequisites:
- The ExoGENI AM has made available a static image (images?) with GIMI I&M packages installed.
- The common node is configured outside the slice and is externally accessible by SSH and HTTP.
- The common node is accessible by the VMs within the slice (which ports?).
- A messaging (XMPP) server is available and accessible by all nodes in the slice. (Is this required for slice set-up?)
Procedure:
- Using OMNI, allocate two VMs from each ExoGENI AM to a slice.
- Generate and install necessary certificates on the nodes?
- Enable required services (examples?) on the MP nodes.
- Verify full connectivity of the nodes within the slice (ping and ssh) as well as connectivity to the common node outside the slice.
GIM-2A-CNOS-2 Basic Measurements
This case tests basic measurement configuration on the measurement points. Need to be more specific here
Prerequisites:
- An ExoGENI slice has been created and verified with 4 MP VMs using a static image with GIMI I&M packages installed.
- The common (OML server) node is located on a node outside the slice and externally accessible.
- The common node is accessible by the VMs within the slice (which ports?).
- A messaging (XMPP) server is available and accessible by all nodes in the slice.
Procedure:
- Configure basic measurement services to run on the MPs using OMF EC and push results to the MC.
- Start, Stop, Restart basic measurement services using OMF EC.
- Verify that processes are being controlled correctly.
- Start basic measurement services.
- Verify that all tests/processes are executing successfully.
GIM-2A-CNOS-3 Send Measurement Data to iRODS
GIM-2A-CNOS-4 Visualize Results
GIM-2A-CNOS-5 Send Analysis Data to iRODS
Dynamic Install/Debian
GIM-2A-CNOS-6. Slice/Sliver Setup
This test creates a slice on two ExoGENI aggregates with 2 VMs in each aggregate using a Debian image with GIMI I&M packages installed dynamically. The two VMs in each aggregate will be measurement points. The common (OML server) node will be located outside the slice (in the user workspace?).
Prerequisites:
- The ExoGENI AM has made available a Debian image on which to install the GIMI I&M packages.
- The GIMI I&M packages are available on a public web server?
- The common node is configured outside the slice and is externally accessible by SSH and HTTP.
- The common node is accessible by the VMs within the slice (which ports?).
- A messaging (XMPP) server is available and accessible by all nodes in the slice. (Is this required for slice set-up?)
Procedure:
- Using OMNI, allocate two VMs from each ExoGENI AM to a slice.
- Install the GIMI I&M packages.
- Generate and install necessary certificates on the nodes?
- Enable required services (examples?) on the MC and MP nodes.
- Verify full connectivity of the slice (ping and ssh)
- Verify required services have been enabled
GIM-2A-CNOS-7 Basic Measurements
This case tests basic measurement configuration on the measurement points. Need to be more specific here
Prerequisites:
- An ExoGENI slice has been created and verified with 4 MP VMs using a Debian image with GIMI I&M packages installed dynamically.
- The common (OML server) node is located on a node outside the slice and externally accessible.
- The common node is accessible by the VMs within the slice (which ports?).
- A messaging (XMPP) server is available and accessible by all nodes in the slice.
Procedure:
- Configure basic measurement services to run on the MPs using OMF EC and push results to the MC.
- Start, Stop, Restart basic measurement services using OMF EC.
- Verify that processes are being controlled correctly.
- Start basic measurement services.
- Verify that all tests/processes are executing successfully.
GIM-2A-CNOS-8 Send Measurement Data to iRODS
GIM-2A-CNOS-9 Visualize Results
GIM-2A-CNOS-10 Send Analysis Data to iRODS
Two Aggregates, One common node in one aggregate
Static Install
GIM-2A-1CN-1. Slice/Sliver Setup
This test creates a slice on two ExoGENI aggregates with 3 VMs in one aggregate and 2 VMs in the other using a static image with GIMI I&M packages installed. One of the VMs in the 3-VM aggregate will be the common (OML server) node and the other two VMs in each aggregate will be measurement points.
Prerequisites:
- The ExoGENI AM has made available a static image (images?) with GIMI I&M packages installed.
- The resource allocated for the MC is externally accessible by SSH and HTTP.
- The resource allocated for the MC is accessible by all VMs in both aggregates (which ports?)
- A messaging (XMPP) server is available and accessible by all nodes in the slice. (Is this required for slice set-up?)
Procedure:
- Using OMNI, allocate 3 VMs from one ExoGENI AM and 2 VMs from the other to a slice.
- Generate and install necessary certificates on the nodes?
- Enable required services (examples?) on the MC and MP nodes.
- Verify full connectivity of the slice (ping and ssh)
- Verify required services have been enabled
GIM-2A-1CN-2 Basic Measurements
This case tests basic measurement configuration on the measurement points. Need to be more specific here
Prerequisites:
- An ExoGENI slice has been created and verified with one common node VM and 4 MP VMs using a static image with GIMI I&M packages installed.
- The common node is accessible by all MP VMs within the slice (which ports?).
- A messaging (XMPP) server is available and accessible by all nodes in the slice.
Procedure:
- Configure basic measurement services to run on the MPs using OMF EC and push results to the MC.
- Start, Stop, Restart basic measurement services using OMF EC.
- Verify that processes are being controlled correctly.
- Start basic measurement services.
- Verify that all tests/processes are executing successfully.
GIM-2A-1CN-3 Send Measurement Data to iRODS
GIM-2A-1CN-4 Visualize Results
GIM-2A-1CN-5 Send Analysis Data to iRODS
Dynamic Install/Debian
GIM-2A-1CN-6 Slice/Sliver Setup
This test creates a slice on two ExoGENI aggregates with 3 VMs in one aggregate and 2 VMs in the other aggregate using a Debian image with GIMI I&M packages installed dynamically. One of the VMs in the 3-VM aggregate will be the common (OML server) node and the other two VMs in each aggregate will be measurement points.
Prerequisites:
- The ExoGENI AM has made available a Debian image on which to install the GIMI I&M packages.
- The GIMI I&M packages are available on a public web server?
- The resource allocated for the MC is externally accessible by SSH and HTTP.
- The resource allocated for the MC is accessible by all VMs in both aggregates (which ports?)
- A messaging (XMPP) server is available and accessible by all nodes in the slice. (Is this required for slice set-up?)
Procedure:
- Using OMNI, allocate three VMs from one ExoGENI AM and two VMs from the other to a slice.
- Install the GIMI I&M packages.
- Generate and install necessary certificates on the nodes?
- Enable required services (examples?) on the MC and MP nodes.
- Verify full connectivity of the slice (ping and ssh)
- Verify required services have been enabled
GIM-2A-1CN-7 Basic Measurements
This case tests basic measurement configuration on the measurement points. Need to be more specific here
Prerequisites:
- An ExoGENI slice has been created and verified with one common node VM and 4 MP VMs using a static image with GIMI I&M packages installed.
- The common node in one of the aggregates is accessible by all MP VMs within the slice (which ports?).
- A messaging (XMPP) server is available and accessible by all nodes in the slice.
Procedure:
- Configure basic measurement services to run on the MPs using OMF EC and push results to the MC.
- Start, Stop, Restart basic measurement services using OMF EC.
- Verify that processes are being controlled correctly.
- Start basic measurement services.
- Verify that all tests/processes are executing successfully.