wiki:GEC16Agenda/IMDesignTopics

Version 12 (modified by hmussman@bbn.com, 8 years ago) (diff)

--

I&M Design Topics at GEC16

Tuesday, March 19, 10:30am - 12noon
Room: City Creek
Session leader: Harry Mussman (GENI Project Office, Raytheon BBN Technologies)

Description

This I&M session will focus on three key issues of interest to both the GIMI and GEMINI projects, as they continue to work towards a comprehensive set of I&M tools for GENI experimenters and for infrastructure measurement.

We will first review a goal to move towards a "unified experiment environment".

Then, we will discuss these topics:

  • Support for GIMI and GEMINI I&M tools on both ExoGENI and InstaGENI racks
  • Use of an instrumentize script, driven by rspec extension, to configure/init all I&M tools
  • Options for further measurement data analysis and presentation

For each topic, we will have a review of current practice, and a discussion of how to move forward.

Finally, we will form teams to continue the discussions.

Pre-Requisites

None

Agenda

This is a tentative agenda, which may change.

1) Introductions

8:30am

2) Towards a Unified Experiment Environemnt

8:35am
Marshall Brinn (GPO)
10min

[ 5 slides:] What does it mean to move towards a "unified experiment environment"?

3) Support GIMI and GEMINI I&M tools on both ExoGENI and InstaGENI racks

8:45am

Introduction

Harry Mussman (GPO)

GENI experiment management Step 3: Obtain slice, install software

  • Now: GIMI loaded (and tested) on ExoGENI, with Flukes
  • Now: GEMINI loaded (and tested) on InstaGENI, with FLACK
  • Next: be able to use GEMINI on ExoGENI, and GIMI on InstaGENI
  • Suggest: set goal to begin testing all combinations by 5/1; good support by GEC17

Lessons learned from using GIMI tools on ExoGENI racks

Cong Wang (UMass Amherst)
5min

[ 3 slides]: current config; key techniques; known challenges

Lessons learned from using GEMINI tools on InstaGENI racks

Hussam Nasir (Univ Kentucky)
5min

[3 slides]: current config; key techniques; known challenges

Discussion

Cong Wang (UMass Amherst; Hussam Nasir (Univ Kentucky); Louisa Nevers (GPO); Jeanne Ohren (GPO)
15min

How do we move towards using GEMINI on ExoGENI, and GIMI on InstaGENI?

Discuss:

  • Suggested approaches
  • Key techniques
  • Likely challenges
  • Goal to begin testing all combinations by 5/1; good support by GEC17; are there any roadblocks?

Any topics, suggestions and issues suggested by members of roundtable?

At the end:

  • List of conclusions
  • List of issues
  • Team to continue discussion

4) Use of instrumentize script, driven by rspec extension, to configure/initialize I&M tools

9:10am

Overview

Harry Mussman (GPO)

GENI experiment management Step 4: Configure/init I&M and exp app

  • Now: GIMI using post boot scripts, OMF
  • Now: GEMINI using instrumentize script, with choices based on rspec extensions (ignored by AggMgr's); also used to add GN (an extra node, one per Agg, for common GEMINI services)
  • Next: move towards common approach, to better unify experiment environment
  • Suggest: both move towards script, driven by rspec ext

Current GIMI use of post boot scripts, OMF, to configure/inti services

Cong Wang (UMass Amherst)
5min

[ 3 slides]: key techniques; known challenges

Current GEMINI use of instrumentize script, to configure/init services

Hussam Nasir (Univ Kentucky)
5min

[ 3 slides]: key techniques; known challenges

Discussion

Cong Wang (Umass Amherst) ; Hussam Nasir (Univ Kentucky); Marshall Brinn (GPO); Jeanne Ohren (GPO)
15min

How do we move towards a common approach to configure and initialize I&M tools, to better unify experiment environment?

Strawman:

  • move towards instrumentize script, driven by rspec ext

Or is there a better solution?

[Any topics, suggestions and issues suggested by members of roundtable]

At the end:

  • List of conclusions
  • List of issues
  • Team to continue discussion

5) Options for further measurement data analysis and presentation

9:35am

Introduction

Harry Mussman (GPO)

GENI experiment management Step 6: Analyze

  • Now: Both GEMINI and GIMI push measurement data objects (files) to GENI Storage Service (iRODS)
  • Now: GEMINI provides dump of mongo DB, plus separate file of metadata
  • Now: GIMI (will) provide SQLdump of PostgreSQL DB, which includes metadata
  • Now: Both use portal on GENI Storage Service (iRODS) to curate files (objects)

Both: Pull measurement data files from GENI Storage Service (iRODS) back to user workspace, where DBs can be reconstituted, and data pulled for further analysis and presentation.

Both: Many options for further analysis and presentation, not being developed as part of tools.

Next: Consider possible ways to unify data formats, analysis and presentation; what commonly available tools might be useful?

Current GIMI measurement data object schema

Stephen Glass (NICTA)
10min

[ 5 slides]: GIMI measurement data object schema

Current GEMINI measurement data object schema

Ezra Kissel (Indiana Univ)
10min

[ 5 slides]: GEMINI measurement data object schema

Discussion

Stephen Glass (NICTA); Ezra Kissel (Indiana Univ); Marshall Brinn (GPO); Fraida Fund (NYU Poly)
10min

How could we unify further analysis and presentation?

What are possible ways to unify data formats?

What commonly available tools might be useful?

[Any topics, suggestions and issues suggested by members of roundtable]

At the end:

  • List of conclusions
  • List of issues
  • Team to continue discussion

6) Adjourn

12noon

Please join us for I&M BoF dinner on Wednesday evening. Please indicate on this poll, if you will be attending

Attachments (6)

Download all attachments as: .zip