wiki:GEMINIv2tasks

Version 33 (modified by Jeanne Ohren, 11 years ago) (diff)

--

GEMINI v2 Plan, Tasks and Status

1) Plan

Current GEMINI configuration figures

  • Detailed workflow on p11

2) Team

Martin Swany (IU)

Ezra Kissel (IU)

Ahmed El-Hassany (IU)

Matt Jaffee (IU)

Frank Diaz (IU)

Jim Griffioen (UK)

Zongming Fei (UK)

Hussam Nasir (UK)

Charles Carpenter (UK)

Jeremy Reed (UK)

Laura Diaz (IU)

Harry Mussman (BBN)

Jeanne Ohren (BBN)

3) Planning and Status Meetings/Conference Calls

040213; 2pm EDT

041613; 2pm EDT

043013; 2pm EDT

051413; 2-4pm EDT; demo

052813; 2pm EDT

061113; 2-4pm EDT; demo

062513; 2pm EDT

070913; 2-4pm EDT; demo; v2 ready for testing

072113 - 072313 is GEC17; v2 software released after testing; integrated tutorials presented

WebEx information for bi-weekly calls

https://bbn.webex.com/bbn/j.php?ED=187459077&UID=1351470132&PW=NNTdlYTI5M2E0&RT=MiMxMQ%3D%3D
Call-in toll number (US/Canada): 1-408-792-6300
Access code:790 362 829

4) Tasks

GEMINI Tasks Through GEC17

  • Started 032913
  • Updated 040113
  • Updated 040313 after 040213 call
  • Updated 042313 after 041613 call, and discussion with Laura Diaz on 042313
  • Updated 050213 after 043013 call

1) Meet biweekly starting 4/2, with 3 demo sessions: 5/14, 6/11 and 7/9

2) By 4/16: /cleanup/checkin/test/document current code

What needs work?
some at UK
some at IU
more browser testing: Firefox OK; Chrome ?; Safari x; IE ?
completed by 043013 call

3) Agree on goals:

a) GEMINI (and GIMI) to work with InstaGENI and ExoGENI
b) Aim for consistent user experience, both racks, both sets of I&M tools (towards unified experiment environment)
c) Implement basic workflow per http://groups.geni.net/geni/wiki/GeniExperiments#a5StepsinBasicGENIExperimentTutorialTestWorkflowHarry and http://groups.geni.net/geni/wiki/TestTutorialExperimentWorkflow
d) Easy to setup basic set of measurements (towards unified experiment environment)
e) Easy to mix-and-match tools, as go from step to step, with automatic transfer of info between steps/tools
f) Easy to configure and then visualize (graph) measurements, starting with topology of resources
g) Ability to simultaneously do multiple measurements and multiple graphs, during an experiment
h) Stay consistent with Spiral 5 GEMINI SOW
i) Negotiate Spiral 6 GEMINI SOW by GEC17, so that there is no gap in funding at 093013

4) Build workflow for GEMINI to work on both InstaGENI and ExoGENI

a) Start with browser, GENI Desktop, FLACK and OMNI, for InstaGENI
b) Start with User Workspace, Flukes and OMNI for ExoGENI
c) When can InstaGENI be used with ExoGENI? also GENI Desktop?
d) Which browsers are supported?
e) Whick credentials are supported?
f) Need detailed plan from team: Jeannie, Louisa, Ezra, Hussam, Ilia and Cong
g) Current InstaGENI configuration per attached figure; changes?
h) Current ExoGENI configuration?

4/16: Sub-team has met, made plan; see http://groups.geni.net/geni/wiki/IMInteroperability
4/16: Biggest issue for extension into ExoGENI: making fedora images; but, could be done later, if start with loading software

5) Add features to GEMINI Portal (GENI Desktop) service:

a) Register with GENI Clearinghouse Service Registry (low)
b) Single sign-on, from GENI Experimenter Portal, as alternate way to get credentials (step 2)

4/2: Hussam and Tom/Aaron; in progress (low)
4/16: Hussam; working on it, reviewing proposals from Aaron Helsinger

c) Push topology to UNIS, then retrieve topology from UNIS for display (high)

4/16: Ezra forwarded paper with options, but was not present to review.
4/16: Discussed presented options; Jim: parser prepares data for the components, and has it available BEFORE instrumentize script run; without more discussion, need to keep with current approach (Proposal 1)

d) Plugin to configure GEMINI active measurements (w/o going to GN) (high)

4/16: Ezra, Charles and Hussam; will make a proposal
4/30: Ezra provides proposal

e) Plugin to push GEMINI measurement data objects (and descriptors) to iRODS, with proper structure (high)

4/16: Ezra, Charles and Hussam; will make a proposal

f) Plugin to gather basic experiment info, and push descriptor files, including annotations, to iRODS, with proper structure (like e)) (med)
g) Plugin to link to iRODS web interface, to curate user's files (med)

4/16: complete, based on available script

h) Consider "universal" plugin, to get an active web service?

6) Add features to measurement services: BLiPP and MS

a) Verify current set of passive host measurements, and define any desired extensions

when?

b) Complete set of active network measurements to match LAMP, and define any desired extensions

4/16: Matt: the real problem is configuration; working on representing all active measurements in UNIS as a propoer resource; will have a proposal on 043013
4/30: Matt: slides and ping schema

c) +Work with GMOC to define network monitoring use case, support GMOC in its use of active network measurements for network monitoring, and define any desired extensions

4/2: Martin; continue to talk with GMOC; when to report?

d) +Work with GMOC to consider how to best support OF in GENI testbed infrastructure

4/2: ?
4/16: Laura will inquire/push

e) Plan how to use NetLogger to gather custom measurements from an experiment application into BLiPP, and prototype

4/2: not yet in GEMINI
4/16: Matt, Dan to provide a plan; starting 043013

7) Prepare tutorials for multiple use cases, identify and fix any "kinks", support off-line use of tutorials, and evaluate user experineces at GEC17 (and before) to guide further development

a) Classroom exercies
b) Research experiments
c) Network monitoring

8) Prototype User Workspace to retrieve measurment data and descriptors from iRODS, and prepare for further analysis and presentation
9) By 7/9: v2 ready for testing

10) On 7/21 - 7/23 at GEC17: v2 software released after testing; integrated tutorials presented

  • In cooperation with GIMI team

+ In cooperation with GMOC team

5) Key Task List

ID Description Assignee Due Status Demos Notes
2a /cleanup/check in/test/document current code Ezra 4/30/13 Completed Code and documentation leading to GEC16 has been checked in.
2C Desktop Browser support- additional testing/planned set of browsers UK- Charles Complete MAC: Firefox, Chrome, Safari, Opera(Flash logon fails) WIN: Firefox, Chrome, IE (Flash logon fails, auto logon drupal pages fail (this is being changed anyway), mixed http/https content stops page). All: Chrome has issues with secure content parts of the page, may not be obvious to user how to proceed by clicking on grayed out shield. 5/28/13- Firefox and Chrome are working (will put at the bottom of the page which browsers are supported).
4 Build workflow for GEMINI to work on both InstaGENI and ExoGENI Ezra, Hussam, Jeanne 4/30: fair 5/14 (on ExoGENI) 4/30: fair, but still some manual steps; lots of changes in instrumentize script; using Centos image on ExoGENI 5/28/13- Started on the ExoGENI part. ExoGENI is down until Friday 5/31/13 so UK will be back working on this next week.
5 Add features to GEMINI Portal (GENI Desktop) service:
5c Push topology to UNIS, then retrieve topology from UNIS for display Ahmed, Ezra, Hussam 5/28/13 Completed 4/16: Ezra sends proposal, some discussion, plan to stay with current plan. 4/30: Still plan to stay with current plan, separate topology data; need to make sure the topology is consistent and getting updated; some concern with when slice modifications happen.
5d Plugin to configure GEMINI active measurements (w/out going to GN) Ezra, Charles, Hussam In progress 4/30: Ezra provides proposal; Jim suggests waiting for new GENI Desktop API; no conclusion. 5/28/13 Keep configuration page on global node, add some code to configuration- should be simple and will be completed by GEC 17.
5e Plugin for scripts on GN to push GEMINI measurement data objects (and descriptors) to iRODS, with proper structure Ezra, Charles, and Hussam In Progress 4/30: much like what is done today; see info on GENI Storage and Archive Service, and descriptive document. 5/28/13- Needs to be tested with ExoGENI.
6 Add features to measurement services: BLiPP and MS Frank (Matt) In Progress 5/28/13- IU will add links to Jira reflecting 6a and 6b
6a Verify current set of passive host measurements, and define any desired extensions Frank (Matt) In Progress
6b Complete set of active network measurements to match LAMP, and define any desired extensions Frank (Matt) 4/30/13 In Progress 5/14 4/30: the real problem is configuration; now all active measurements in UNIS are a proper resource; should be easy to finish
6c +Work with GMOC to define network monitoring use case, support GMOC in its use of active network measurements for network monitoring, and define any desired extensions Martin 5/28/13- Need update from Martin by next call
6d +Work with GMOC to consider how to best support OF in GENI test bed infrastructure Martin 5/28/13- Update by next Gemini call
6e Plan how to use NetLogger? to gather custom measurements from an experiment application into BLiPP, and prototype Matt, Dan 5/14/13 In Progress 5/14 Have netlogger support elsewhere (not GEMINI) provide app level monitoring that OML has, just a question of prioritizing it. 5/28/13- Matt was working on this, Matt will put together a wiki page on how this works, IU will demo as well.
7 Prepare tutorials for multiple use cases, identify and fix any "kinks", support off-line use of tutorials, and evaluate user experiences at GEC17 (and before) to guide further development Jeanne In Progress 5/28/13- Jim and Jeanne met about tutorial schedule. Gemini- content is open, 1)pre-canned rspec and expect user has done before and/or 2) Start with existing slice. This gives us a chance to focus on actual instrumentation. We will use a VM this time and by GEC18 try to go without a tutorial VM. We will have 1 session for hands on, and a general session to show more advanced/other experiments/GEMINI functionality.
8 Prototype User Workspace to retrieve measurement data and descriptors from iRODS, and prepare for further analysis and presentation
9 v2 ready for testing 7/9/13
10 v2 software released after testing; integrated tutorials presented 7/21/13
  • In cooperation with GIMI team

+ In cooperation with GMOC team

Demo 1- 5/14/2013

1) More complete active configuration page for BLiPP (leading to removal of pS-LAMP tools)

2) Ability to extend GEMINI instrumentation if the user extends their slice

3) Demonstrate our components working on ExoGENI images

Demo 2- 6/11/2013
1) Interoperability- Jeanne

2) New Features to BLiPP and MS- Matt, Frank

3) Auto-login from the Geni Portal to the Geni Desktop- Hussam

4) Basic NetLogger example- Ezra

Attachments (4)

Download all attachments as: .zip