Version 35 (modified by 11 years ago) (diff) | ,
---|
GEMINI v2 Plan, Tasks and Status
1) Plan
Current GEMINI configuration figures
- Detailed workflow on p11
2) Team
Martin Swany (IU)
Ezra Kissel (IU)
Ahmed El-Hassany (IU)
Matt Jaffee (IU)
Frank Diaz (IU)
Jim Griffioen (UK)
Zongming Fei (UK)
Hussam Nasir (UK)
Charles Carpenter (UK)
Jeremy Reed (UK)
Laura Diaz (IU)
Harry Mussman (BBN)
Jeanne Ohren (BBN)
3) Planning and Status Meetings/Conference Calls
040213; 2pm EDT
041613; 2pm EDT
043013; 2pm EDT
051413; 2-4pm EDT; demo
052813; 2pm EDT
061113; 2-4pm EDT; demo
062513; 2pm EDT
070913; 2-4pm EDT; demo; v2 ready for testing
072113 - 072313 is GEC17; v2 software released after testing; integrated tutorials presented
WebEx information for bi-weekly calls
https://bbn.webex.com/bbn/j.php?ED=187459077&UID=1351470132&PW=NNTdlYTI5M2E0&RT=MiMxMQ%3D%3D
Call-in toll number (US/Canada): 1-408-792-6300
Access code:790 362 829
4) Tasks
GEMINI Tasks Through GEC17
- Started 032913
- Updated 040113
- Updated 040313 after 040213 call
- Updated 042313 after 041613 call, and discussion with Laura Diaz on 042313
- Updated 050213 after 043013 call
1) Meet biweekly starting 4/2, with 3 demo sessions: 5/14, 6/11 and 7/9
2) By 4/16: /cleanup/checkin/test/document current code
What needs work?
some at UK
some at IU
more browser testing: Firefox OK; Chrome ?; Safari x; IE ?
completed by 043013 call
3) Agree on goals:
a) GEMINI (and GIMI) to work with InstaGENI and ExoGENI
b) Aim for consistent user experience, both racks, both sets of I&M tools (towards unified experiment environment)
c) Implement basic workflow per http://groups.geni.net/geni/wiki/GeniExperiments#a5StepsinBasicGENIExperimentTutorialTestWorkflowHarry and http://groups.geni.net/geni/wiki/TestTutorialExperimentWorkflow
d) Easy to setup basic set of measurements (towards unified experiment environment)
e) Easy to mix-and-match tools, as go from step to step, with automatic transfer of info between steps/tools
f) Easy to configure and then visualize (graph) measurements, starting with topology of resources
g) Ability to simultaneously do multiple measurements and multiple graphs, during an experiment
h) Stay consistent with Spiral 5 GEMINI SOW
i) Negotiate Spiral 6 GEMINI SOW by GEC17, so that there is no gap in funding at 093013
4) Build workflow for GEMINI to work on both InstaGENI and ExoGENI
a) Start with browser, GENI Desktop, FLACK and OMNI, for InstaGENI
b) Start with User Workspace, Flukes and OMNI for ExoGENI
c) When can InstaGENI be used with ExoGENI? also GENI Desktop?
d) Which browsers are supported?
e) Whick credentials are supported?
f) Need detailed plan from team: Jeannie, Louisa, Ezra, Hussam, Ilia and Cong
g) Current InstaGENI configuration per attached figure; changes?
h) Current ExoGENI configuration?
4/16: Sub-team has met, made plan; see http://groups.geni.net/geni/wiki/IMInteroperability
4/16: Biggest issue for extension into ExoGENI: making fedora images; but, could be done later, if start with loading software
5) Add features to GEMINI Portal (GENI Desktop) service:
a) Register with GENI Clearinghouse Service Registry (low)
b) Single sign-on, from GENI Experimenter Portal, as alternate way to get credentials (step 2)
4/2: Hussam and Tom/Aaron; in progress (low)
4/16: Hussam; working on it, reviewing proposals from Aaron Helsinger
c) Push topology to UNIS, then retrieve topology from UNIS for display (high)
4/16: Ezra forwarded paper with options, but was not present to review.
4/16: Discussed presented options; Jim: parser prepares data for the components, and has it available BEFORE instrumentize script run; without more discussion, need to keep with current approach (Proposal 1)
d) Plugin to configure GEMINI active measurements (w/o going to GN) (high)
4/16: Ezra, Charles and Hussam; will make a proposal
4/30: Ezra provides proposal
e) Plugin to push GEMINI measurement data objects (and descriptors) to iRODS, with proper structure (high)
4/16: Ezra, Charles and Hussam; will make a proposal
f) Plugin to gather basic experiment info, and push descriptor files, including annotations, to iRODS, with proper structure (like e)) (med)
g) Plugin to link to iRODS web interface, to curate user's files (med)
4/16: complete, based on available script
h) Consider "universal" plugin, to get an active web service?
6) Add features to measurement services: BLiPP and MS
a) Verify current set of passive host measurements, and define any desired extensions
when?
b) Complete set of active network measurements to match LAMP, and define any desired extensions
4/16: Matt: the real problem is configuration; working on representing all active measurements in UNIS as a propoer resource; will have a proposal on 043013
4/30: Matt: slides and ping schema
c) +Work with GMOC to define network monitoring use case, support GMOC in its use of active network measurements for network monitoring, and define any desired extensions
4/2: Martin; continue to talk with GMOC; when to report?
d) +Work with GMOC to consider how to best support OF in GENI testbed infrastructure
4/2: ?
4/16: Laura will inquire/push
e) Plan how to use NetLogger to gather custom measurements from an experiment application into BLiPP, and prototype
4/2: not yet in GEMINI
4/16: Matt, Dan to provide a plan; starting 043013
7) Prepare tutorials for multiple use cases, identify and fix any "kinks", support off-line use of tutorials, and evaluate user experineces at GEC17 (and before) to guide further development
a) Classroom exercies
b) Research experiments
c) Network monitoring
8) Prototype User Workspace to retrieve measurment data and descriptors from iRODS, and prepare for further analysis and presentation
9) By 7/9: v2 ready for testing
10) On 7/21 - 7/23 at GEC17: v2 software released after testing; integrated tutorials presented
- In cooperation with GIMI team
+ In cooperation with GMOC team
5) Key Task List
ID | Description | Assignee | Due | Status | Demos | Notes |
2a | /cleanup/check in/test/document current code | Ezra | 4/30/13 | Completed | Code and documentation leading to GEC16 has been checked in. | |
2C | Desktop Browser support- additional testing/planned set of browsers | UK- Charles | Complete | MAC: Firefox, Chrome, Safari, Opera(Flash logon fails) WIN: Firefox, Chrome, IE (Flash logon fails, auto logon drupal pages fail (this is being changed anyway), mixed http/https content stops page). All: Chrome has issues with secure content parts of the page, may not be obvious to user how to proceed by clicking on grayed out shield. 5/28/13- Firefox and Chrome are working (will put at the bottom of the page which browsers are supported). | ||
4 | Build workflow for GEMINI to work on both InstaGENI and ExoGENI | Ezra, Hussam, Jeanne | 4/30: fair | 5/14 (on ExoGENI) | 4/30: fair, but still some manual steps; lots of changes in instrumentize script; using Centos image on ExoGENI 5/28/13- Started on the ExoGENI part. ExoGENI is down until Friday 5/31/13 so UK will be back working on this next week. | |
5 | Add features to GEMINI Portal (GENI Desktop) service: | |||||
5a | Register with GENI Clearinghouse Service Registry (low) | |||||
5b | Single sign-on, from GENI Experimenter Portal, as alternate way to get credentials (step 2) | Hussam and Tom/Aaron | In Progress | 4/2: Hussam and Tom/Aaron; in progress (low) 4/16: Hussam; working on it, reviewing proposals from Aaron Helsinger | ||
5c | Push topology to UNIS, then retrieve topology from UNIS for display | Ahmed, Ezra, Hussam | 5/28/13 | Completed | 4/16: Ezra sends proposal, some discussion, plan to stay with current plan. 4/30: Still plan to stay with current plan, separate topology data; need to make sure the topology is consistent and getting updated; some concern with when slice modifications happen. | |
5d | Plugin to configure GEMINI active measurements (w/out going to GN) | Ezra, Charles, Hussam | In progress | 4/30: Ezra provides proposal; Jim suggests waiting for new GENI Desktop API; no conclusion. 5/28/13 Keep configuration page on global node, add some code to configuration- should be simple and will be completed by GEC 17. | ||
5e | Plugin for scripts on GN to push GEMINI measurement data objects (and descriptors) to iRODS, with proper structure | Ezra, Charles, and Hussam | In Progress | 4/30: much like what is done today; see info on GENI Storage and Archive Service, and descriptive document. 5/28/13- Needs to be tested with ExoGENI. | ||
5f | Plugin to gather basic experiment info, and push descriptor files, including annotations, to iRODS, with proper structure (like e)) (med) | |||||
5g | Plugin to link to iRODS web interface, to curate user's files (med) | 4/16/2013 | Complete | 4/16: complete, based on available script | ||
5h | Consider "universal" plugin, to get an active web service? | |||||
6 | Add features to measurement services: BLiPP and MS | Frank (Matt) | In Progress | 5/28/13- IU will add links to Jira reflecting 6a and 6b | ||
6a | Verify current set of passive host measurements, and define any desired extensions | Frank (Matt) | In Progress | |||
6b | Complete set of active network measurements to match LAMP, and define any desired extensions | Frank (Matt) | 4/30/13 | In Progress | 5/14 | 4/30: the real problem is configuration; now all active measurements in UNIS are a proper resource; should be easy to finish |
6c | +Work with GMOC to define network monitoring use case, support GMOC in its use of active network measurements for network monitoring, and define any desired extensions | Martin | 5/28/13- Need update from Martin by next call | |||
6d | +Work with GMOC to consider how to best support OF in GENI test bed infrastructure | Martin | 5/28/13- Update by next Gemini call | |||
6e | Plan how to use NetLogger to gather custom measurements from an experiment application into BLiPP, and prototype | Matt, Dan | 5/14/13 | In Progress | 5/14 | Have NetLogger support elsewhere (not GEMINI) provide app level monitoring that OML has, just a question of prioritizing it. 5/28/13- Matt was working on this, Matt will put together a wiki page on how this works, IU will demo as well. |
7 | Prepare tutorials for multiple use cases, identify and fix any "kinks", support off-line use of tutorials, and evaluate user experiences at GEC17 (and before) to guide further development | Jeanne | In Progress | 5/28/13- Jim and Jeanne met about tutorial schedule. Gemini- content is open, 1)pre-canned rspec and expect user has done before and/or 2) Start with existing slice. This gives us a chance to focus on actual instrumentation. We will use a VM this time and by GEC18 try to go without a tutorial VM. We will have 1 session for hands on, and a general session to show more advanced/other experiments/GEMINI functionality. | ||
8 | Prototype User Workspace to retrieve measurement data and descriptors from iRODS, and prepare for further analysis and presentation | |||||
9 | v2 ready for testing | 7/9/13 | ||||
10 | v2 software released after testing; integrated tutorials presented | 7/21/13 |
- In cooperation with GIMI team
+ In cooperation with GMOC team
Demo 1- 5/14/2013
1) More complete active configuration page for BLiPP (leading to removal of pS-LAMP tools)
2) Ability to extend GEMINI instrumentation if the user extends their slice
3) Demonstrate our components working on ExoGENI images
Demo 2- 6/11/2013
1) Interoperability- Jeanne
2) New Features to BLiPP and MS- Matt, Frank
3) Auto-login from the Geni Portal to the Geni Desktop- Hussam
4) Basic NetLogger example- Ezra
Attachments (4)
- GEMINI_instrumentize_integration.pdf (177.6 KB) - added by 12 years ago.
- Visio-040313_GEMINI_Figures.pdf (289.8 KB) - added by 12 years ago.
- BLiPP Measurement Architecture.pdf (106.3 KB) - added by 12 years ago.
- 043013_Proposal_activemeasruementpage.txt (3.5 KB) - added by 12 years ago.
Download all attachments as: .zip