Changes between Version 33 and Version 34 of GEMINI_TopicsIssuesTasks


Ignore:
Timestamp:
04/27/12 17:58:41 (8 years ago)
Author:
hmussman@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GEMINI_TopicsIssuesTasks

    v33 v34  
    44
    55Notes and tasks from 3/22/12 GEMINI status call:  [[BR]]
    6 Additions and corrections after call on 3/27/12 with Martin:  [[BR]]
    7 Additions and corrections after team call on 3/29/12, and call on 3/30/12 with Jim:  [[BR]]
    8 Additions and changes after call with Martin and Jim on 4/4/12:  [[BR]]
    9 Addtions and changes after call with Jim and Charles on 4/17/12:  [[BR]]
    10 Additions and changes after call with Martin on 4/18/12:  [[BR]]
    11 Additions and changes after team call 4/19/12:   (sections are rearranged) [[BR]]
     6 - Additions and corrections after call on 3/27/12 with Martin:  [[BR]]
     7 - Additions and corrections after team call on 3/29/12, and call on 3/30/12 with Jim:  [[BR]]
     8 - Additions and changes after call with Martin and Jim on 4/4/12:  [[BR]]
     9 - Addtions and changes after call with Jim and Charles on 4/17/12:  [[BR]]
     10 - Additions and changes after call with Martin on 4/18/12:  [[BR]]
     11 - Additions and changes after team call 4/19/12:   (sections are rearranged) [[BR]]
     12 - Additions and changes after team call 4/19/12:
    1213
    1314* 4/5/12 topics :  [[BR]]
     
    4647 9d)  agree on schedule  [[BR]]
    4748
    48  
     49 + 5/3/12 topics suggested by Harry: [[BR]]
     50 5j')  report on Gush  (Jeanne)   (delayed) [[BR]]
     51 6d)  provide a more complete view of GEMINI portal service  (Jim, Charles on 4/18/12)  [[BR]]
     52 7l)  review updated test plan for making active network measurements  (Jeanne)  [[BR]]
     53 8a)  review current status of baseline configuration to gather host metrics (Guilherme, and all) [[BR]]
     54 9a)  agree on plan to coordinate configurations to make active network measurements  and to collect basic host metrics in one slice (all) [[BR]]
    4955 
    5056== 1)  Authentication and authorization:  multiple actor options: ==
     
    118124g)  Task:  (see e) above) how to access http interface?  tunnel through ssh?  port map, like ssh?  perhaps could "piggyback" on opening ssh port?  setup a separate proxy?   [[BR]]
    119125
    120  See [http://groups.geni.net/geni/wiki/RspecExtensionProposal_PortMapping  Port mapping proposal from Hussam]  [[BR]]
    121  Jim on 4/12:  Talked with Rob Ricci.  He is willing to work on it, since many needs to proxy to VMs.   (In INSTOOLS, used VNC) [[BR]]
    122  On 4/12:  protoGENI considering using OPS server to provide persistent proxy. [[BR]]
    123  Jim on 4/19:  Long term solution:  Gary Wong at Utah is considering a proxy service per testbed, advertised in manifest.  [[BR]]
    124  Jim of 4/19:  Short term solution:  user can get to http port via ssh and port forwarding;  Hussam has script.  [[BR]]
     126 - See [http://groups.geni.net/geni/wiki/RspecExtensionProposal_PortMapping  Port mapping proposal from Hussam]  [[BR]]
     127 - Jim on 4/12:  Talked with Rob Ricci.  He is willing to work on it, since many needs to proxy to VMs.   (In INSTOOLS, used VNC) [[BR]]
     128 - On 4/12:  protoGENI considering using OPS server to provide persistent proxy. [[BR]]
     129 - Jim on 4/19:  Long term solution:  Gary Wong at Utah is considering a proxy service per testbed, advertised in manifest.  [[BR]]
     130 - Jim of 4/19:  Short term solution:  user can get to http port via ssh and port forwarding;  Hussam has script.  [[BR]]
     131 - On 4/26:  short term solution:  for 1st, put MC only on a server;  concern:  some servers have limited capacity. [[BR]]
     132 - On 4/26:  long term solution:  wait for Utah proxy service per testbed;  when?    perhaps soon?[[BR]]
    125133 
    126134h)  Task:  what about vnc tunnels?  how were they done in INSTOOLS?   which port on host?  (who?)
     
    167175
    168176d)  Task:  Setup user workspace using server (or VM) in BBN Cambridge lab;  begin to include tools, etc .    (Jeanne) 
    169 On 3/30/12:  Done on VM in BBN Cambridge lab, ubuntu 10.04, internal to BBN. 
    170 **Next:  external to BBN
     177 - On 3/30/12:  Done on VM in BBN Cambridge lab, ubuntu 10.04, internal to BBN. 
     178 - **Next:  external to BBN
    171179
    172180e)  Task: Consider VM to distribute user workspace  (Matt);  e.g, ubuntu on virtual box [similar to what has been done at GEC tutorials]
     
    175183
    176184g)  Start with CNRI:  Directory Archive (DA) service, which can push data to DOA service, using OI service [[BR]]
    177 Then replace DOA with iRODS [[BR]]
    178 [Have iRODS at IU for NetKarma;  Jim and Wesley talking with Ilia and Shu] [[BR]]
    179 
    180 g')  Or, do we use IRODS client to push/pull date to/from IRODS?  [[BR]]
     185 - Then replace DOA with iRODS [[BR]]
     186 - Have iRODS at IU for NetKarma;  Jim and Wesley talking with Ilia and Shu [[BR]]
     187 - Or, do we use IRODS client to push/pull date to/from IRODS?  [[BR]]
    181188
    182189h)  Include MDOD creator/editor  (CNRI, GPO)
     
    188195
    189196j')  Use of GUSH:  [[BR]]
    190 *4/5/12 notes from Jeanne:  [[BR]]
    191 What does Gush provide vs. Flack?  Why would user use Gush?  [[BR]]
    192 Working with VMs.   According to Vic, Jeannie A. says Gush will work with anything that allows SSH.  [[BR]]
    193 Jeanne O. has experienced some issues with VMs in Gush.  Investigate further.  [[BR]]
    194 Issues with hostnames?  Need to investigate this further.  [[BR]]
    195 Harry:  Suggest Jeanne talk with Luisa about Gush information.  She has worked with it a lot.  [[BR]]
    196 Jim asks Martin:  How does Gush integrate with UNIS?  [[BR]]
    197 Discussion of using UNIS to store/access information about the slices for the experiment rather than passing around rspecs.  [[BR]]
    198 How do we keep this UNIS information up-to-date?  [[BR]]
    199 Guilherme suggests things that are outside of slice introspection, user needs to push to UNIS.  [[BR]]
    200 What types of changes can we make to the slice in Gush/Omni/other that I&M and others need to discover from UNIS?  [[BR]]
    201 Task:  Things to investigate regarding Gush (Jeanne will report next week):  [[BR]]
    202 1.   Tridentcom paper says gush has ability to add and remove nodes from a slice.  How is this done?  Under what circumstances does this work? [GENI AM API does not support updateSliver]  [[BR]]
    203 2.   How does Gush work with protogeni VMs?  [[BR]]
    204 
    205 4/12: Jeanne reports:    [[BR]]
    206 Certain commands (slice add, renew, update) apply only to PlanetLab.  [[BR]]
    207 Issue:  Gush takes hostname and goes to physical node, not VMs;  considering how to rectify.  [[BR]]
    208 In ORCA, this works.  hostname in manifest is not the same as the hostname reported for the node.  [[BR]]
    209 
    210 4/12:  Jim asks:  How would be run shell scripts on nodes?  scp between nodes?  [[BR]]
    211 
     197 - *4/5/12 notes from Jeanne:  [[BR]]
     198 - What does Gush provide vs. Flack?  Why would user use Gush?  [[BR]]
     199 - Working with VMs.   According to Vic, Jeannie A. says Gush will work with anything that allows SSH.  [[BR]]
     200 - Jeanne O. has experienced some issues with VMs in Gush.  Investigate further.  [[BR]]
     201 - Issues with hostnames?  Need to investigate this further.  [[BR]]
     202 - Harry:  Suggest Jeanne talk with Luisa about Gush information.  She has worked with it a lot.  [[BR]]
     203 - Jim asks Martin:  How does Gush integrate with UNIS?  [[BR]]
     204 - Discussion of using UNIS to store/access information about the slices for the experiment rather than passing around rspecs.  [[BR]]
     205 - How do we keep this UNIS information up-to-date?  [[BR]]
     206 - Guilherme suggests things that are outside of slice introspection, user needs to push to UNIS.  [[BR]]
     207 - What types of changes can we make to the slice in Gush/Omni/other that I&M and others need to discover from UNIS?  [[BR]]
     208 - Task:  Things to investigate regarding Gush (Jeanne will report next week):  [[BR]]
     209 - 1.   Tridentcom paper says gush has ability to add and remove nodes from a slice.  How is this done?  Under what circumstances does this work? [GENI AM API does not support updateSliver]  [[BR]]
     210 - 2.   How does Gush work with protogeni VMs?  [[BR]]
     211 - 4/12: Jeanne reports:    Certain commands (slice add, renew, update) apply only to PlanetLab.  [[BR]]
     212 - Issue:  Gush takes hostname and goes to physical node, not VMs;  considering how to rectify.  [[BR]]
     213 - In ORCA, this works.  hostname in manifest is not the same as the hostname reported for the node.  [[BR]]
     214 - 4/12:  Jim asks:  How would be run shell scripts on nodes?  scp between nodes?  [[BR]]
     215 - 4/26:  Known issue:  Gush does not find ssh port on VMs properly;  can this be fixed soon?  if not, cannot use Gush for GEC14
     216  - 4/26:  Jeanne will consider using just ssh for tests, not Gush, to load code and manage processes
     217 
    212218== 6)  Portal services ==
    213219
     
    303309
    304310a')  Need baseline configuration ASAP   [[BR]]
    305   4/12:  (Guilherme)  considering overall framework, working on interfaces, considering UNIS functions and schema.   [[BR]]
    306   4/19:  (Guilherme) Need baseline config for GEC14 tutorials ASAP  [[BR]]
     311 - 4/12:  (Guilherme)  considering overall framework, working on interfaces, considering UNIS functions and schema.   [[BR]]
     312 - 4/19:  (Guilherme) Need baseline config for GEC14 tutorials ASAP  [[BR]]
     313 - 4/26:  (Guilherme) Need baseline config for GEC14 tutorials ASAP
    307314 
    308315a!'')  Need MP to gather host metrics   (Guilherme)
    309316  - easy for raw servers;  hard for VMs
    310   - considering BLiPP (Matt) to gather all utilization metrics;  extend via libvirt to gather metrics from VMs
    311   - Could still use SNMP daemon from INSTOOLS  (Jim, Hussam)
     317  - considering BLiPP (Matt) to gather all utilization metrics;  how to refactor BLipp?
     318   - plan to use libvirt to gather metrics from VMs and hypervisor node
     319   - on 4/26:  *** need to talk with InstaGENI to get libvert installed!
     320  - Could still use SNMP daemon from INSTOOLS to gather table info  (Jim, Hussam)
    312321  -  Use netflow to gather flow metrics;  need to be able to turn on/off since uses many resources
     322  - on 4/26:  for 1st, do not include netflow, because of capacity issues
    313323  -  Could associate netflow with both hosts and switches.
    314324 
     
    316326 - 4/12:  For those gathered by INSTOOLS, see [http://groups.geni.net/geni/attachment/wiki/GEMINI_TopicsIssuesTasks/012312_INSTOOLS_Measurements.txt   list] by Hussam
    317327 - Talking to Dan about use cases for gathering host metrics.
    318  - 4/19:  see list on github at:  [https://github.iu.edu/GEMINI/GEMINI/wikis/user-stories-for-instrumenting-an-experimenters-slice  list]
     328 - 4/19:  see list on github at:   [https://github.iu.edu/GEMINI/GEMINI/wikis/user-stories-for-instrumenting-an-experimenters-slice list]
    319329 - 4/19:  start with utilization metrics
    320330 - 4/19:  later, add netflow metrics
     331 - 4/26:  need up-to-date list
    321332
    322333
    323334b)  MP pushes to Measurement Store (MS)
    324335  - Use http?  POST to port?  what about authentication and authorization?
    325   - Use XSP, for streaming?
     336  - Use XSP, for streaming?  Martin on4/26:  working well.
    326337       
    327338c)  Need to realize new MS
     339  - using on SQL for data
    328340  - How many options?
    329341  - One per Aggregate?
     
    361373 - 4/19:  For GEC13, LAMP code and INSTOOLS code were both loaded;  portal was pointed to both GUIs
    362374 - 4/19:  Plan to load both types of code
     375 - 4/26::  plan for host monitoring to be ON by default;  need to specifically enable network measurements
    363376 - 4/19:  Perhaps UK could work on unified deployment plan.  Note:  Cannot use UpdateSlice.
     377 - 4/26:  Harry suggests using perfSONAR config GUI to config host measurements
    364378 
    365379b)  Long term strategy:  unified set of tools
     
    374388 - Testing and bug fixes:  +2 weeks
    375389 - Prepare and test turotrial:  +1 week
     390 - also INSTOOLS to GENI summer camp, 5/29 - 6/2
     391 - also INSTOOLS to TridentCom 6/15
    376392
    377393