[[PageOutline]] = Cluster-D Meetings at GEC9, Agenda and Notes = Tuesday, Nov 2, 12noon - 4:30pm [[BR]] Room: Congressional A [[BR]] Meeting Chair: Ilia Baldine (RENCI)[[BR]] System Engineer: Harry Mussman (GPO, Raytheon BBN Technologies) [[BR]] == Introductions (12noon) == == Spiral 3 Goals (12:05pm, Mussman) == The following high-level goals have been established by the GPO for Spiral 3: [[BR]] Experiments: [[BR]] * Use by outside researchers[[BR]] * Use involving multiple aggregates[[BR]] * Use for research experiments [[BR]] Some expected experiments using Cluster D during Spiral 3:[[BR]] * Programmable Packet Networks over Dynamic Circuit Substrate (Jeff Chase, Xiaowei Yang)[[BR]] * Optical-layer experiments (BEN network, ERM sensors and actuators, IMF capabiliites)[[BR]] * Mobile wireless experiments (DOME)[[BR]] * Nowcasting experiments, using weather data from ViSE radar, processed in local cluster and/or cloud (ViSE and DICLOUD)[[BR]] * Sensor network experiments (Kansei, Neteye)[[BR]] * Robotics experiments (OKGems)[[BR]] Interoperability:[[BR]] * Researchers can obtain and stitch resources from multiple aggregates[[BR]] * Researchers from other CFs (e.g., protoGENI) can obtain resources from Cluster D aggregates via GENI AM API [[BR]] * Researchers in Cluster D can obtain resources from aggregates other CFs (e.g., protoGENI)via GENI AM API [[BR]] == Proposed Spiral 3 Roadmap for Discussion (12:15pm, Mussman and Baldine) == Cluster D clearinghouse from Spiral 2: [[BR]] * Operational readiness[[BR]] * Connectivity by aggregates[[BR]] * Features[[BR]] Cluster D connectivity from Spiral 2: [[BR]] * Control framework message flows between actors [[BR]] * Component programming via SSH [[BR]] * VLAN connectivity to Internet 2 or NLR [[BR]] * Many VLANs [[BR]] * Bridge between backbone networks [[BR]] * Ability to control setup of VLANs as part of experiment [[BR]] * Ability to control setup of VLANs as part of experiment involving multiple aggregates [[BR]] Task list for Spiral 3: [[BR]] * Streamline Cluster D site setup and operation, including cluster (Eucalyptus) and connector (L2 switch, with full tag mapping) [[BR]] * Streamline connectivity to Cluster D sites on campuses, via regional networks (LEARN project) [[BR]] * Plan to allow Cluster D researchers to obtain and stitch resources from multiple Cluster D sites, connected by backbone domain, using their SM. [[BR]] * Plan to authenticate users in SM via InCommon/Shibboleth [[BR]] * With other CFs, a plan for consistent names and interfaces [[BR]] * With other CFs, a plan for resource descriptions at interoperability interfaces [[BR]] * Plan to interop with other CFs, particularly from and to protoGENI (Cluster C) [[BR]] * Plan to allow GENI (e.g., protoGENI) researchers to obtain resources via GENI AM API v1.0 (using RSpec resource description) [[BR]] * Plan to allow Cluster D researchers to include tools (e.g., GUSH) to help authorize, reserve, assign and configure resources via “ORCA SM API v1.0” XMLRPC interface to their SM (similar to protoGENI AM API, or possibly same as GENI AM API v2.0) [[BR]] * Plan for Cluster D researchers to get resources from protoGENI aggregates via GENI AM API v1.0 (or possibly protoGENI AM API) (using RSpec resource description) [[BR]] * Plan for naming and stitching L2 connectivity across Cluster C (protoGENI), and Cluster D sites [[BR]] * Plan for operations portal into Cluster D site, including status and logs, with connections to GMOC [[BR]] Demos for GEC10:[[BR]] * Demo experiment where Cluster D researchers obtain and stitch resources from multiple Cluster D sites (and backbone domains) using their SM.[[BR]] * Demo experiment where protoGENI researchers obtain resources via GENI AM API v1.0, using RSpec resource description.[[BR]] * Demo operations portal into Cluster D site, for status and logs, with connections to GMOC[[BR]] Demos for GEC11: [[BR]] * Demo experiment where Cluster D researchers get resources from protoGENI aggregates via GENI AM API v1.0 (or possibly protoGENI AM API) (using RSpec resource description)[[BR]] * Demo experiment where Cluster D researchers stitch L2 connectivity across Cluster C (protoGENI), and Cluster D sites[[BR]] * Demo experiment where Cluster D researchers include tools (e.g., GUSH) to help authorize, reserve and assign resources via “ORCA SM API v1.0” XMLRPC interface to their SM (similar to protoGENI AM API, or possibly same as GENI AM API v2.0)[[BR]] [http://groups.geni.net/geni/attachment/wiki/Gec9ClusterDAgenda/Visio-102810_partial_ClusterD_Spiral3_Drawings.pdf All Figures]: [[BR]] Figure 1-1) and 1-2): Cluster D Config at end of Spiral 3 [[BR]] * Each Cluster D site is a self-contained aggregate, which can offer resources to all of GENI using GENI AM API.[[BR]] (See figure below)[[BR]] Figure 2): ORCA Site Config [[BR]] * Adding interface for Site and GMOC admin/operations[[BR]] * Adding ExpCntrlTools[[BR]] * Adding Measurement Tools (various I&M projects)[[BR]] * Adding UserWorkspaceSrvc and DigitalObjectArchiveSrvc (CNRI project)[[BR]] (See figure below)[[BR]] Figure 3): Multiple ORCA Sites [[BR]] * Actors exchange ORCA messages[[BR]] * Supports stitching[[BR]] * Supports advanced reservations[[BR]] (See figure below)[[BR]] Figure 4): ORCA Interop with protGENI [[BR]] * Both from and to protoGENI[[BR]] * Expect to be able to stitch both Cluster D and protoGENI resources[[BR]] (See figure below)[[BR]] Figure 5): ORCA Experiment Flow [[BR]] * All steps need to be supported, per I&M architecture[[BR]] (See figure below)[[BR]] == ORCA Features Spiral 2 report and Spiral 3 roadmap (1pm, Baldine) == * Upcoming Bella 2.2 status * Bella 2.2 Features in detail * XMLRPC controller * Eucalyptus integration and NEuca extensions * Euca site experiment topology embedding * Format conversions (http://geni-test.renci.org:11080/ndl-conversion/convert.jsp) * Actor registry * Bella 3.x upcoming Spiral 3 features * New substrate support * Experiment support * Authentication and authorization * ProtoGENI interoperability * Connectivity planning * Naming and format conversions * Handlers and policies * Tools integration * Clearinghouse and intra-cluster connectivity * Status * Actor registry * Future == Break (1:40-2:00pm) == == Cluster D Project Plans for Spiral 3 (2pm - 3:30pm) == Each project should prepare NO MORE THAN THREE slides for presentation, and upload to the wiki below:[[BR]] 1) Functions and features planned for Spiral 3:[[BR]] 2) Connectivity planned for Spiral 3: [[BR]] * Component programming via SSH? [[BR]] * VLAN connectivity to Internet 2? NLR? How many VLANs? [[BR]] * Ability to control setup of VLANs as part of experiment? [[BR]] 3) Experiments planned for Spiral 3: [[BR]] * Use by outside researchers? [[BR]] * Use involving multiple aggregates? [[BR]] * Use for research experiments? [[BR]] === ORCA/BEN === Ilia Baldine [[BR]] ~~ === DOME === ~~ ~~ Brian Lynn ~~[[BR]] === ViSE === David Irwin[[BR]] === DICloud === Michael Zink [[BR]] === KANSEI === Anish Arora [[BR]] ~~ === OKGems === ~~ ~~ Andy Li ~~[[BR]] === ERM === Keren Bergman, Caroline Lai, Michael Wang [[BR]] === IMF === Rudra Dutta === LEARN === Deniz Gurkan [[BR]] === iGENI === Joe Mambretti, Jim Chen [[BR]] == Open Discussion (3:30pm) == Who is going to work with the ORCA group on the following tasks? [[BR]] * Streamline Cluster D site setup and operation, including cluster (Eucalyptus) and connector (L2 switch, with full tag mapping) [[BR]] * Streamline connectivity to Cluster D sites on campuses, via regional networks (LEARN project) [[BR]] * Plan to allow Cluster D researchers to obtain and stitch resources from multiple Cluster D sites, connected by backbone domain, using their SM. [[BR]] * Plan to authenticate users in SM via InCommon/Shibboleth [[BR]] * With other CFs, a plan for consistent names and interfaces [[BR]] * With other CFs, a plan for resource descriptions at interoperability interfaces [[BR]] * Plan to interop with other CFs, particularly from and to protoGENI (Cluster C) [[BR]] * Plan to allow GENI (e.g., protoGENI) researchers to obtain resources via GENI AM API v1.0 (using RSpec resource description) [[BR]] * Plan to allow Cluster D researchers to include tools (e.g., GUSH) to help authorize, reserve, assign and configure resources via “ORCA SM API v1.0” XMLRPC interface to their SM (similar to protoGENI AM API, or possibly same as GENI AM API v2.0) [[BR]] * Plan for Cluster D researchers to get resources from protoGENI aggregates via GENI AM API v1.0 (or possibly protoGENI AM API) (using RSpec resource description) [[BR]] * Plan for naming and stitching L2 connectivity across Cluster C (protoGENI), and Cluster D sites [[BR]] * Plan for operations portal into Cluster D site, including status and logs, with connections to GMOC [[BR]] == Adjourn (4:00pm) == == Figures == [http://groups.geni.net/geni/attachment/wiki/Gec9ClusterDAgenda/Visio-102810_partial_ClusterD_Spiral3_Drawings.pdf All Figures]: [[BR]] Figure 1-1) and 1-2): Cluster D Config at end of Spiral 3 [[BR]] * Each Cluster D site is a self-contained aggregate, which can offer resources to all of GENI using GENI AM API.[[BR]] [[Image(Visio-102810_partial_ClusterD_Spiral3_Drawings_Page_1.jpg, 100%)]] [[BR]] [[Image(Visio-102810_partial_ClusterD_Spiral3_Drawings_Page_2.jpg, 100%)]] [[BR]] Figure 2): ORCA Site Config [[BR]] * Adding interface for Site and GMOC admin/operations[[BR]] * Adding ExpCntrlTools[[BR]] * Adding Measurement Tools (various I&M projects)[[BR]] * Adding UserWorkspaceSrvc and DigitalObjectArchiveSrvc (CNRI project)[[BR]] [[Image(Visio-102810_partial_ClusterD_Spiral3_Drawings_Page_3.jpg, 100%)]] [[BR]] Figure 3): Multiple ORCA Sites [[BR]] Actors exchange ORCA messages[[BR]] Supports stitching[[BR]] Supports advanced reservations[[BR]] [[Image(Visio-102810_partial_ClusterD_Spiral3_Drawings_Page_4.jpg, 100%)]] [[BR]] Figure 4): ORCA Interop with protGENI [[BR]] * Both from and to protoGENI[[BR]] * Expect to be able to stitch both Cluster D and protoGENI resources[[BR]] [[Image(Visio-102810_partial_ClusterD_Spiral3_Drawings_Page_5.jpg, 100%)]] [[BR]] Figure 5): ORCA Experiment Flow [[BR]] * All steps need to be supported, per I&M architecture[[BR]] [[Image(Visio-102810_partial_ClusterD_Spiral3_Drawings_Page_6.jpg,100%)]] [[BR]] == References ==