[[PageOutline]] = Cluster D Integration = == 1. Projects == [http://groups.geni.net/geni/wiki/ORCABEN ORCA/BEN (1582)] and [wiki:ORCAAUG ORCA Augmentation (1700)][[BR]] [http://groups.geni.net/geni/wiki/DOME DOME (1599)][[BR]] [http://groups.geni.net/geni/wiki/ViSE ViSE (1602)][[BR]] [http://groups.geni.net/geni/wiki/Embedded%20Real-Time%20Measurements Embedded Real-Time Measurements (ERM, 1631)][[BR]] [http://groups.geni.net/geni/wiki/KanseiSensorNet KanseiGenie (KanseiGenie, 1633)][[BR]] [http://groups.geni.net/geni/wiki/DICLOUD Data Intensive Cloud Control (DICLOUD, 1709)][[BR]] [http://groups.geni.net/geni/wiki/OKGEMS OKGems: Cyber-Physical System (OKGEMS, 1716)][[BR]] [http://groups.geni.net/geni/wiki/IMF Integrated Measurement Framework (IMF, 1718)][[BR]] [http://groups.geni.net/geni/wiki/IGENI iGENI Distributed Network Research Infrastructure (IGENI, 1719)][[BR]] [http://groups.geni.net/geni/wiki/LEARN LEARN Network (LEARN, 1733)][[BR]] [http://groups.geni.net/geni/wiki/BBN_ORCA BBN ORCA Xen Cluster] [[BR]] [http://groups.geni.net/geni/wiki/Mile_QSR_Process Process for updating Milestones, submitting QSRs] [[BR]] == 2. Meetings and Demos == Suggested mailing lists for Cluster D participants: [[BR]] [http://lists.geni.net/mailman/listinfo "GENI mailing lists"], including the dev, discuss and geni-announce lists, plus working groups that cover your interests. [[BR]] [mailto:cluster-d@renci.org mail to cluster-d@renci.org] for PIs and senior personnel, including administrative cluster-wide issues. / [https://mm.renci.org/mailman/ext/listinfo.cgi/cluster-d subscribe] / [https://mm.renci.org/mailman/ext/private.cgi/cluster-d/ mailman archieve][[BR]] [mailto:geni-orca-users@renci.org mail to geni-orca-users@renci.org] primarily for developers, including technical discussions about the implementation, etc. / [https://mm.renci.org/mailman/ext/listinfo.cgi/geni-orca-users subscribe] / [https://mm.renci.org/mailman/ext/private.cgi/geni-orca-users/ mailman archieve][[BR]] [https://geni-orca.renci.org/trac/wiki/events/orca-fest-2009 ORCA-fest May 28, 2009, web site][[BR]] Cluster D Conference Call on June 11, 2009 [[BR]] [http://groups.geni.net/geni/wiki/ClusterDMtg070209 Cluster D Review Meeting July 2, 2009][[BR]] [http://groups.geni.net/geni/attachment/wiki/ORCABEN/071509c%20%20ORCA_BEN%20demo.pdf "ORCA/BEN Integration Demo with Stitching of VLANs between BEN and NLR", July 7, 2009][[BR]] [https://geni-orca.renci.org/trac/wiki/events/orca-nlr-july-2009 "ORCA/BEN Integration Demo July 7, 2009, web site][[BR]] [http://groups.geni.net/geni/wiki/Gec5ClusterDAgenda "Cluster D Meetings at GEC5 July 20 and 21, 2009"][[BR]] [http://groups.geni.net/geni/wiki/oct292009agenda "Cluster D conference call on October 29, 2009"][[BR]] [http://groups.geni.net/geni/wiki/Gec6ClusterDAgenda "Cluster D Meetings at GEC6 on Nov 16 and 17, 2009, Agenda and Notes"] [[BR]] [http://groups.geni.net/geni/wiki/jan272010agenda "Cluster D conference call on January 27, 2010"][[BR]] [http://groups.geni.net/geni/wiki/feb32010agenda "Cluster D conference call on February 3, 2010"][[BR]] [http://groups.geni.net/geni/wiki/feb102010agenda "NDL conference call on February 3, 2010"][[BR]] [http://groups.geni.net/geni/wiki/feb172010agenda "Cluster D conference call on February 17, 2010"][[BR]] [http://groups.geni.net/geni/wiki/march32010agenda "Cluster D conference call on March 3, 2010"][[BR]] [http://groups.geni.net/geni/wiki/Gec7ClusterDDemos "Cluster D demos at GEC7 on March 16 and 17, 2010"] [[BR]] [http://groups.geni.net/geni/wiki/Gec7ClusterDAgenda "Cluster D Meetings at GEC7 on March 16 and 17, 2010, Agenda and Notes"] [[BR]] [http://groups.geni.net/geni/wiki/Gec7ResourceRepresentationWorkshop "Workshop on Future Resource Representations in GENI, after GEC7 on March 18, 2010, Agenda and Notes"][[BR]] [wiki:april040910agenda "Cluster D conference call on April 9, 2010"][[BR]] [wiki:april042310agenda "Cluster D conference call on April 23, 2010"][[BR]] [wiki:april052110agenda "Cluster D conference call on May 21, 2010"][[BR]] [wiki:june061810agenda "Cluster D conference call on June 18, 2010"][[BR]] [wiki:july070210agenda "Cluster D conference call on July 2, 2010"][[BR]] [http://groups.geni.net/geni/wiki/Gec8Workshops#RSpecworkshop "Workshop on Future Resource Representations in GENI, before GEC8 on July 20, 2010, Agenda and Notes"][[BR]] [http://groups.geni.net/geni/wiki/Gec8ClusterDAgenda "Cluster D Meeting at GEC8 on July 20, 2010, Agenda and Notes"] [[BR]] == 3. References and Documents == [https://geni-orca.renci.org/trac/ GENI - ORCA web site], including ORCA code and ticket system [[BR]] [https://mm.renci.org/mailman/ext/listinfo.cgi/cluster-d Subscribe to Cluster D mailing list] (cluster-d@renci.org), for PIs and senior personnel, to discuss administrative cluster-wide issues [[BR]] [https://mm.renci.org/mailman/ext/listinfo.cgi/geni-orca-users Subscribe to Cluster D mailing list] (geni-orca-users@renci.org), primarily for developers, to discuss technical issues about the implementation, etc. [[BR]] [http://groups.geni.net/geni/wiki/DOMEControllerModule Prototype DOME controller and handler modules for ORCA, 2009][[BR]] [http://groups.geni.net/geni/attachment/wiki/ClusterD/070209b%20%20ClusterD_Spiral1_Plan.doc Spiral 1 Plan Document, on 7/02/09][[BR]] [http://groups.geni.net/geni/attachment/wiki/ClusterD/072109b%20%20ClusterD_Meeting_GEC5.ppt Spiral 2 Roadmap slides, with task ratings, on 7/21/09][[BR]] [http://groups.geni.net/geni/attachment/wiki/ClusterD/101509%20ClusterD_Spiral2_Roadmap.pdf Cluster D Roadmap Document, on 10/15/09][[BR]] [http://groups.geni.net/geni/attachment/wiki/ClusterD/Visio-101509_ClusterD_Spiral2_Drawings.pdf Cluster D Roadmap Drawings, on 10/15/09][[BR]] [http://groups.geni.net/geni/wiki/clusterdvlan GENI Cluster D Spiral 2 Connectivity Plan, on 10/15/09] [[BR]] == 4. Roadmap for Spiral 2 == === 4.1 Goals === The following goals have been established by the GPO for Spiral 2. [[BR]] Goal 1: Live experiments, the central goal of Spiral 2. Support significant numbers of research experiments in the end-to-end prototype systems. The GPO expects live experimentation to begin near the end of Spiral 1, which will intensify through Spiral 2 as we begin continuous operation of the prototype systems. This will begin to give us all substantial (early) operational experience, as these experiments will help us all understand the prototypes' strengths and weakness, which will drive our Spiral 3 goals. [[BR]] Goal 2: Identity management [[BR]] Goal 3: Improved integration of data & control planes, within clusters [[BR]] Goal 4: Instrumentation [[BR]] Goal 5: Interoperability, permitting clusters to access the widest number of aggregate [[BR]] === 4.2 Key Dates === Begin 9/1/09 or 10/1/09, depending on the project [[BR]] ORCA Rel 1.3 10/1/2009[[BR]] GEC6 11/16/09 [[BR]] ORCA Rel 2.1 2/1/10[[BR]] GEC7 3/16/10 [[BR]] ORCA Rel 2.2 6/1/10[[BR]] GEC8 7/20/10[[BR]] End 8/31/10 or 9/30/10, depending on the project [[BR]] ORCA Rel 2.3 10/1/10 [[BR]] === 4.3 ORCA Software Releases === ==== 4.3.1 Roadmap ==== The ORCA software releases are currently scheduled for every 4 mo. , and include work done by both Solicitation 1 (1582) and Solicitation 2 (1700) ORCA projects. [[BR]] ORCA Rel 1.3 10/1/2009[[BR]] ORCA Rel 2.1 2/1/10[[BR]] ORCA Rel 2.2 6/1/10[[BR]] ORCA Rel 2.3 10/1/10 [[BR]] The following roadmap describes features and capabilities of ORCA software releases. [[BR]] [[Image(features1.jpg, 60%)]] [[BR]] [[Image(features 2.jpg, 60%)]] [[BR]] Figure 1-6: Slice controller API on the service manager [[BR]] [[Image(Visio-101509_ClusterD_Spiral2_Drawings_Page_06.jpg, 40%)]] [[BR]] Figure 1-5: Identity provider verifies login [[BR]] [[Image(Visio-101509_ClusterD_Spiral2_Drawings_Page_05.jpg, 40%)]] [[BR]] ==== 4.3.2 Status ==== 1) For latest status, go to [https://geni-orca.renci.org/trac/ GENI - ORCA, web site maintained by RENCI, including ORCA code and ticketing system] or contact Ilia Baldine ibaldin@renci.org at RENCI [[BR]] ==== 4.3.3 Issues ==== 1) Revoking / Canceling Leases [[BR]] With ORCA, is there a method for leases to be canceled, or for outstanding requests to be revoked? This is required, or at least very highly desired, for DOME. Some scenarios: [[BR]] * An experiment is started on the buses and the researcher begins getting erroneous results, or the experiment starts generating too much data (this happens). We'd like to be able to prematurely terminate a lease to stop the experiment, even if the allocated resources are not returned to the pool. [[BR]] * An experiment is scheduled for the future, but then the researcher discovers he or she wants to change the experiment or alter the time. [[BR]] Obviously, there are many other scenarios that make the functionality desirable. [[BR]] === 4.4 Cluster D Operating Capabilities and Clearinghouse === ==== 4.4.1 Roadmap ==== The following roadmap describes features and capabilities of the Cluster D operating environment, including a production-level Cluster D clearinghouse. [[BR]] [[Image(ops1.jpg, 60%)]] [[BR]] [[Image(ops2.jpg, 60%)]] [[BR]] Figure 1-1: Cluster D Configuration at start of Spiral 2 [[BR]] [[Image(Visio-101509_ClusterD_Spiral2_Drawings_Page_01.2.jpg, 40%)]] [[BR]] Figure 1-2: Message flows between actors [[BR]] [[Image(Visio-101509_ClusterD_Spiral2_Drawings_Page_02.jpg, 40%)]] [[BR]] Figure 1-3: Parallel local and clearinghouse brokers [[BR]] [[Image(Visio-101509_ClusterD_Spiral2_Drawings_Page_03.jpg, 40%)]] [[BR]] Figure 1-4: Experiment from remote or local service manager, and clearnghouse broker [[BR]] [[Image(Visio-101509_ClusterD_Spiral2_Drawings_Page_04.jpg, 40%)]] [[BR]] ==== 4.4.2 Status ==== For access to Cluster D Clearinghouse, go to [http://geni.renci.org:8080/orca/ Cluster D Clearinghouse at RENCI] ; get login from ibaldin@renci.org [[BR]] 1) Clearinghouse at RENCI: Yes? [[BR]] 2a) BEN and VM brokers in clearinghouse: Yes? [[BR]] 2b) DOME broker in clearinghouse: Yes? [[BR]] 2c) ViSE broker in clearinghouse: Yes? [[BR]] 2d) Kansei broker in clearinghouse: Yes? [[BR]] 2e) BBN broker in clearinghouse: No? [[BR]] Figure 1-1: Cluster D Configuration at start of Spiral 2 [[Image(Visio-101509_ClusterD_Spiral2_Drawings_Page_01.2.jpg, 40%)]] [[BR]] ==== 4.4.3 Issues ==== === 4.5 Cluster D VLAN Capabilities === ==== 4.5.1 Roadmap ==== The following roadmap describes Cluster D VLAN capabilities. [[BR]] [[Image(vlan.jpg, 40%)]] [[BR]] ==== 4.5.2 Status ==== 1) "All S1 aggregates connect to Internet2 (or NLR) with link capable of Layer 2 connection" Due 10/1/09 [[BR]] 1a) BEN and VMs connected to NLR; see [http://groups.geni.net/geni/wiki/ORCABEN#Spiral2Connectivity BEN Connectivity][[BR]] 1b) DOME connected to Internet2, or NLR; see [http://groups.geni.net/geni/wiki/DOME#Spiral1Connectivity DOME Connectivity][[BR]] 1c) ViSE connected to Internet2, or NLR; see [http://groups.geni.net/geni/wiki/ViSE#Spiral1Connectivity ViSE][[BR]] 1d) Kansei not connected?; see [http://groups.geni.net/geni/wiki/KanseiSensorNet#Spiral1Connectivity Kansei Connectivity][[BR]] 1e) BBN VMs connected to NLR?; see ? [[BR]] 2) "Cluster D completes plan for the setup of VLANs between testbeds, to be carried by Internet 2 (or NLR) backbone network between the testbeds" Due 11/16/09, GEC6 [[BR]] See: [http://groups.geni.net/geni/wiki/clusterdvlan GENI Cluster D Spiral 2 Connectivity Plan] [[BR]] ==== 4.5.3 Issues ==== === 4.6 Cluster D Experiment Capabilities === ==== 4.6.1 Roadmap ==== The following roadmap describes Cluster D experiment capabilities. [[BR]] [[Image(experiment.jpg, 40%)]] [[BR]] Figure 1-3: Parallel local and clearinghouse brokers [[BR]] [[Image(Visio-101509_ClusterD_Spiral2_Drawings_Page_03.jpg, 40%)]] [[BR]] Figure 1-4: Experiment from remote or local service manager, and clearnghouse broker [[BR]] [[Image(Visio-101509_ClusterD_Spiral2_Drawings_Page_04.jpg, 40%)]] [[BR]] Figure 1-7: Experiment with two aggregates [[BR]] [[Image(Visio-101509_ClusterD_Spiral2_Drawings_Page_07.jpg, 40%)]] [[BR]] ==== 4.6.2 Status ==== 1) "All S1 aggregates ready for experiments by outside researchers" Due 10/1/09 [[BR]] 1a) BEN experiments by ERM project? [[BR]] 1b) DOME experiments by Undergraduate networking class in fall 2009? [[BR]] 1c) ViSE experiments using rapidly deployable node? [[BR]] 1d) Kansei experiments by internal researchers? [[BR]] 1e) BBN VMs experiments by? [[BR]] 2) "All S1 aggregates ready for experiments by researchers using remote SMs and CH brokers." Due 11/16/09, GEC6 [[BR]] ==== 4.6.3 Issues ==== 2a) For each S1 aggregate, how can remote portal and SM be built? 2b) [http://groups.geni.net/geni/attachment/wiki/ClusterD/DOME-Federation.pdf DOME and Federated Scheduling, i.e., towards an experiment that utilizes resources from multiple testbeds][[BR]] [wiki:requirementsfilehtml ][[BR]] == 5. Cluster D Connectivity Plan == === 5.1 Control Framework Message Flows === Figure 1-1: Cluster D Configuration at start of Spiral 2 [[Image(Visio-101509_ClusterD_Spiral2_Drawings_Page_01.2.jpg, 40%)]] [[BR]] Figure 1-2: Message flows between actors [[BR]] [[Image(Visio-101509_ClusterD_Spiral2_Drawings_Page_02.jpg, 40%)]] [[BR]] === 5.2 Component Programming via SSH === Figure 2-1: SSH Access to a Component [[BR]] [[Image(Visio-111609_ClusterD_Connectivity_Page_3.jpg, 40%)]] [[BR]] === 5.3 VLAN Connectivity Between Aggregates === [http://groups.geni.net/geni/wiki/clusterdvlan VLAN Connectivity Plan] === 5.4 VLAN Connectivity for GEC7 Demos === From 2/3 call: + Planning on a demo, RENCI, iGENI, UMass[[BR]] + Both first day, and plenary[[BR]] + BBN will map VLAN, from UMass to BBN, to NLR FrameNet (which now terminates at RENCI)[[BR]] + Overall path: from UMass, through NOX, to BBN, through NOX, through NLR Framenet, to iGENI, to RENCI. + To setup path: David Irwin (UMass Amherst), Chaos Golubitsky (BBN), Chris Heermann (RENCI), Jim Chen (Northwestern)[[BR]] + Chris Heermann (RENCI) coordinates + Pending: UMass direct connection to NLR FrameNet[[BR]] + Pending: BBN will get Cisco 3750, which can be used later[[BR]] + Pending: x2 NLR FrameNet ports for Starlight