[[PageOutline]] == Project Number == 1718 == Project Title == GENI IMF: Integrated Measurement Framework and Tools for Cross Layer Experimentation [[BR]] a.k.a. IMF === Technical Contacts === PI: Rudra Dutta Department Of Computer Science North Carolina State University dutta@csc.ncsu.edu http://www.csc.ncsu.edu/directories/faculty_info.php?id=1665 [[BR]] Co-PI: George Rouskas Department of Computer Science North Carolina State University rouskas@ncsu.edu http://www.csc.ncsu.edu/directories/faculty_info.php?id=241 [[BR]] Subcontractor: Ilia Baldine Renaissance Computing Institute (RENCI) ibaldin@renci.org http://www.renci.org/about/leadership [[BR]] Subcontractor: Keren Bergman Department of Electrical Eng. Columbia University bergman@ee.columbia.edu http://www.ee.columbia.edu/fac-bios/bergman/faculty.html [[BR]] [https://geni-imf.renci.org Project Website] === Participating Organizations === [http://www.csc.ncsu.edu/ NCSU, CS Dept][[BR]] [http://www.ee.columbia.edu/ Columbia University, EE Dept][[BR]] [http://www.renci.org/ Renaissance Computing Insititute (RENCI), Chapel Hill, NC][[BR]] [https://ben.renci.org/ BEN: Breakable Experimental Network][[BR]] === GPO Liaison System Engineer === Harry Mussman hmussman@geni.net == Scope == This project will develop and integrate the GENI Integrated Measurement Framework (IMF) for optical communication substrates into the ORCA control framework prototype, and integrate the FIND SILO framework into the ORCA control framework prototype, and IMF and SILO with each other, to enable cross-layer experimentation involving the physical layer of an optical network. [[BR]] This will enable (a) measurements from an optical substrate to be passed to a measurement consumer inside a slice; this is a valuable capability since the optical substrate characteristics may be important to the experimenter in the slice although the substrate itself is not directly observable by the experimenter, and (b) enable the automated (in-stack) consumption of measurement data; this is important for an experimenter who does not merely want to see the optical substrate measurement data after the experiment, but would like to experiment with reactive protocols designed to run inside the stack and react in real-time to measurements. [[BR]] [[Image(IMF_Overview.png, 50%)]] [[BR]] Initial deployment will be in the Breakable Experimental Network (BEN), a regional optical network located in North Carolina. [[BR]] The IMF will utilize deliverables from the Embedded Real-time Measurements (ERM) project, including its Unified Measurements Framework (UMF).[[BR]] The IMF will provide a single point of access to various devices in the optical substrate. The IMF will include a software module that interfaces with the UMF to gather measurements from the optical substrate, and that communicates with SILO (and other software modules) over a specified communication protocol, also to be developed in this project. [[BR]] The interface between the IMF and the optical devices in BEN will be leveraged from the UMF of the ERM project. The IMF will gather measurements from devices with performance monitoring capabilities already incorporated into the BEN, including: the Infinera DTN, a remotely configurable optical add/drop multiplexer (ROADM); and the Polatis 24 port fiber switch. This will be guided by the output of the Data Plane Measurements project, that identified measurement capabilities in a wide range of equipment. In addition, the use of programmable measurement nodes and performance monitors will be assessed. [[BR]] The Services Integration, controL and Optimization (SILO) framework was previously developed and prototyped in the NSF Future Internet Design (FIND) project. It will be extended to provide the tools for the experimenter to enable cross-layer experimentation. New SILO services will be developed to interface with the IMF and to introduce optical substrate measurement capability into custom protocol stacks. [[BR]] Both the IMF and SILO will be integrated with ORCA, so that they can be assigned to the slice of a researcher, who can then configure and run them to conduct an experiment. This project will collaborate with the ORCA Augmentation project on an ontology for measurement capabilities.[[BR]] This project will collaborate with other GENI projects on the development of a common GENI instrumentation and measurement architecture. [[BR]] === Current Capabilities === The overall architecture of the project has been articulated. The first diagram below shows the experimenter view of the proposed system; realization of this is part of our Year 2 goals. The second diagram below shows the component systems interaction architecture. [[BR]] January 2011 update: Upon consultation with GPO, the priorities of the project have been revised a little. Year 2 (Spiral 3) goals now focus on integrating the developed IMF capabilities for measurement, and transfer of measurement (from substrate to in-slice stack), with existing GENI Inst&Meas capabilities; specifically, to integrate and install perfSONAR (pS) MPs and archives to collect performance measurement data from Polatis switches and Infinera DWDM platforms on 4 BEN sites, and (subsequently) integrate pS MP polling into IMF to demonstrate ability of in-slice reactive protocols to consume these measurements and react accordingly. At GEC10, the first of these (collecting performance data from Polatis using pS) capability has been completed. This leverages Spiral 3 goals of the ERM project team, who also form the Columbia U part of the IMF team. === Experiment View (Feb 2010) === [[Image(IMF_exp_view.png, 50%)]] [[BR]] === Architecture (as of July 2010) === [[Image(IMF_Arch.png, 50%)]] [[BR]] At the end of Spiral 2, we are ahead of our goals with respect to the main vision of the project, and have demonstrated real-time reactive use of optical substrate measurements to allow in-slice protocols to react by tuning optical substrate parameters. A detailed description is available in the GEC8 demo report. The diagram below shows the essentials of the demo setup. The IMF project uses the BEN facility for its physical realization. See the [wiki:ORCABEN#CurrentCapabilities ORCA/BEN project] . [[Image(GEC8_demo_nutshell.png)]] [[BR]] ==== Update (as of March, 2011) ==== In line with the Spiral 3 goals of IMF, the architecture has been modified to include a pS MP to mediate the measurement from the Polatis switches, utilizing the ERM project capability which creates pS functionality into the switch, as shown in the diagram below. The pS MP can continue to serve other pS clients, and the IMF client can use other mechanisms (such as that developed in Spiral 2) to obtain measurements, in addition to this. This is shown in the diagram below. The substrate control part is currently not shown, since this will require newer pS functionality to be available for integration. [[Image(pS_blowup.pdf, 30%)]] [[BR]] === Milestones === [[MilestoneDate(IMF: S2.a Initial architecture-)]] [[BR]] [[MilestoneDate(IMF: S2.b Initial ontology for measurement)]] [[BR]] [[MilestoneDate(IMF: S2.c First GENI instrumentation and measurement architecture)]] [[BR]] [[MilestoneDate(IMF: S2.d First component architecture)]] [[BR]] [[MilestoneDate(IMF: S2.e Initial IMF software)]] [[BR]] [[MilestoneDate(IMF: S2.f Integrate the IMF and UMF with BEN)]] [[BR]] [[MilestoneDate(IMF: S2.g Protocol between SILO and IMF)]] [[BR]] [[MilestoneDate(IMF: S2.h Update the IMF software)]] [[BR]] [[MilestoneDate(IMF: S2.i First release of IMF and SILO software)]] [[BR]] [[MilestoneDate(IMF: S2.j Contribution to GENI outreach plan)]] [[BR]] [[MilestoneDate(IMF: S3.a Demonstration at GEC9 and Experimenter Outreach)]] [[BR]] [[MilestoneDate(IMF: S3.b Documentation and Code Release)]] [[BR]] [[MilestoneDate(IMF: S3.c Demonstration at GEC10 and Experimenter Outreach)]] [[BR]] [[MilestoneDate(IMF: S3.d Documentation and Code Release)]] [[BR]] [[MilestoneDate(IMF: S3.e Demonstration at GEC11 and Experimenter Outreach)]] [[BR]] [[MilestoneDate(IMF: S3.f Documentation and code release)]] [[BR]] == Project Technical Documents == [http://groups.geni.net/geni/attachment/wiki/IMF/GEC6-ilia-imf-intro.pdf Presentation at GEC6 ][[BR]] [http://groups.geni.net/geni/attachment/wiki/IMF/GEC7_imf_cluster_d_meet.ppt Presentation at GEC7 Cluster D ][[BR]] [http://groups.geni.net/geni/attachment/wiki/IMF/GEC7_Measurment_Poster_v5.pdf Poster presented at GEC7 demo session][[BR]] [http://groups.geni.net/geni/attachment/wiki/IMF/GEC8_IMF_cluster_d_meet_w_backup.pptx Presentation at GEC8 Cluster D ][[BR]] [http://groups.geni.net/geni/attachment/wiki/IMF/GEC8_Poster_Demo_final_print.pdf Poster presented at GEC8 demo session][[BR]] [http://groups.geni.net/geni/attachment/wiki/IMF/GEC10_IMF-ERM_Demo-Poster.pdf Poster presented at GEC10 demo session][[BR]] [http://groups.geni.net/geni/attachment/wiki/IMF/geni-imf_s2_review.pptx Spiral 2 Review presentation][[BR]] [http://groups.geni.net/geni/attachment/wiki/IMF/GEC6-ilia-imf-intro.pdf Initial architectural view - Presentation at GEC6 (also attached to Milestone S2.a ticket) ][[BR]] [http://groups.geni.net/geni/attachment/wiki/IMF/IMF%20Architecture.pdf First component architecture (Updated) ][[BR]] [http://groups.geni.net/geni/attachment/wiki/IMF/IMF-SILO.pdf Early draft IMF-SILO interface ][[BR]] [http://groups.geni.net/geni/attachment/wiki/IMF/GEC8_demo_report.pdf Report describing GEC8 demo ][[BR]] [http://groups.geni.net/geni/attachment/wiki/IMF/GEC8_demo_report.pdf Report describing GEC8 demo ][[BR]] === Related Research Publications / Reports === [http://groups.geni.net/geni/attachment/wiki/IMF/1569237337.pdf "Architectural Support for Internet Evolution and Innovation"][[BR]] [http://groups.geni.net/geni/attachment/wiki/IMF/ants_silo.pdf "A Composition Algorithm for the SILO Cross-Layer Optimization Service Architecture"][[BR]] [http://groups.geni.net/geni/attachment/wiki/IMF/ICC-SILO-2007.pdf "The SILO Architecture for Services Integration, controL, and Optimization for the Future Internet"][[BR]] [http://groups.geni.net/geni/attachment/wiki/IMF/milcom2007%20final.pdf "ON THE SUITABILITY OF COMPOSABLE SERVICES FOR THE ASSURABLE FUTURE INTERNET"][[BR]] [http://groups.geni.net/geni/attachment/wiki/IMF/paper.pdf "A Unified Software Architecture to Enable Cross-Layer Design in the Future Internet"][[BR]] === Quarterly Status Reports === * [http://groups.geni.net/geni/attachment/wiki/IMF/IMF-QSR1Q10.pdf Status ending 1st Quarter, 2010 ][[BR]] * [http://groups.geni.net/geni/attachment/wiki/IMF/IMF-QSR2Q10.pdf Status ending 2nd Quarter, 2010 ][[BR]] * (Starting Spiral 3 switching to "after-GEC" reporting cycle)[[BR]] * After GEC9 - No report, contract renewal still in negotiation[[BR]] * [wiki:IMF-GEC10-QSR] * [wiki:IMF-GEC11-QSR] === Spiral 2 Connectivity === See the [wiki:ORCABEN#Spiral2Connectivity ORCA/BEN project] === Related Projects === [wiki:ORCABEN ORCA/BEN project] and [wiki:ORCAAUG ORCA Augmentation][[BR]] [http://www.net-silos.net/ The SILO Project][[BR]] [https://ben.renci.org/ BEN: Breakable Experimental Network][[BR]] [http://www.cs.duke.edu/nicl/ New Internet Computing Lab (NICL)][[BR]] [http://nicl.cod.cs.duke.edu/orca/ Open Resource Control Architecture (ORCA)][[BR]] [http://www.cs.duke.edu/nicl/cereus/shirako.html Shirako][[BR]] [http://groups.geni.net/geni/wiki/Embedded%20Real-Time%20Measurements Embedded Real-Time Measurements][[BR]] [http://groups.geni.net/geni/wiki/LEARN LEARN: Programmable Measurements over Texas-based Research Network][[BR]]