[[PageOutline]] == Project Number == 1631 == Project Title == Project Title: Embedding real-time substrate measurements for cross-layer communications[[BR]] a.k.a. Programmable Optical Metrics Interface (obsolete)[[BR]] a.k.a. Embedded real-time measurements [[BR]] a.k.a. ERM === Technical Contacts === Principal Investigator: Keren Bergman bergman@ee.columbia.edu http://www.ee.columbia.edu/fac-bios/bergman/faculty.html[[BR]] Student Developer: Caroline Lai caroline@ee.columbia.edu [[BR]] Student Developer: Michael Wang msw2138@columbia.edu [[BR]] Former Postdoctoral Fellow: Dr. Franz Fidler ffidler@ee.columbia.edu [[BR]] [[Image(Prof Bergmans pick IMG_0831_medium.JPG, 45%)]] Back row: Howard Wang, *Prof. Keren Bergman (PI), *Dr. Franz Fidler, Gilbert Hendry, Prof. Gil Zussman, Dan Brunina, *Michael Wang, Noam Ophir[[BR]] Front row: *Caroline Lai, Ajay Garg [[BR]] *Main researchers on project === Participating Organizations === Columbia University - New York City[[BR]] Bell Labs Alcatel-Lucent [[BR]] === GPO Liaison System Engineer === Vic Thomas == Scope == Ensure GENI includes the technology to support cross-layer communications, specifically, the ability to incorporate a diverse set of real-time measurements in networking protocols. The project addresses the GENI challenge of architectural experimentations across diverse heterogeneous technologies by supporting real-time cross-layer communications and measurements. Our objective is to develop networking capabilities within the GENI infrastructure that enable deeper exposure of cross-layer information and user access to real-time measurements. === Current Capabilities === By the end of year 1, we assessed and proposed the required measurement framework. [[BR]] For year 2: we plan to develop the hardware and software prototype using a NetFPGA and integrate the subsystem within Cluster D. [[BR]] === Milestones === [[MilestoneDate(ERM: GENI requirements for real-time measurements)]] [[BR]] [[MilestoneDate(ERM: Develop specifications and networking protocols)]] [[BR]] [[MilestoneDate(ERM: Perform discrete-event network simulations)]] [[BR]] [[MilestoneDate(ERM: Develop a software architecture)]] [[BR]] [[MilestoneDate(ERM: Support the GPO in developing an experimental use-case)]] [[BR]] [[MilestoneDate(ERM: identify a candidate control framework)]] [[BR]] [[MilestoneDate(KANSEI: S2.a Remote access)]] [[BR]] [[MilestoneDate(KANSEI: S2.b Cluster plan for VLANs between testbeds)]] [[BR]] [[MilestoneDate(KANSEI: S2.c Extend researcher portal to support workflow management)]] [[BR]] [[MilestoneDate(KANSEI: S2.d Extend researcher portal for use with Kansei and Neteye)]] [[BR]] [[MilestoneDate(KANSEI: S2.e Bring up NetEye testbed at WSU)]] [[BR]] [[MilestoneDate(KANSEI: S2.f Connections from Kansei and NetEye to Internet2)]] [[BR]] [[MilestoneDate(KANSEI: S2.g Import extended ORCA v2.1)]] [[BR]] [[MilestoneDate(KANSEI: S2.h Demo experiment using Kansei and NetEye)]] [[BR]] [[MilestoneDate(KANSEI: S2.i Collaborate with GMOC)]] [[BR]] [[MilestoneDate(KANSEI: S2.j POC to GENI response team)]] [[BR]] [[MilestoneDate(KANSEI: S2.k POC to GENI security team)]] [[BR]] [[MilestoneDate(KANSEI: S2.l Contribution to GENI outreach)]] [[BR]] == Project Technical Documents == ''[http://groups.geni.net/geni/attachment/wiki/Embedded%20Real-Time%20Measurements/GENI_MS1_ERM_March09_v1-1.pdf Technical Note MS1]'' The capabilities of GENI's (future) infrastructure with respect to real-time measurements are evaluated and we assess the GENI requirements for real-time user access to measurement data across a diverse set of technologies.[[BR]] ''[http://groups.geni.net/geni/attachment/wiki/Embedded%20Real-Time%20Measurements/GENI_MS2_ERM_March09_v1-0.pdf Technical Note MS2]'' A set of specifications for enabling real-time measurements within the substrate and specifications for networking protocols based on the GENI requirements for real-time user-accessed cross-layer measurements is developed. We identify a set of specifications for the implementation of a unified, integrated measurement framework with the ultimate purpose of limiting the hardware and software overhead and complexity associated with accessing measurement data.[[BR]] ''[http://groups.geni.net/geni/attachment/wiki/Embedded%20Real-Time%20Measurements/GENI_MS3_ERM_March09_v1-0.pdf Technical Note MS3]'' To enable and perform discrete-event network simulations and quantitatively evaluate performance impact under several scenarios of cross-layer information exchange based on real-time measurements we developed new simulation modules for the ns-2 open source network modeling environment and make them available to the GENI community at: ''[http://lightwave.ee.columbia.edu/?s=research&p=ns2 ERM software module repository]'' ''(Columbia University New York, Alcatel-Lucent Bell Labs)'' [[BR]] ''[http://groups.geni.net/geni/attachment/wiki/Embedded%20Real-Time%20Measurements/GENI_MS4_ERM_June09_v1-0.pdf Technical Note MS4]'' This milestone deals with the development of a measurement framework based on GENI real-time measurement requirements and other developments/resources within the GENI prototyping activities. Interacting with other prototype efforts, we identify and leverage relevant activities, software architectures, protocols, and products. This work deals with a number of software architectures dedicated to network measurements which could serve as an interface between a unified measurement framework (UMF), the control framework, and the GENI experimenter. We assess several network management protocols and data exchange formats with respect to their ability of exchanging measurement and control information between the substrate's performance monitors and the UMF, as well as between the UMF and the GENI control frameworks. [[BR]] ''[http://groups.geni.net/geni/attachment/wiki/Embedded%20Real-Time%20Measurements/GENI_MS5_ERM_Sept09_v1-0.pdf Technical Note MS5]'' The release of this milestone document was postponed until after the proceedings of the European Conference on Optical Communication were published (end of September 2009). Support GPO in developing an experimental use-case (completed 09/01/2009) The goal of this milestone was to support the GPO in developing experimental designs for usecases based on our work on a measurement-driven cross-layer communication system. Building on the successful simulation work with the modules developed in [erm09_1], we validate our cross-layer communication schemes in developing an experimental use-case based on proactive packet protection. We show network simulations, as well as an experimental demonstration, of our packet protection scheme. Additional information, as well as a technical note, on milestone 5 is available online [erm09_1], [erm09_2]. [[BR]] ''[http://groups.geni.net/geni/attachment/wiki/Embedded%20Real-Time%20Measurements/GENI_MS6_ERM_Sept09_v1-0.pdf Technical Note MS6]'' We have evaluated various control frameworks to assess the feasibility of joining a GENI cluster and integrating our work on real-time measurements within one of these clusters. In this milestone, we discuss this endeavor and our recent decision to join the Cluster D ORCA team. [[BR]] === Quarterly Status Reports === ''[http://groups.geni.net/geni/attachment/wiki/Embedded%20Real-Time%20Measurements/GENI_QR_ERM_Dec08.pdf Quarterly Status Report 4Q08]'' [[BR]] ''[http://groups.geni.net/geni/attachment/wiki/Embedded%20Real-Time%20Measurements/GENI_QR_ERM_Apr09_v3-2.doc Quarterly Status Report 1Q09]'' [[BR]] ''[http://groups.geni.net/geni/attachment/wiki/Embedded%20Real-Time%20Measurements/GENI_QR_ERM_Jul09.pdf Quarterly Status Report 2Q09]'' [[BR]] ''[http://groups.geni.net/geni/attachment/wiki/Embedded%20Real-Time%20Measurements/GENI_QR_ERM_Oct09.pdf Quarterly Status Report 3Q09]'' === Presentations === ''[http://groups.geni.net/geni/attachment/wiki/Embedded%20Real-Time%20Measurements/GEC3_Columbia_ERM.pdf K. Bergman, "Embedding Real-Time Substrate Measurements for Cross-Layer Communications", 3rd GENI Engineering Conference, Stanford, CA, 2008.]'' [[BR]] ''[http://groups.geni.net/geni/attachment/wiki/Embedded%20Real-Time%20Measurements/GEC4_Columbia_ERM.pdf F. Fidler, "Unified Measurements", 4th GENI Engineering Conference, Miami, FL, 2009.]''[[BR]] ''[http://groups.geni.net/geni/attachment/wiki/Embedded%20Real-Time%20Measurements/ColumbiaUniversity_WorkshopMadison_ERM_UMF.pdf F. Fidler, "Unified Measurement Framework", 1st GENI Measurement Workshop, Madison, WI, 2009.]'' === Spiral 1 Connectivity === There is no connectivity requirment for year-1 in this project === Participating Projects === Columbia University - New York City[[BR]]