wiki:IMF

Version 27 (modified by Ilia Baldine, 14 years ago) (diff)

--

Project Number

1718

Project Title

GENI IMF: Integrated Measurement Framework and Tools for Cross Layer Experimentation
a.k.a. IMF

Technical Contacts

PI: Rudra Dutta Department Of Computer Science North Carolina State University Rudra Dutta http://www.csc.ncsu.edu/directories/faculty_info.php?id=1665
Co-PI: George Rouskas Department of Computer Science North Carolina State University rouskas@ncsu.edu http://www.csc.ncsu.edu/directories/faculty_info.php?id=241
Subcontractor: Ilia Baldine Renaissance Computing Institute (RENCI) Ilia Baldine
Subcontractor: Keren Bergman Department of Electrical Eng. Columbia University bergman@ee.columbia.edu http://www.ee.columbia.edu/fac-bios/bergman/faculty.html

Participating Organizations

NCSU, CS Dept
Columbia University, EE Dept
Renaissance Computing Insititute (RENCI), Chapel Hill, NC
BEN: Breakable Experimental Network
New Internet Computing Lab (NICL)
Open Resource Control Architecture (ORCA)
Shirako

GPO Liaison System Engineer

Harry Mussman hmussman@geni.net

Scope

This project will develop and integrate the GENI Integrated Measurement Framework (IMF) for optical communication substrates into the ORCA control framework prototype, and integrate the FIND SILO framework into the ORCA control framework prototype, and IMF and SILO with each other, to enable cross-layer experimentation involving the physical layer of an optical network.

This will enable (a) measurements from an optical substrate to be passed to a measurement consumer inside a slice; this is a valuable capability since the optical substrate characteristics may be important to the experimenter in the slice although the substrate itself is not directly observable by the experimenter, and (b) enable the automated (in-stack) consumption of measurement data; this is important for an experimenter who does not merely want to see the optical substrate measurement data after the experiment, but would like to experiment with reactive protocols designed to run inside the stack and react in real-time to measurements.


Initial deployment will be in the Breakable Experimental Network (BEN), a regional optical network located in North Carolina.

The IMF will utilize deliverables from the Embedded Real-time Measurements (ERM) project, including its Unified Measurements Framework (UMF).

The IMF will provide a single point of access to various devices in the optical substrate. The IMF will include a software module that interfaces with the UMF to gather measurements from the optical substrate, and that communicates with SILO (and other software modules) over a specified communication protocol, also to be developed in this project.

The interface between the IMF and the optical devices in BEN will be leveraged from the UMF of the ERM project. The IMF will gather measurements from devices with performance monitoring capabilities already incorporated into the BEN, including: the Infinera DTN, a remotely configurable optical add/drop multiplexer (ROADM); and the Polatis 24 port fiber switch. This will be guided by the output of the Data Plane Measurements project, that identified measurement capabilities in a wide range of equipment. In addition, the use of programmable measurement nodes and performance monitors will be assessed.

The Services Integration, controL and Optimization (SILO) framework was previously developed and prototyped in the NSF Future Internet Design (FIND) project. It will be extended to provide the tools for the experimenter to enable cross-layer experimentation. New SILO services will be developed to interface with the IMF and to introduce optical substrate measurement capability into custom protocol stacks.

Both the IMF and SILO will be integrated with ORCA, so that they can be assigned to the slice of a researcher, who can then configure and run them to conduct an experiment. This project will collaborate with the ORCA Augmentation project on an ontology for measurement capabilities.

This project will collaborate with other GENI projects on the development of a common GENI instrumentation and measurement architecture.

Current Capabilities

The overall architecture of the project has been articulated. The first diagram below shows the experimenter view of the proposed system; realization of this is part of our Year 2 goals. The second diagram below shows the component systems interaction architecture.

January 2011 update: Upon consultation with GPO, the priorities of the project have been revised a little. Year 2 (Spiral 3) goals now focus on integrating the developed IMF capabilities for measurement, and transfer of measurement (from substrate to in-slice stack), with existing GENI Inst&Meas capabilities; specifically, to integrate and install perfSONAR (pS) MPs and archives to collect performance measurement data from Polatis switches and Infinera DWDM platforms on 4 BEN sites, and (subsequently) integrate pS MP polling into IMF to demonstrate ability of in-slice reactive protocols to consume these measurements and react accordingly. At GEC10, the first of these (collecting performance data from Polatis using pS) capability has been completed. This leverages Spiral 3 goals of the ERM project team, who also form the Columbia U part of the IMF team.

Experiment View (Feb 2010)


Architecture (as of July 2010)


At the end of Spiral 2, we are ahead of our goals with respect to the main vision of the project, and have demonstrated real-time reactive use of optical substrate measurements to allow in-slice protocols to react by tuning optical substrate parameters. A detailed description is available in the GEC8 demo report. The diagram below shows the essentials of the demo setup.

The IMF project uses the BEN facility for its physical realization. See the ORCA/BEN project .

Nutshell view of demo at GEC8

Update (as of March, 2011)

In line with the Spiral 3 goals of IMF, the architecture has been modified to include a pS MP to mediate the measurement from the Polatis switches, utilizing the ERM project capability which creates pS functionality into the switch, as shown in the diagram below. The pS MP can continue to serve other pS clients, and the IMF client can use other mechanisms (such as that developed in Spiral 2) to obtain measurements, in addition to this. This is shown in the diagram below. The substrate control part is currently not shown, since this will require newer pS functionality to be available for integration.


Milestones

MilestoneDate(IMF: S2.a Initial architecture-)?
MilestoneDate(IMF: S2.b Initial ontology for measurement)?
MilestoneDate(IMF: S2.c First GENI instrumentation and measurement architecture)?
MilestoneDate(IMF: S2.d First component architecture)?
MilestoneDate(IMF: S2.e Initial IMF software)?
MilestoneDate(IMF: S2.f Integrate the IMF and UMF with BEN)?
MilestoneDate(IMF: S2.g Protocol between SILO and IMF)?
MilestoneDate(IMF: S2.h Update the IMF software)?
MilestoneDate(IMF: S2.i First release of IMF and SILO software)?
MilestoneDate(IMF: S2.j Contribution to GENI outreach plan)?

MilestoneDate(IMF: S3.a Demonstration at GEC9 and Experimenter Outreach)?
MilestoneDate(IMF: S3.b Documentation and Code Release)?
MilestoneDate(IMF: S3.c Demonstration at GEC10 and Experimenter Outreach)?
MilestoneDate(IMF: S3.d Documentation and Code Release)?
MilestoneDate(IMF: S3.e Demonstration at GEC11 and Experimenter Outreach)?
MilestoneDate(IMF: S3.f Documentation and code release)?

Project Technical Documents

Presentation at GEC6
Presentation at GEC7 Cluster D
Poster presented at GEC7 demo session
Presentation at GEC8 Cluster D
Poster presented at GEC8 demo session
Poster presented at GEC10 demo session

Spiral 2 Review presentation

Initial architectural view - Presentation at GEC6 (also attached to Milestone S2.a ticket)
First component architecture (Updated)
Early draft IMF-SILO interface
Report describing GEC8 demo

Report describing GEC8 demo

Related Research Publications / Reports

Architectural Support for Internet Evolution and Innovation
A Composition Algorithm for the SILO Cross-Layer Optimization Service Architecture
The SILO Architecture for Services Integration, controL, and Optimization for the Future Internet
ON THE SUITABILITY OF COMPOSABLE SERVICES FOR THE ASSURABLE FUTURE INTERNET
A Unified Software Architecture to Enable Cross-Layer Design in the Future Internet

Quarterly Status Reports

Status ending 1st Quarter, 2010
Status ending 2nd Quarter, 2010
(Starting Spiral 3 switching to "after-GEC" reporting cycle)
After GEC9 - No report, contract renewal still in negotiation

Spiral 2 Connectivity

See the ORCA/BEN project

Related Projects

ORCA/BEN project and ORCA Augmentation
The SILO Project
BEN: Breakable Experimental Network
New Internet Computing Lab (NICL)
Open Resource Control Architecture (ORCA)
Shirako
Embedded Real-Time Measurements
LEARN: Programmable Measurements over Texas-based Research Network

Attachments (35)