Version 4 (modified by Prasad Calyam, 13 years ago) (diff)


OnTimeMeasure: Centralized and Distributed Measurement Orchestration Software

Quarterly Status Report Document for Global Environment for Network Innovations (GENI) Project # 1764

Prasad Calyam (PI) and Paul Schopis (Co-PI)

Ohio Supercomputer Center/OARnet, The Ohio State University

Update Period: August 2011 - November 2011

I. Major accomplishments

A. Milestones achieved

In the project period between August 2011 - November 2011, we have made significant progress towards our milestones [1]. A summary of our accomplishments is as follows:

  • We successfully completed the latest Spiral 3 milestones as planned: OnTime: S3.e Demonstrate the use of OnTimeMeasure within a GENI experiment that utilizes multiple GENI tools/services; OnTime: S3.f Release a software version of OnTimeMeasure that is integrated with other GENI software tools/services.
  • To date, we have 42 users from 17 GENI-related projects registered in the OnTimeMeasure researcher web-portal to try out the software. We have integrated OnTimeMeasure with 6 GENI projects: ProtoGENI [3], PlanetLab [4], InsTools [5], CRON [6] Gush [7], and DOR [8].
  • We have also made progress towards the GPO requirement to collaborate with related GENI measurement and security projects on a common GENI instrumentation and measurement architecture.

B. Deliverables made

  • Released updated OnTimeMeasure software along with tutorial slides and videos, source code tar files with documentation and installation instructions in the “Current Capabilities” section of the project wiki.
  • Developed capability to customize OnTimeMeasure for an NSF-funded GENI experiment titled "Emulating Cloud Dynamics for performance sensitive applications" led by Purdue University. Previously, we had integrated OnTimeMeasure with the NSF-funded experiment titled "Resource allocation in virtual desktop clouds" led by The Ohio State University. See -Paper on OnTimeMeasure Integration in Virtual Desktop Cloud GENI Experiment. Based on these two customization experiences, we have developed a "Custom Metric Integration" capability in OnTimeMeasure that allows easy integration for other experiments and GENI services Wiki on OnTimeMeasure Custom Metric Integration
  • Presented a status update of OnTimeMeasure software at GEC12. More specifically, we demonstrated OnTimeMeasure custom metric integration capability at GEC12 poster session. See- OnTimeMeasure GEC12 Poster. We also presented our OnTimeMeasure development and deployment plans for Spiral 4 at the GEC12 I&M Working Session. See - Update Talk Slides. Further, we actively participated in the GENI Instrumentation and Measurement Architecture (GIMA) document discussions at the GEC12 I&M Working Session. We volunteered to work on the "I&M Use Cases for Experiments, and Support for Experimenters" and "Messaging Service" discussions in GENI.
  • Published quarterly status report document on the GENI project website.

II. Description of work performed during last quarter

A. Activities and findings

i. OnTimeMeasure v1.0 Software Release:

We completed the prototype development of a "custom metric integration" feature in OnTimeMeasure that allows Experimenters to add their custom measurement metrics into the measurement service. The motivation for this feature is that the Experimenters not only want to use off-the-shelf tools (e.g., Ping, Netflow) within measurement services in GENI, but also other tools they have developed or others have developed that are relevant to their experiment. Details of our prototype development can be found at - Wiki on OnTimeMeasure Custom Metric Integration. We found that Amazon CloudWatch also has a similar capability for its users. For details, see - Amazon CloudWatch Custom Metric Integration

ii. Procedures/mechanisms for measurements of GENI backbone and access networks:

We are working towards implementing infrastructure measurement slices in GENI backbone and access networks. We have started to create experiment slices with the LAMP/perfSONAR software, and are working through some installation and configuration problems. The LAMP project team is promptly helping us with our questions and has been sending updated software when we report bugs.

We are also building upon the "Reference Slice" experiences with LAMP/perfSONAR software of Ali Sydney and Harry Mussman over the last few months. In the coming months, we plan to also experiment with creating measurement slices as part of OpenFlow network monitoring, and are looking to use Tango GENI as a testbed for these experiments.

iii. Service activities relevant to the GENI community:

Prasad is advising Aishwarya Venkataraman, Graduate Student at OSU Computer Science and Engg. Department, who is working on a GENI experiment funded by NSF titled - “Thin Client Performance Benchmarking Based Resource Adaptations in Virtual Desktop Clouds”. The goal of the experiment is to validate virtual desktop cloud related laboratory investigations under real system loads, and at the same time evaluate the capabilities of multiple kinds of GENI resources. Paper on OnTimeMeasure Integration in Virtual Desktop Cloud GENI Experiment has been accepted for publication in the Journal of Communications and Networks' special issue on "Management Issues in the Future Internet".

B. Project participants

The following participants have helped in the execution of the project activities described in this status report:

  • Prasad Calyam (PI) – Ohio Supercomputer Center/OARnet
  • Paul Schopis (Co-PI) – OARnet
  • Alex Berryman (Student Research Assistant) – OARnet
  • Yingxiao Xu (PostDoctoral Fellow) - Ohio Supercomputer Center

C. Publications (individual and organizational)

OnTimeMeasure GEC12 Poster
GEC12 I&M Working Session Talk
JCN Paper on OnTimeMeasure Integration in Virtual Desktop Cloud GENI Experiment

D. Outreach activities

  • P. Calyam, “OnTimeMeasure Status Update”, GEC12 I&M Working Session, November 2011.
  • P. Calyam, “OSU Experiment Feedback to GENI Developers”, ProtoGENI Cluster Call, September 2011.

E. Collaborations

We have been collaborating with several GENI project teams: ProtoGENI, LAMP, Instrumentation Tools, S3, Digital Object Repository, and VMI-FED. We are also attending Cluster C conference calls regularly.

F. Other Contributions



[1] OnTimeMeasure-GENI Project Wiki –

[2] P. Calyam, K. Zhu, “OnTimeMeasure Project Experiences with using ProtoGENI in Spiral 2”, August 2010.

[3] P. Calyam, K. Zhu, “OnTimeMeasure Installation Procedure on ProtoGENI”, July 2010.

[4] P. Calyam, R. Patali, K. Zhu, “OnTimeMeasure Installation Procedure on PlanetLab”, August 2010.

[5] P. Calyam, R. Patali, “OnTimeMeasure Integration Efforts with Instrumentation Tools”, August 2010.

[6] P. Calyam, K. Zhu, “OnTimeMeasure Installation Procedure on CRON 10Gbps Testbed”, November 2010.

[7] P. Calyam, A. Berryman, K. Zhu, “OnTimeMeasure Integration Efforts with Gush Experimenter Workflow Tool”, January 2011.

[8] P. Calyam, Y. Zhu, “OnTimeMeasure Integration Efforts with Digital Object Repository”, June 2011.

This material is based upon work supported by the National Science Foundation under Grant No. CNS-0940805. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of BBN Technologies, Corp., the GENI Project Office, or the National Science Foundation.