wiki:OnTime-Nov10

Version 1 (modified by Prasad Calyam, 13 years ago) (diff)

--

OnTimeMeasure: Centralized and Distributed Measurement Orchestration Software

Quarterly Status Report Document for Global Environment for Network Innovations (GENI) Spiral 2 Project # 1764

Prasad Calyam (PI) and Paul Schopis (Co-PI)

Ohio Supercomputer Center/OARnet, The Ohio State University

November 2010


I. Major accomplishments

A. Milestones achieved

In our fourth quarter in the GENI Spiral 2 as well as, in our early first quarter in the GENI Spiral 3, we have made significant progress towards our milestones [1]. A summary of our accomplishments is as follows:

  • We successfully completed our Spiral 2’s sixth (OnTime: S2.f: Report on experiences with implementing and using OnTimeMeasure on ProtoGENI) [2] and seventh (OnTime: S2.g: Validation and refinements to OnTimeMeasure-GENI service) milestones as planned [3].
  • We successfully completed our Sprial 3’s first milestone (OnTime: S3.a: Demonstrate OnTimeMeasure with ProtoGENI and PlanetLab sites) as planned.
  • To date, we have 12 users from 10 projects registered in the OnTimeMeasure researcher web-portal. We have integrated OnTimeMeasure with 4 GENI projects: ProtoGENI [3], PlanetLab [4], InsTools [5] and CRON [6]. We are working towards integrating OnTimeMeasure with experimenter tools such as GUSH.
  • We have also made progress towards the GPO requirement to collaborate with related GENI measurement and security projects on a common GENI instrumentation and measurement architecture [7].

B. Deliverables made

  • Released the OnTimeMeasure v1.0 software along with a tutorial slides and videos, source code tar files with documentation and installation instructions in the “Current Capabilities” section of the project wiki.
  • Presented a tutorial in 3rd GENI I&M Workshop at GEC9 describing how to use OnTimeMeasure software within the GENI facility.
  • Demonstrated OnTimeMeasure software integration with the CRON 10Gbps testbed at GEC9 sessions (Demo Reception, COMIS Working Group).
  • Demonstrated OnTimeMeasure integration with ProtoGENI and PlanetLab sites.
  • Published a set of measurement service use-cases as part of the GENI Instrumentation and Measurement Architecture (GIMA) document being developed in the GENI I&M Working Group.
  • In collaboration with other GENI projects such as S3, Digital Object Repository and Kansie-Genie, we developed a design document for an integrated GENI I&M system that complies with GIMA; the design document has been submitted to the GPO.
  • Hired Alex Berryman, undergraduate student at The Ohio State University as the GENI related NSF REU Student who will be engaged in the R&D activities of OnTimeMeasure.
  • Published quarterly status report document on the GENI project website.

II. Description of work performed during last quarter

A. Activities and findings

Details of our activities and findings during Q3 and early Q4 2010 are as follows:

i. OnTimeMeasure v1.0 Software Release:

We successfully completed our Spiral 2’s sixth (OnTime: S2.f: Report on experiences with implementing and using OnTimeMeasure on ProtoGENI) and seventh (OnTime: S2.g: Validation and refinements to OnTimeMeasure-GENI service) milestones as planned. Our implementation of the OnTimeMeasure software closely follows our high-level design [1].

OnTimeMeasure measurement service is now available to users of ProtoGENI/Emulab and PlanetLab aggregates. Users can submit measurement requests, control the measurement service, and query measurement data within ProtoGENI and PlanetLab slices spanning geographically distributed sites within the GENI facility.

OnTimeMeasure has also been integrated with other GENI projects: InsTools and CRON

To start using OnTimeMeasure, users can register and follow instructions presented at the researcher web-portal - http://ontime.oar.net

For details, users can refer to - Tutorial Slides and Tutorial Videos [1]; Wikis with Install Instructions: OnTimeMeasure-ProtoGENI [3], OnTimeMeasure-PlanetLab [4], OnTimeMeasure-InsTools [5], OnTimeMeasure-CRON [6].

We have released the software along with relevant “getting started” information to several early experimenters in GENI:

  • GENI Project Office
  • CRON 10Gbps Testbed, Louisiana State University
  • GMOC, Indiana University
  • Instrumentation Tools, University of Kentucky
  • Kansei-Genie, The Ohio State University
  • Virtual Desktop Cloud Experiment, The Ohio State University
  • Experiments Security Analysis, University of Alabama
  • Digital Object Registry, CNRI
  • Davis Social Links, University of California, Davis
  • S3, Purdue University, HP Labs
  • PEIBAIRA, Rochester Institute of Technology

All the above early experimenters have agreed to evaluate our software and provide feedback. In fact, many have already registered, evaluated the features and provided feedback to improve the documentation, installation procedures and usability.

We also have released a beta version of our command-line tool (OnTime Control) that uses XML-RPC messages to perform all the measurement service functions between client-and-server currently being done interactively with researcher web-portal (http://ontime.oar.net). This tool provides capability for integration with experiment workflow tools such as GUSH. We are currently working on the design to integrate OnTime Control into GUSH as part of our third milestone in Spiral 3 due in January 2011.

To help early experimenters, we presented a OnTimeMeasure software tutorial at the 3rd GENI I&M Workshop, GEC9 describing how to register and use the various software features.

Further, to help early experimenters setup slices using the ProtoGENI control framework, we published a report on our experiences with the various ProtoGENI slice creation GUIs (i.e., Flash Client, Java Client) to create slices within a cluster and across geographically-distributed clusters.

ii. GENI instrumentation and measurement architecture discussions:

We have also made progress towards the GPO requirement to collaborate with related GENI measurement and security projects on a common GENI instrumentation and measurement architecture. We published a set of measurement service use-cases as part of the GENI Instrumentation and Measurement Architecture (GIMA) document being developed in the GENI I&M Working Group. Also, we are contributing towards sections on GENI I&M interfaces and protocols (APIs): (a) data flows and data file transfers, and (b) service registration and discovery. Further, in collaboration with other GENI projects such as S3, Digital Object Repository and Kansie-Genie, we developed a design document for an integrated GENI I&M system that complies with GIMA; the design document has been submitted to the GPO.

iii. Service activities relevant to the GENI community:

Prasad Calyam, PI and Paul Schopis, Co-PI have also been involved in various service activities in the GENI community. Specifically, Prasad served as a committee member of the “The Quilt GENI Workshop” at GEC8. The workshop goal was to: Engage and educate the community stakeholders that are not already involved in GENI by providing relevant projects information, best practices and lessons learned from campus deployments.

Prasad and Paul are moderating conference calls, and are leading an effort with participants from The Ohio State University (OSU), OARnet, MERIT, NLR, StarLight, RENCI, and Wayne State University (WSU) to establish L2/L3 connectivity between the Kansei-GENI testbed at OSU, Neteye-GENI testbed at WSU and the ORCA clearing house at RENCI. Prasad, Jay from OSU (Campus Network Engineer) and Wenjie from OSU (Researcher) presented about the experiences from this campus deployment case study at the Quilt GENI Workshop collocated with GEC8.

Prasad is advising Rohit Patali, Graduate Student at OSU Computer Science and Engg. Department, who is working on a GENI experiment funded by NSF titled - “Thin Client Performance Benchmarking Based Resource Adaptations in Virtual Desktop Clouds”. The goal of the experiment is to validate virtual desktop cloud related laboratory investigations under real system loads, and at the same time evaluate the capabilities of multiple kinds of GENI resources.

Prasad is mentoring Alex Berryman, undergraduate student at The Ohio State University as the GENI related NSF REU Student who will be engaged in the R&D activities of OnTimeMeasure.

B. Project participants

The following participants have helped in the execution of the project activities described in this status report:

  • Prasad Calyam (PI) – Ohio Supercomputer Center/OARnet
  • Paul Schopis (Co-PI) – OARnet
  • Kunpeng (Tony) Zhu (Graduate Student Programmer) – Ohio Supercomputer Center
  • Rohit Patali (Graduate Research Associate) – OARnet
  • Alex Berryman (REU Student) – OARnet

C. Publications (individual and organizational)

OnTimeMeasure project is mentioned in OSC’s Annual Research Report - http://www.osc.edu/research/report10/ResearchLandscape/NetworkHealthStatus.shtml

D. Outreach activities

  • P. Calyam, “OnTimeMeasure Tutorial for Early Experimenters”, Presentation at the 3rd GENI I&M Workshop, GEC9, November 2010.
  • S-J. Park, P. Calyam, “Federating CRON with OnTimeMeasure”, Presentation at the COMIS Working Group, GEC9, November 2010.
  • P. Calyam, “OnTimeMeasure: Centralized and Distributed Measurement Orchestration Software”, Status Report at Cluster C Breakout Session at GEC9, November 2010.
  • P. Calyam, “OnTimeMeasure Spiral 2 Project Review”, Presentation at the GENI I&M-2 Project Reviews Call, August 2010.

E. Collaborations

We have been collaborating with several GENI project teams: ProtoGENI, GMOC, Instrumentation Tools, S3, Digital Object Repository, Kansei-Genie, CRON, Data Plane Measurements, and GUSH. We are also attending Cluster C conference calls regularly.

F. Other Contributions

None.


Acknowledgements

We would like to acknowledge the following individuals for participating in our project discussions and providing useful suggestions:

  • Thomas Bitterman – Ohio Supercomputer Center
  • Robert Ricci – University of Utah
  • Chris Small – Indiana University
  • Hussamuddin Nasir, James Griffioen – University of Kentucky
  • Anish Arora, Rajiv Ramnath, Mukundan Sridharan – The Ohio State University
  • Sonia Fahmy - Purdue University
  • Puneet Sharma – HP Labs
  • Larry Lannom, Giridhar Manepalli, Jim French - CNRI

References

[1] OnTimeMeasure-GENI Project Wiki – http://groups.geni.net/geni/wiki/OnTimeMeasure

[2] P. Calyam, K. Zhu, “OnTimeMeasure Project Experiences with using ProtoGENI in Spiral 2”, August 2010. http://groups.geni.net/geni/wiki/ExperienceWithProtoGENI

[3] P. Calyam, K. Zhu, “OnTimeMeasure Installation Procedure on ProtoGENI”, July 2010. http://groups.geni.net/geni/wiki/OnTime-Install

[4] P. Calyam, R. Patali, K. Zhu, “OnTimeMeasure Installation Procedure on PlanetLab”, August 2010. http://groups.geni.net/geni/wiki/OTM-PlanetLabInstall

[5] P. Calyam, R. Patali, “OnTimeMeasure Early Integration Efforts with Instrumentation Tools”, August 2010. http://groups.geni.net/geni/wiki/OTM-InsToolsDemo

[6] P. Calyam, K. Zhu, “OnTimeMeasure Early Integration Efforts with CRON 10Gbps Testbed”, November 2010. http://groups.geni.net/geni/wiki/OTM-CRONInstall

[7] P. Calyam, “Use-cases for GENI Instrumentation and Measurement Architecture Design”, June 2010. http://groups.geni.net/geni/wiki/2ndInstMeasWork#Topic1GENIIMUseCases

This material is based upon work supported by the National Science Foundation under Grant No. CNS-0940805. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of BBN Technologies, Corp., the GENI Project Office, or the National Science Foundation.