= S3MONITOR Project Status Report = Period: Second quarter 2010 Title: Scalable, Extensible, and Safe Monitoring of GENI Clusters Authors: Sonia Fahmy, Purdue University and Puneet Sharma, HP Labs == I. Major accomplishments == === A. Milestones achieved === We have extended our implementation over the version demonstrated at the seventh GENI Engineering Conference (GEC 7). The new version 0.2 includes the Sensing Information Manager that allows researchers to invoke on-demand and periodic measurements. It also supports archiving the collected measurements in a database. We are also collaborating with other GENI measurement projects on the GENI I&M specification document as discussed below. === B. Deliverables made === - We are finalizing version 0.2 of the system. We have registered for a demo and poster to present the system at GEC 8. - We are collaborating with several researchers on the GENI I&M specification document. This will be discussed at GEC 8. Sonia Fahmy is leading the team writing the GENI I&M interfaces and protocols (APIs) for service management, working with Vic Thomas (BBN/GPO), Ivan Seskar (Rutgers WINLAB), Max Ott (NICTA), and Giridhar Manepalli (CNRI). Puneet Sharma is collaborating with Jeremy Reed from U. Kentucky and Guilherme Fernandes from U. Delaware on the section on GUIs. - During the GENI measurement workshop on June 8-9, 2010, Sonia Fahmy and Puneet Sharma discussed the project extensively with researchers working on other measurement projects especially the teams from OSU, CNRI, and U Kentucky. == II. Description of work performed during last quarter == === A. Activities and findings === We have continued to extend the sensor pod implementation for the ProtoGENI platform, and made several changes to adapt to ProtoGENI upgrades. We are also implementing the sensing information manager. The sensor pod is a web-service-enabled collection of light-weight measurement and monitoring sensors that collect information at a machine. This information spans network properties such as connectivity to the Internet, latency to some other machine in the system, and bandwidth to another machine. The sensors gather information actively (e.g., send some packets on a network link to detect available bandwidth) and possibly passively. Sensor pods are being implemented as cgi scripts accessible through any web-server that supports cgi. To enable large-scale concurrent measurements, we had to modify some of the measurement tools. We leverage the web-services-based sensing pod architecture to deploy various sensors measuring different metrics and also to configure measurements. We currently support ping, traceroute, pathrate, tulip and spruce. The sensing information manager is a data aggregation and management middleware that collects measurement data from the individual sensor pods on physical machines in the system, and provides a programmable substrate for application services to aggregate the data in an efficient and scalable manner. === B. Project participants === Sonia Fahmy, Sriharsha Gangam, Ethan Blanton, Ravish Khosla, Purdue University [[BR]] Puneet Sharma, Prakash Kumar Malligemane, HP Labs Note: HP will be subcontracting directly from BBN. === C. Publications (individual and organizational) === "Leveraging Correlations Between Capacity and Available Bandwidth To Scale Network Monitoring", Praveen Yalagandula, Sung-Ju Lee, Puneet Sharma, Sujata Banerjee, In Proceedings of IEEE !GlobeCom 2010, accepted for publication. "On the Cost of Network Inference Mechanisms," Ethan Blanton, Sonia Fahmy, Greg N. Frederickson, Sriharsha Gangam, IEEE Transactions on Parallel and Distributed Systems (TPDS), 14 pp., accepted for publication. === D. Outreach activities === Sonia Fahmy is serving as the technical program committee (TPC) chair of ICNP 2010. Puneet Sharma is serving on the TPC of ICNP 2010 and reviewed several measurement architecture-related papers in May/June 2010. === E. Collaborations === We participated in all bi-weekly Cluster C conference calls held since January 2010. During the GENI measurement workshop held in Chicago on June 8-9, we discussed our project with measurement projects that started in both spirals 1 and 2, as discussed above. === F. Other Contributions ===