wiki:GEC12MesoScaleMonitoring

Version 11 (modified by sedwards@bbn.com, 8 years ago) (diff)

--

Meso-scale Monitoring

Thurs, 1530-1730

Organizers: Sarah Edwards and Chaos Golubitsky, GPO

This is an interactive working session for GENI aggregate owners, operators, and software developers on how to share data, perform analyses, check status, and generate summaries to best support operations and experimentation needs. The GEC12 session will follow up on monitoring requirements developed in previous sessions. We will describe solutions and identify which new and existing tools can be used to build them. Campus IT staff, aggregate operators and software developers are encouraged to attend.

Agenda

All slides for the session.

  • (5 min) Introduction - Sarah Edwards, GPO
    • Bottom-Up talks will address progress addressing pain points identified at previous GECs
    • Top-Down talk and discussion identifies monitoring/mgmt requirements looking forward
  • Bottom-Up Talks
    • (10 min) FOAM: New OpenFlow Aggregate Manager - Josh Smift, GPO
    • (20 min) Using SNAPP to Find and Visualize GENI Monitoring Data - Camilo Viecco & John Meylor, Indiana University/GMOC
    • (15 min) GENI Monitoring: Topology in the Mesoscale - Chaos Golubitsky, GPO
  • Top-Down Talk
    • (1 hr incl. discussion) Monitoring/Mgmt Requirements - Sarah Edwards, GPO

Session Summary

Links to appropriate section of the Detailed Notes are included below.

Sarah Edwards of the GPO introduced the session.

There were two goals for the session:

  1. Keep talking about day-to-day issues and problems, as we did at GEC11
  2. Look ahead to where GENI is headed. We need to be able to provide inputs so that other parts of GENI will address monitoring needs, and so we don't ignore any important pieces.

Josh Smift of the GPO spoke about FOAM, the new OpenFlow Aggregate Manager (AM).

  • Version 0.6 will migrate to campuses on November 21.
  • FOAM addresses three pain points identified at the last GEC:
    • improved data mapping between FlowVisor slices, GENI slivers, GENI slices, and experimenters allows much improved monitoring;
    • an automated approval engine make approval (aka OpenFlow Opt-In) easier; and,
    • FOAM reduces the size of the flowspace (eg the GPO saw an improved by a factor of 30).

Camilo Viecco (of Indiana U/GMOC) did a demonstration of how to use SNAPP to find and visualize monitoring data from the GMOC DB.

  • Camilo demonstrated the new Portal interface to SNAPP which allows you to browse the data by meso-scale participant.
  • In addition, Camilo demonstrated how to use search in SNAPP (eg to find all data related to a single slice).

Chaos Golubitsky of GPO spoke about Topology in the Mesoscale.

Chaos discussed two solved problems which can cause an experimenter's topology to not match their expectations. Monitoring in both the near and long terms needs to address problems like these.

Sarah Edwards of the GPO provided an overview of top-down GENI monitoring requirements. Sarah presented as analysis of monitoring and management requirements, to ensure we cover all the key areas and focus on areas that will become problems, not just areas that are currently a problem. Monitoring and management in GENI must support

  • cross-GENI monitoring,
  • troubleshooting and event escalation,
  • quickly identifying and addressing security events, and
  • emergency stop,
  • all while ensuring all parties follow defined policies,
  • and preserve both experimenter and end user privacy.

Background Reading

Attachments (6)