== Meso-scale Monitoring == Thurs, 1530-1730 Organizers: Sarah Edwards and Chaos Golubitsky, GPO This is an interactive working session for GENI aggregate owners, operators, and software developers on how to share data, perform analyses, check status, and generate summaries to best support operations and experimentation needs. The GEC12 session will follow up on monitoring requirements developed in previous sessions. We will describe solutions and identify which new and existing tools can be used to build them. Campus IT staff, aggregate operators and software developers are encouraged to attend. === Agenda === [attachment:"GEC12_MonitoringReqts_FINAL.pdf" slides] * (5 min) Introduction - Sarah Edwards, GPO * Bottom-Up talks will address progress addressing pain points identified at previous GECs * Top-Down talk and discussion identifies monitoring/mgmt requirements looking forward * Bottom-Up Talks * (10 min) FOAM: New !OpenFlow Aggregate Manager - Josh Smift, GPO * (20 min) Using SNAPP to Find and Visualize GENI Monitoring Data - Camilo Viecco & John Meylor, Indiana University/GMOC * (15 min) GENI Monitoring: Topology in the Mesoscale - Chaos Golubitsky, GPO * Top-Down Talk * (1 hr incl. discussion) Monitoring/Mgmt Requirements - Sarah Edwards, GPO === Session Summary === Links to appropriate section of the [wiki:GEC12MesoScaleMonitoring/DetailedNotes Detailed Notes] are included below. '''Sarah Edwards''' of the GPO introduced the session. There were two goals for the session: 1. Keep talking about day-to-day issues and problems, as we did at GEC11 2. Look ahead to where GENI is headed. We need to be able to provide inputs so that other parts of GENI will address monitoring needs, and so we don't ignore any important pieces. '''Josh Smift''' of the GPO [wiki:GEC12MesoScaleMonitoring/DetailedNotes#FOAM:NewOpenFlowAggregateManager spoke] about [https://openflow.stanford.edu/display/DOCS/FOAM FOAM], the new !OpenFlow Aggregate Manager (AM). * Version 0.6 will migrate to campuses on November 21. * FOAM addresses three pain points identified at the last GEC: * improved data mapping between !FlowVisor slices, GENI slivers, GENI slices, and experimenters allows much improved monitoring; * an automated approval engine make approval (aka !OpenFlow Opt-In) easier; and, * FOAM reduces the size of the flowspace (eg the GPO saw an improved by a factor of 30). '''Camilo Viecco''' (of Indiana U/GMOC) did a [wiki:GEC12MesoScaleMonitoring/DetailedNotes#UsingSNAPPtoFindandVisualizeGENIMonitoringData demonstration] of how to use SNAPP to find and visualize monitoring data from the GMOC DB. * Camilo demonstrated the new [http://gmoc-db.grnoc.iu.edu/measurement/portal.cgi Portal] interface to SNAPP which allows you to browse the data by meso-scale participant. * In addition, Camilo demonstrated how to use search in [http://gmoc-db.grnoc.iu.edu/measurement SNAPP] (eg to find all data related to a single slice). '''Chaos Golubitsky''' of GPO [wiki:GEC12MesoScaleMonitoring/DetailedNotes#Topology spoke] about Topology in the Mesoscale. Chaos discussed two solved problems which can cause an experimenter's topology to not match their expectations. Monitoring in both the near and long terms needs to address problems like these. '''Sarah Edwards''' of the GPO provided an [wiki:GEC12MesoScaleMonitoring/DetailedNotes#MonitoringandManagementRequirementsandDiscussion overview] of top-down GENI monitoring requirements. Sarah presented a top-down analysis of monitoring and management requirements, to ensure we cover all the key areas and focus on areas that will become problems, not just areas that are currently a problem. Monitoring and management in GENI must support * cross-GENI monitoring, * troubleshooting and event escalation, * quickly identifying and addressing security events, and * emergency stop, * all while ensuring all parties follow defined policies, * and preserve both experimenter and end user privacy. === Background Reading === * [http://gmoc-db.grnoc.iu.edu/measurement/portal.cgi GMOC Monitoring Portal] * [http://gmoc-db.grnoc.iu.edu/measurement SNAPP interface to GMOC Database]