Opened 9 years ago

Closed 9 years ago

#1439 closed (fixed)

Streaming Query Builder

Reported by: cody@uky.edu Owned by: peter.stickney@bbn.com
Priority: major Milestone:
Component: GPO Version: SPIRAL7
Keywords: GEC22 Cc:
Dependencies:

Description (last modified by lnevers@bbn.com)

One-sentence layman's description:

-This demo shows a working prototype of a system used to graphically construct complex streaming query using a hierarchical directed graph structure.

Who should see this demo?

-Attendees interested in pseudo real-time access to health, performance, and other resource metrics, or those interested in time series stream analysis.

Demo description paragraph(s):

-Complex event processing (CEP) combines data from multiple sources to infer events or patterns that might suggest more complicated circumstances. Often, CEP is performed on aggregations of pseudo real-time data streams. Source data streams are often manipulated and serve as additional data sources. This tool aims to provide users the ability to experiment with CEP without requiring requiring software development by the end-user.

The basis of our work is related to GENI resource monitoring, which includes collecting and recording metrics from the infrastructure that makes up the GENI network. Typically data collection and monitoring frameworks are both limited in the scale of their data collection and the complexity of reporting and alerting on collected data.

Our work aims to create a scalable system capable of collecting metrics from globally distributed resources. In addition, have developed a highly scalable complex event processing (CEP) platform capable of processing general data streams. As data streams through this system it is recorded as time-series data-points in a distributed database capable of storing billions of metrics. Time series data is then used to model new real-time events.

Simply, if real-world complex events can be both observed and described in a query language, we can react to these events in real-time. The collection of metrics over time can be correlated with undetected events to develop more accurate event models.

This capabilities of this system would be of interest to those working in large distributed systems such as those participating in large sensor networks, market trading, resource utilization prediction, systems optimization, etc.

List of equipment that will need AC connections (e.g. laptop, switch, monitor):

-Two laptops

Total number of wired network connections (sum standard IP and VLAN connections):

-Two connections for laptop standard IP

Number of wired layer 2 VLANs (if any):

-An exclusive VLAN is not needed

Number of wireless network connections (include required bandwidth if significant):

-Not needed unless wired is unavailable

Number of static addresses needed (if any):

-Not needed as long as dynamic addresses are unrestricted between devices.

Monitor (y/n, specify VGA or DVI):

yes. if possible, otherwise we can use the laptop and poster.

Number of posters (max size poster boards are 30" x 40"): one poster

Special requests: No special request.

Change History (5)

comment:1 Changed 9 years ago by hdempsey@bbn.com

Keywords: GEC22 added
Owner: changed from somebody to peter.stickney@bbn.com
Status: newassigned

comment:2 Changed 9 years ago by hdempsey@bbn.com

Description: modified (diff)
Summary: Placeholder for UKY Monitoring DemoStreaming Query Builder

comment:3 Changed 9 years ago by hdempsey@bbn.com

Reporter: changed from hdempsey@bbn.com to cody@uky.edu

Participants:

Cody Bumgardner <cody@uky.edu> Caylin Hickey <Caylin Hickey>

comment:4 Changed 9 years ago by lnevers@bbn.com

Description: modified (diff)

comment:5 Changed 9 years ago by peter.stickney@bbn.com

Resolution: fixed
Status: assignedclosed

Thanks for joining us in DC this year. We hope everything worked as you expected.

Please feel free to update / append the wiki page for the Demo Night here:

http://groups.geni.net/geni/wiki/GEC22Agenda/EveningDemoSession

Note: See TracTickets for help on using tickets.