wiki:Gec7ClusterDAgenda

Version 28 (modified by hmussman@bbn.com, 10 years ago) (diff)

--

Cluster-D meetings at GEC7

Day 1: March 16, 1pm - 5pm, Agenda and Notes

ORCA/BEN

Ilia Baldine
slides

ORCA software releases, and features:

Bella 2.0
Available now (was 2.1, planned for Feb 1)
+ New substrate API obsoletes COD
+ Lease cancellation
+ Multiple redeem predecessor support
+ Eucalyptus support
+ New broker policies
+ XML-­‐RPC ProtoGENI-­‐like SM interface
+ Global actor registry XML-­‐RPC function
+ Extended NDL support
+ NLR Sherpa driver

Bella 2.1
Panned for ? (was 2.2, planned for June 1)
+ Code hardening, more unit tests, better documentation
+ Broker querying coupled with registry
+ Juniper EX3200 support
+ Multi‐point VLAN slice support (BEN and NLR)
+ Possible:
– Support for newer Eucalyptus release
– Internet2 IDC support
– Gush integration (in cooperation with Gush team)

ViSE

David Irwin
UMass-Duke demo movie
slice setup movie

DICloud

Michael Zink
slides?

KANSEI

Mukundan Sridharan
slides

Progress in Spiral 2:

  1. Created v1.1 KanseiGenie Installer
  2. Ported KanseiGenie to NetEye (Wayne State), and provided support to porting efforts at OKGems (Oklahoma State)
  3. Extended KanseiGenie Researcher Portal to include baseline federated experimentation
  4. Completed development to make the switch form Soap to SecureSoap. New version will be rolled out after GEC7.
  5. Started planning v2.0 of software installer package, including baseline federation

Milestones Completed:
KANSEI: S2.d Extend researcher portal for use with Kansei and NetEye (Due 3/16/10)
KANSEI: S2.e Bring up NetEye testbed at WSU (Due 03/16/10)
KANSEI: S2.f Connection plan from Kansei and NetEye to Internet2 (Due 03/16/10)
KANSEI: S2.h Demo experiment using Kansei and NetEye (partially done; Due 07/20/10)

OKGems

PIs: Xiaolin (Andy) Li, Nazanin Rahnavard, Weihua Sheng, Venkatesh Sarangan, Johnson Thomas
Students: Han Zhao, Xinxin Liu, Praveen Khethavath, Li Yu, Nhat Nguyen
slides

Hardware status:
Dedicated lab space
About 100 sensor nodes (mainly Telosb and Micaz)
About 20 robots

ORCA status:
Installed and configured ORCA (Anacortes 1.2) in local environment successfully.
Built one ORCA local master and one node agent for initial testing.

KanseiGenie status:
Set up a small set of lab sensor nodes into the KanseiGenie framework.
Customized the KanseiGenie web portal.

Robotics VLab status:
A client session, control a robotic arm for arranging an alphabetical pattern

Year 1 Plan 1:
Design and develop drivers for our resource aggregates (PCs and sensors) using ORCA Bella 2.0.
Set up VLAN to stitch distributed resources together.
Deploy field sensor nodes and integrate them into the OKGems framework.
Further design OKGems portal
Give a demo in GEC 8

Year 1 Plan 2:
Modify existing plugins and develop new plugins for ORCA, i.e., plugins of scheduling policies.
Develop spatial-temporal slivers of sensor nodes/networks through TinyHive virtual machine and TinyBee mobile agent. (to be fully completed in Year Two)
Define programmable abstractions in finer granularity

Year 1 Plan 3:
Draft a system design to include robots
Define initial programmable abstractions of actuators and effectors
Remotely control robots over networks (LAN & WAN)

Bella 2.0 Release Features

Aydan Aydan Yumerefendi
slides

+ New Substrate API

  • Simplify integration of new substrates
  • Simplified IConcreteSet implementation

. UnitSet represents a collection of Unit-s
. Unit designed to represent any resource unit, e.g, VM, VLAN, Testbed, etc.

  • IShirakoPlugin extension: ISubstrate

. Implemented as Substrate and AuthoritySubstrate
. Defines clearly the extension points for a new substrate
. transferIn, modify, transferOut

  • New authority Resource Control classes

. UnitsControl
. SimpleVMControl
. VMControl
. VLANControl

  • First steps to simplify and generalize the web portal

. New project: webapp2

+ New drivers and handlers: NLR, Eucalyptus

  • NLR

. Provisions dynamically a path over NLR

  • Eucalyptus

. Provisions dynamically a VM from an Eucalyptus cluster
. Can also provision from Amazon EC2 (same API)
. Supports assigning VLANs to VMs
. Requires a patch to Eucalyptus 1.5

+ Simplified actor configuration file format

  • Define an actor with a few lines of XML

+ Lease cancellation (vacate) support

  • Brokers can allocate resources more efficiently

+ New controllers: inter-domain, xmlrpc (protogeni)
+ No major new features in the next release

  • Primary focus:

. Harden and productize existing codebase
. Simplify installation and setup
. Documentation

  • If time permits:

. SOAP management API
. Integrate Orca in command-line tools and other portals
. Distributed Orca without Tomcat

Actor Registry and XML-­RPC Controller

Anirban Mandal
slides

+ ORCA Actor Registry

  • Snapshot of available actors from various ORCA containers

— Users can use this for resource discovery and other queries

  • Users can visit http://geni.renci.org/actors.php to view current set of actors registered with the registry
  • Users can also programmatically query the registry using an XML-RPC interface

+ XML-RPC Controller

  • Goal: Provide an XML-RPC interface to ORCA for experiment control tools and external users
  • Tools/users would use this interface to

. discover available resources
. instantiate and destroy experiment slivers

  • Initial version of ProtoGENI-like XML-RPC interface available on an ORCA SM
  • Generic slice manager acts on behalf of experiment control tools/user
  • Details of control framework hidden from user
  • These interfaces provide a minimal set of features

. DiscoverResources(), CreateSliver(), DeleteSliver()

  • Extended set of features (available later) would include

. GetTicket(), RedeemTicket(), UpdateTicket(), UpdateSliver()
. Support for resource representation using NDL

Day 2: March 17, 1pm - 3pm, Agenda and Notes

ERM: Embedded real-time substrate measurements for real-time cross-layer experiments

Keren Bergman, Caroline Lai, Michael Wang
slides

+ Year 1: Unified measurement Framework architecture
+ Now: get measurements from Polatis, Infinera, etc.
+ Next: experiment use case for GEC8

  • Control:

. Stand-aline programmable attentuator
. Polatis swithch

LEARN Measurement Handler

Debjyoti Majumder
slides LEARN measurement handler

+ Measurement handler:

  • receives XML-RPC requests
  • logs in to Polatis/Infinera via TL1
  • gets measurements
  • logs out

LEARN Network Integration

Shade EL-Hadik
slides LEARN network

+ Create an isolated ORCA instance in the lab with a Cisco 3750 switch

  • The ORCA Master is now equipped with handlers.
  • The node agent has drivers installed.
  • Drivers for accessing the Cisco 6509 switch are available, which we need to modify for Cisco 3750.
  • Need to test if the handlers of the ORCA master are suitable for the existing drivers of the node agent.
  • If successful, the Cisco 3750 switch needs to be accessed by node agent for our lab
  • Finally to set up a VLAN using the switch, node agent, and the ORCA Master.

+ Goal: Integrate the LEARN, regional optical network, located in Texas, into the ORCA control framework (GENI Cluster D) by GENI Engineering Conference 8 (July 2010)

IMF

Rudra Dutta slides
poster, including IMF, ERM and LEARN

+ IMF Overview (see poster)

  • IMF provides an abstraction of measurement capabilities available within the GENIsubstrate by allowing experimenters to measure properties within the substrate, such as physical layer attributes (e.g.optical or RF power) and performance parameters (e.g.BER, packet loss,CPU usage) through a unified measurement interface.

+ IMF Architecture (see poster)

  • An experiment slice is created by instantiating slivers of resources from multiples sites and interconnecting them.
  • The data plane of a slice reflects the topology desired by user.
  • The measurement plane of a slice represents the measurement functions available within the slice.
  • A slice also has substrate environment control capability so that the precise environment of a slice may be controlled and manipulated.

+ PubSub module included in IMF

  • Knows about what it wants, polls MH
  • Publishes results

+ MH module, included in IMF

  • Simple driver, no state

+ Use Case

  • Run SILO applications on ORCA-BEN.
  • SILO: Services Integration, controL, and Optimization.

+ Next

  • Run SILO – IMF for a complete closedloop feedback control demonstration
  • Create SCM to mirror measurement capability
  • Measure – control – monitor
  • Down the road – better presenting capabilities to experimenter who only consumes
  • Also examine API for in-slice consumer programmers
  • Integrate with measurement ontology ?

DOME

Brian Lynn, Thijs de Vries
slides

Since Sept, 2009, have several users running experiments on DOME
+ UMass graduate students
+ Research project with University of Arkansas
+ NSF GENI Research Experience for Undergraduate (REU) program
+ U of Washington’s Million Node GENI runs on DOME when no other experiments are scheduled

iGENI

Joe Mambretti, Jim Chen
slides

+ "GENI Cluster D Network", or GCDNet
+ iGENI as an aggregate

+ Now

  • Installed 6509 at NW in Chicago
  • Initial Site to Site Implementation Demonstrated at GEC 7
  • Connected UMass (via un-switched VLAN) to RENCI (via switched VLAN)

+ Next

  • Prototype/Model for Other Instantiations
  • Planning Has Begun for Other Cluster-D Sites
  • Next Demonstration in July 2010 at GEC 8
  • Planning for Cluster-D November Wash DC Showcase

+ Goal

  • Bridge NLR and I2 soon, for a good reason

Plan for GEC8 demos/experiments

+ Questions:

  • Exactly where?
  • How much bandwidth?

+ ORCA-BEN

  • Multi‐point slice demo with several Cluster‐D members
  • Assist other projects with experiment demonstrations

+ OKGems: robots?

+ Kansei: Federation, with visualization?

Plan for GEC9 demos/experiments

+ Questions:

  • Exactly where?
  • How much bandwidth?

+ Can Cluster D provide a featured demo?

  • What could it be?

Ongoing Cluster D Interactions

Monthly PI calls
Calls on specific topics
Resource description

Attachments (16)