wiki:CRON

Version 6 (modified by Seung-Jong Park, 11 years ago) (diff)

--

Project Number

1794

Project Title

Integrating a CRON (Cyberinfrastructure of Reconfigurable Optical Network) Testbed into ProtoGENI
a.k.a. CRON

Technical Contacts

Principal Investigator Seung-Jong Park sjpark@csc.lsu.edu
Co-PI: Rajgopal Kannan rkannan@csc.lsu.edu

PoC for escalation group: Seung-Jong Park 225 571 9239

Participating Organizations

Computer Science
Louisiana State University
289 Coates Hall
Baton Rouge, LA 70803

GPO Liaison System Engineer

Vic Thomas vthomas@geni.net

Scope

This effort provides a reconfigurable optical network emulator aggregate connected to the GENI backbone over Louisiana Optical Network Initiative (LONI). The role of optical network emulation in GENI is to provide a predictable environment for repeatable experiments, and to perform early tests of network research experimentation prior to acquiring real network resources. The tools and services developed by this project will integrate with the ProtoGENI suite of tools. The aggregate manager and network connections between LONI and GENI for this project will also allow other LONI sites to participate in GENI.

Current Capabilities

1. Introduction

CRON is the project funded by NSF MRI (Major Research Instrumentation) program, which builds a virtual high speed optical networking and computing testbed. The CRON testbed can provide up to four 10Gbps optical hardware emulated paths, four 5Gbps optical software emulated paths, and 16 high-end workstations attached to those paths simultaneously. A large number of application developers and networking researchers can share those virtually created high speed networking and computing environments without technical knowledge of networks and communications and without interference of other users. This virtual feature of CRON is exactly matched to the concept of GENI - Virtualization and Other Forms of Resource Sharing.

The cyberinfrastructure, CRON, provides integrated and automated access to a wide range of high speed networking configurations. Figure 1 shows how CRON can be reconfigured to emulate such optical networks as NLR (National Lambda Rail), Internet2, LONI (Louisiana Optical Network Initiative) configuration, or purely user-defined networks having different networking characteristics such as bandwidth, latency, and data loss rates. Moreover, users can dynamically reconfigure whole computing resources, such as operating system, middleware, applications, based on their specific demands. Due to the automated and reconfigurable characteristics, all types of experiments over CRON will be repeatable and controllable. This reconfigurable feature of CRON coincides with that of GENI – Programmability

No image "Concept.png" attached to CRON

2. Rationale of CRON

Although many statewide or nationwide or global high speed optical networks have been deployed, only a few groups of scientists and researchers can access the networking resources due to the following reasons:

Uncertainty: There are discrepancies between the expected and the actual performance experienced while developing new application softwares over high speed networks. And the reasons of the discrepancies can be the computing environment, networking environment, or the application software itself. Networks, especially in the early phase of deployment, can show varying levels of quality, such as bandwidth/throughput, latency, jitter and loss rate. The uncertain cause of these problems prevents the application developers from identifying their origin; they cannot tell if the problem source is the network or the software. It is critical for application developers to be able to identify the origin of problems so that they have a chance to solve them. If the problem is in the network, it is usually hard to find its origin as the application developers need to check all potential problems of all the resources utilized for development. This dramatically increases overall development time. Application developers should be able to concentrate on debugging only their software or end-systems when an unexpected level of performance is observed. To make this possible, they need to be able to decouple the networking environment from the computing environment. CRON is a decoupled networking environment that is guaranteed to provide a stable level of network quality because it is localized and fully controlled.

Scarce and Expensive Networking Resources: Even when optical networks achieve a level of stability that guarantees an error-controlled environment, they are still very high-priced entities that support only a few concurrent users at each optical link. As the demand for dedicated high speed networks increases, the number of users (including both researchers and engineers) will exceed the capacity of the networks. Therefore, it is critical to serve the increasing number of users with cost-effective networking services that provide a development environment that is equivalent to the real networking services. The proposed CRON will be able to accommodate these increasing user demands with smaller investments than real multi-million-dollar optical networks cost.

Research vs. Production Networks: Although users are ready to use a dedicated networking environment requested by them, the users at the application layer are not allowed to modify built-in configurations of other layers, such as transport protocols and other software configurations of end workstations which are connected to the dedicated networks. This constraint will limit the scope of experiments of users. Although they have a chance to modify the configurations, they can interfere with other users at different layers, who share the end workstations. To prevent this interference over production networks, CRON will provide an independent and separate virtual networking and computing environment to each user so that each user can reconfigure any software parameters fit for user’s own experimental purpose.

3. Architecture of CRON

No image "Connection Diagram.png" attached to CRON No image "Connection Diagram 1.png" attached to CRON

Above figure shows the architecture of the CRON, which consists of two main components: (i) hardware (H/W) components, including a 10Gbps switch, a 1Gbps switch, optical fibers, network emulators, and workstations; and (ii) software (S/W) components, creating an automatic configuration server that will integrate all the H/W components to create virtual networking and computing environments based on the users' requirements. All components are connected at two different networking planes: a control plane connected with 100/1000 Mbps Ethernet links and a data plane connected with 10 Gbps optical links. To allow access from outside networks, such as Internet2, NLR, and LONI, and to connect to external compute resources, the switch at the data plane has four external 10 Gbps optical connections that will extend the capacity of CRON and integrate it with existing networks and projects for the purpose of cooperative scenarios shown in the Figure.

Due to the high cost of the network hardware emulators, we will connect them to only four optical links that will be allocated to satisfy demands over 5 Gbps of bandwidths. The remaining links will be connected to machines running software emulators. More precisely, we utilize the NIST Net emulator. This emulator can only support up to 5 Gbps of bandwidth due to computing overhead on the CPUs of the machines they run on

All components of CRON, except the remote access clients, are located at LSU, which already has established 10 Gpbs optical paths to LONI and Internet2. Although all computing and networking resources are located at LSU, CRON provides virtual networking and computing environments to users from different physical locations.

Major Accomplishments

  1. Sep 2009 -Finished hardware purchase including servers, racks, 10Gbps network cards, 1Gbps control switch and 10Gbps data switch and connection cables.
  1. Oct 2009 -Finished the OPS server, including user file service, mailing service. Set up the mail relay with CCT through CCT’s mail exchange server.
  1. Nov 2009 --Finished the testbed Control Network, including Cisco 3560E switch configuration.
  1. Dec 2009 -Finished the BOSS server, including web service, accounts management, DNS service, and PXE DHCP configuration.
  1. Dec 2009 -Finished CRON testbed cluster movement from testing machine cabinet to the machine room of the first floor of the Frey building
  1. Jan 2010 -Finished Memory File System (MFS) including both FreeBSD based and Linux based MFS. Database configuration and webpage configuration are made successfully. Updated the FreeBSD based MFS from version 6.2 to 6.4 and then to the latest version of FBSD7.2 MFS. Successfully customized Fedora 8 image to be compatible with CRON project hardware. However, due to the SUN Fire x4240 hardware advanced feature of SAS disk buss and RAID controllers, the Emulab FreeBSD 6.x version generic image can’t be used.
  1. Jan 2010 -Finished network access for BOSS and OPS server, both within LSU and outside Internet, including LSU wireless access.
  1. Feb 2010 -Finished Serial line control network, testing on the serial line cable because the Sun Fire x4240 machine has special pinout serial port. Asked the Comtrol company’s official technical support and got the right cable pinout design. Currently, the serial control network could work, but has some wrong display problem. Asked CCT IT support to help on making such serial cable on test.
  1. Mar 2010 -Finished CRON system version upgrading from Utah Emulab stable source branch.

Outreach activities

The CRON project already envisages close cooperation between LSU and Southern University via a shared testbed, thus uniting two institutions from an EPSCoR state which struggles to overcome historic disadvantages related to education and poverty levels. Due in part to the large African American population of its state, LSU has a history of minority recruitment (one of the co-PI's Ph.D. students is in fact African-American). We expect to hire several more minority graduate students to work on networking research problems using the CRON infrastructure. Furthermore, the two PIs regularly teach the graduate High-Speed Networking Course (CSC 7502) as well as the primary undergraduate course in the LSU computer science department on computer networks (CSC 4501). We plan to incorporate a laboratory component in these courses relating to CRON - by allowing students in these courses hands-on access via experiments for utilizing the virtual networking and computing environment of CRON, we will enable a better understanding of the benefits of virtualization and network reconfigurability. We plan to crosslist this course with Southern University thereby allowing students there to also participate in and understand virtualization research via class experiments. Thus through this collaboration, the two institutions will become better equipped to train future generation of engineers for the network computing industry, an industry that is expected to experience rapid growth over the next several years. The LSU computer science department also hosts an annual summer workshop for incoming undergraduates called Computer Science Intensive Orientation for Students (CIOS). We plan to use the workshop to introduce freshman computer science students to the challenging field of networking research through CRON presentations and on-site demos.

Other Contributions

Our goal is to actively involve minority institutions and underrepresented students in this project. As a preliminary step towards this broader outreach, we have already established an experimental testbed connection between LSU and Southern University through LONI to perform networking experiments as shown in Figure 4. Southern University is one of the nation’s largest Historically Black Colleges & Universities. Thus the broader impact of CRON at Louisiana State will be to enable underrepresented minority institutions, which suffer the last mile problem and cannot access high speed networking resources, to perform experiments and researches. We also actively plan to publicize and advertise research opportunities in CRON at our annual departmental workshop for incoming freshman undergraduates and interested high-school students. This annual workshop in which the PIs participated in 2008 is called Computer Science Intensive Orientation for Students (CIOS) and covers basic introductions to key aspects of computer science as a discipline and a profession. In 2010, we plan to use the workshop to introduce freshman computer science students to the challenging field of networking research through CRON presentations and demos. We also hope to actively increase undergraduate and high-school student participation in the project through summer internships as part of the LSU Chancellors undergraduate research program which involves mentoring honors undergraduate students.


Milestones

MilestoneDate(CRON: S2.a)? Identify POC for GENI Prototype Response and Escalation Group.
MilestoneDate(CRON: S2.b)? Establish 10Gbps connection from LONI to ProtoGENI through Internet 2.
MilestoneDate(CRON: S2.c)? Establish a 10Gbps connection from CRON to ProtoGENI through LONI and Internet2.
MilestoneDate(CRON: S2.d)? CRON RSpec definition completed and documented.
MilestoneDate(CRON: S2.e)? Site authority and component manager ready.
MilestoneDate(CRON: S2.f)? Report on experiment over the federation among CRON, LONI, ProtoGENI sites.

Project Technical Documents

Links to wiki pages for the project's technical documents go here. List should include any document in the working groups, as well as other useful documents. Projects may have a full tree of wiki pages here.

Quarterly Status Reports

2b- Draft.docx page

Spiral 2 Connectivity

Links to wiki pages about details of infrastrcture that the project is using (if any). Examples include IP addresses, hostnames, URLs, DNS servers, local site network maps, VLANIDs (if permanent VLANs are used), pointers to public keys. GPO may do first drafts of any of these and have the PI correct them to bootstrap. May also include ticket links for pending or known connectivity issues. Many projects will have a full tree of wiki pages here.

Related Projects

Includes non-GENI projects.

Attachments (18)