[[PageOutline]] = Current GENI Rack Projects = GENI racks are being implemented to meet the goals specified by the GPO [wiki:GeniRacks GENI Rack Requirements]. The first class of racks were "GENI Starter Racks." The GPO has discontinued the deployment of these racks. However, documentation for this project exists for the edification for prospective rack builders and can be found [wiki:GENIRacksHome#PastGENIRackProject here]. Current rack projects can be characterized as follows: * '''[#ExoGENIRacks ExoGENI]''' A higher cost, flexible virtual networking topologies solution including !OpenFlow, that also delivers a powerful platform for multi-site cloud applications. These racks are typically deployed as an integrated part of a campus network.[[BR]] * '''[#InstaGENIRacks InstaGENI]''' - A mid-range cost, expandable GENI Racks solution that can will be deployed at a large number of campuses, delivering Internet cloud applications support, along with !OpenFlow and VLAN networking. These racks are normally deployed outside a site firewall. All GENI Racks have layer 3 connections to the Internet and layer 2 connections to the GENI core networks (curently NLR and Internet2). The racks use commodity Internet for control access to rack resources, and shared VLANS for the application and experiment data connections. The racks may also use layer 3 Internet connections for some experiments, particularly IP cloud experiments. This diagram illustrates logical connections for all the GENI Rack types: [[Image(GENI-Racks-connection.jpg)]] ''Note: InstaGENI Racks additionally allow layer 3 connections on the Data Plane connections'' Additional GENI racks information is available for various aspects of GENI Racks: - '''[wiki:GENIRacksAdministration GENI Racks Administration]''' page highlights tasks for each of these rack solutions to provide some insight into the effort required by a participant. - '''[wiki:GENIRacksHome/AcceptanceTests GENI Racks Acceptance Tests]''' page provides insight into how the GPO validates these racks before broad campus deployment. - '''[wiki:GENIRacksInteroperability GENI Racks Interoperability Experiment]''' page captures an interoperability experiment with ExoGENI, InstaGENI and Meso-scale !OpenFlow resources. - '''[wiki:GENIRacksHome/GENIRacksDeploymentSites GENI Racks Deployment Sites]''' page captures the list of Sites that will have an ExoGENI or InstaGENI Rack. - '''[wiki:GENIRacksHome/ExogeniRacks ExoGENI Rack Project]''' and '''[wiki:GENIRacksHome/InstageniRacks InstaGENI Rack Project]''' overview pages provide insight into each project's activity. - '''[wiki:GENIRacksHome/RacksChecklist Rack Checklist]''' page provides high level steps for installing a GENI rack. - '''[wiki:GENIRacksHome/RacksChecklistStatus Rack Checklist Status]''' page provides the status of each GENI site for completing the rack checklist. = ExoGENI Racks = The [http://www.exogeni.net ExoGENI] project is an effort to implement high-performance GENI Racks via a partnership between RENaissance Computing Institute (RENCI), Duke and IBM. ExoGENI racks are assembled and tested by IBM and shipped directly to sites, where they are managed by the RENCI team. ExoGENI racks deliver support for multi-domain cloud structure with flexible virtual networking topologies that allow combining ExoGENI, Meso-scale !OpenFlow and WiMAX resources. An overview of this project was presented at the [http://groups.geni.net/geni/attachment/wiki/GEC12GENIUpdatePlenary/GEC12-ExoGENI-Racks.pptx?format=raw GEC12 ExoGENI Presentation]. Also available are an [https://code.renci.org/gf/download/docmanfileversion/13/691/ExoGENIDesignv1.02.pdf ExoGENI Design] document and an [http://www.cs.duke.edu/~chase/exogeni.pdf ExoGENI white paper]. For a more details see the '''[http://groups.geni.net/geni/wiki/GENIRacksHome/ExogeniRacks ExoGENI Rack Project]''' overview page. The up-to-date technical information about ExoGENI Racks is located on [http://wiki.exogeni.net ExoGENI Wiki]. == ExoGENI Components == '''IMPORTANT:''' For the most up-to-date information about GENI Racks configurations and features please visit http://wiki.exogeni.net An [http://wiki.exogeni.net ExoGENI Rack] delivers the following types of systems: * Management Switch - An IBM G8052R switched is delivered to allow access to/from the local network provider. * VPN appliance - A Juniper SSG5 provides backup access to manage nodes. * !OpenFlow-enabled switch - An IBM G8264R switch to carry experimental traffic via layer2 to GENI backbone (I2, NLR) and to local OF campus. * Management Node - An IBM x3650 host running Elastic Compute Cloud(EC2) with !OpenStack to provision VMs and running xCat to provision bare-metal nodes. Also runs monitoring functions. * Worker Nodes - Ten IBM 3650 M3 Worker nodes provide both !OpenStack virtualized instances and Bare-metal Xcat nodes * Monitoring Host - None, Monitoring is through Nagios from GMOC. The ExoGENI resources have the following connections: [[Image(GENI-ExoGENI-components.jpg)]] == ExoGENI Specifications == '''IMPORTANT:''' For the most up-to-date information about GENI Racks configurations and features please visit http://wiki.exogeni.net An initial inventory of the ExoGENI Rack hardware components is found [https://docs.google.com/document/d/1hzleT6TNmiDb0YkkgqjXxPFJ37P4O6qApLmXgKJHBZQ/edit?hl=en_US here], which is superseded by the following: ''__Compute Resources__'' A total of 12 hosts are in the rack to provide the Resources, Monitoring, Storage and Application functions: * Management node: 1 IBM x3650 M3, 2x146GB 10K SAS hard drives, 12G RAM, dual-socket 4-core Intel X5650 2.66Ghz CPU, Quad-port 1Gbps adapter * Worker/Bare-Metal nodes: 10 IBM x3650 M3, 1x146GB 10K SAS hard drive +1x500+GB secondary drive, 48G RAM, dual-socket 6-core Intel X5650 2.66Ghz CPU, dual 1Gbps adapter, 10G dual-port Chelseo adapter * Sliverable Storage: 1 IBM DS3512 storage NAS 6x1TB 7200RPM drives ''__Network Components__'' * Management Switch: IBM BNT G8052R 1G client/10G uplink ports - Access to commodity internet. * !OpenFlow Switch: IBM BNT G8264R 10G client/40G uplink ports - Access to GENI backbone. * VPN Appliance: Juniper SSG5 - Backup management access. ''__Misc. Components__'' General purpose hardware included: * IBM PDU based on site power requirements, (GPO=IBM 5897 PDU; RENCI=DPI 5900 PDU) * No UPS included * IBM Local 2x16 Console Manager (LCM16) * IBM 1U 17-inch Flat Panel Console Kit (PN 172317X) Up-to-date details about the configuration and setup of ExoGENI racks can be found in [http://wiki.exogeni.net ExoGENI wiki]. == ExoGENI Implementation == Any configuration or run-time requirements for the ExoGENI rack systems will be documented here, when available. Each ExoGENI Rack systems requires a specific setup, which is to captured for each of the rack components: !OpenFlow Switch, Management node, Worker Nodes, etc.. See the '''[wiki:GENIRacks/ExoGENICompSetup ExoGENI Component Setup]''' for details about the required configuration. For help about the configuration settings, please contact [mailto:help@geni.net help@geni.net]. Some examples are available to get insight into '''[wiki:GENIRacksAdministration#ExoGENIAdministration ExoGENI Racks Administration]''' tasks. == ExoGENI Monitoring == Monitoring data for the ExoGENI rack is collected on the management node by a Nagios aggregator and then forwarded to the GMOC. The type of data that will be available is currently being defined. ExoGENI Racks meet the GENI [wiki:GeniRacks#D.MonitoringRequirements monitoring requirements]. ExoGENI Monitoring data will be available at the [https://gmoc-db.grnoc.iu.edu/api-demo GMOC SNAPP Home]. == ExoGENI Site Requirements == ExoGENI racks have the following site requirements: * Network Setup - Define how the rack will connect to the Internet and to the GENI backbones. Ex Regional connections, connection speed, VLANs to be used, etc. * Site Security Requirements- Determine changes required for rack connectivity, such as FV rules, IP filters, etc. * Address assignment for rack components - Define which address, subnet mask, routing is to be configured for the rack components. * Power requirements - based on site requirements * Administrative accounts - Setup of site administrator account that will be created on the management/head node. * Delivery logistics - Details for ''where'' the rack is to be delivered, ''who'' will accept the delivers, and ''when'' the delivery will take place. Also covers any physical restrictions for the rack delivery. If you are interested in becoming an ExoGENI deployment site, please contact us at [mailto:ibaldin@renci.org]. ------ = InstaGENI Racks = The InstaGENI project is an effort to deploy low-end, expandable GENI Racks at large number of campuses and is typically found outside the site firewall, more details are to be added as defined. An overview of the project is available from the [http://groups.geni.net/geni/attachment/wiki/GEC12GENIUpdatePlenary/McGeer%20InstaGENI.pdf?format=raw GEC12 InstaGENI Racks] presentation. An [http://groups.geni.net/geni/attachment/wiki/GENIRacksHome/InstaGENI%20Design%20Document%20Rick%202-15%282%29.doc?format=raw InstaGENI Design] document is available. For more details see the '''[http://groups.geni.net/geni/wiki/GENIRacksHome/InstageniRacks InstaGENI Rack Project]''' overview page. == InstaGENI Components == Each InstaGENI racks delivers a small ProtoGENI cluster with !OpenFlow networking and FOAM aggregate management. This rack includes the following types of systems: * Control Node - Xen Server that runs 3 VMS to provide: * PG boss node, web server, monitoring, and GENI API Server * Local File Server node * FOAM Controller * Experiment Nodes - Five nodes managed by ProtoGENI software stack, which provides boot services, account creation, experimental management, etc. * !OpenFlow Switch - Provides internal routing and data plane connectivity to the GENI backbone (layer 2 and layer 3) * Management Switch - Provides control plane connectivity to the Internet (layer 3) Following are the network connections for an InstaGENI rack: [[Image(GENI-InstaGENI-components.jpg)]] == InstaGENI Specifications == The current hardware components specification for the InstaGENI Racks includes: ''__Compute Resources__'' 5 HP !ProLiant DL360 G7 Server series hosts to provide the VM Server, Monitoring, Storage, and Application functions: * Control Node - 1 HP !ProLiant DL360 G7 Server, quad-core, single-socket, 12 GB Ram, 4 TB Disk (RAID), and dual NIC * Experiment Nodes - 5 HP !ProLiant DL360 G7 Server, six-core, dual-socket,48GB Ram, 1TB Disk, and dual NIC * Bare Metal Node ''__Network Components__'' 2 network components to provide access to GENI core networks and commodity Internet: * HP !ProCurve 2620 Switch (J9623A), 24 10/100/100 Mb/s ports, 2 1 Gb/s ports * HP !ProCurve 5406zl Switch (J8697A) 48 1 Gb/s ports, 4 10 Gb/s ports ''__Misc. Components_'' General purpose hardware also included: * 1 or more HP Intelignt Mod PDU * HP Dedicated iLO Management Port Option * HP TFT7600 KVM Console US Kit == InstaGENI Implementation == Configuration and run-time requirements for InstaGENI rack systems are documented here. Following are a list of available configuration details for the rack setup: * [http://www.protogeni.net/wiki/RackSetupQuestions Questionnaire] used to gather initial site configuration data. * [http://www.protogeni.net/wiki/rack-deployment Rack Deployment] page detailing how rack software is deployed. * [http://www.protogeni.net/wiki/RackAdminAccounts Administrative Accounts] instructions for creating new accounts. * FOAM Aggregate setup details are not documented at this time. * [http://www.protogeni.net/wiki/InstaGeni/ILO HP Integrated Lights-Out 3] information to configure, update, and operate servers remotely. For help or questions about configuration settings or run-time requirements, please contact [mailto:help@geni.net help@geni.net]. Some examples are available to get insight into '''[wiki:GENIRacksAdministration#InstaGENIAdministration InstaGENIRacks Administration]''' tasks. == InstaGENI Monitoring == InstaGENI Racks meet the following [wiki:GeniRacks#D.MonitoringRequirements monitoring requirements]. InstaGENI Monitoring data is currently being defined and will be available at the [https://gmoc-db.grnoc.iu.edu/api-demo GMOC SNAPP home]. == InstaGENI Site Requirements == InstaGENI racks have the following site requirements: * Network Setup - Define how the rack will connect to the Internet and to the GENI backbones. Ex Regional connections, connection speed, VLANs to be used, etc. * Address assignment for rack components - Define which address, subnet mask, routing is to be configured for the rack components. * Power requirements - based on site requirements * Administrative accounts - Setup of site administrator account that will be created on the management/head node. * Delivery logistics - Details for ''where'' the rack is to be delivered, ''who'' will accept the delivers, and ''when'' the delivery will take place. Also covers any physical restrictions for the rack delivery. If you are interested in becoming an InstaGENI deployment site, please contact us at [mailto:rick.mcgeer@hp.com]. == Interested in Building Your Own InstaGENI or ExoGENI Rack? == If you would like to make your own InstaGENI or ExoGENI rack, or to be considered as a potential site for the next phase of funded deployments, contact the project PI: * ExoGENI PI contact: [mailto:ibaldin@renci.org] * ExoGENI [http://www.exogeni.net website] * InstaGENI PI contact: [mailto:rick.mcgeer@hp.com] ------ = Past GENI Rack Project = No longer deployed by the GPO, this project delivered an early low-end solution for GENI Racks. = Starter Racks = The Starter Racks project was an effort to get [http://www.nsf.gov/cise/usignite/ US Ignite] cities connected to the GENI Network to facilitate experimental network and compute research, and city application development. The Starter Racks jump started the delivery of fully integrated network and compute resources to selected sites. During this period, the Starter racks did not deliver GENI software features such as an Aggregate Manager. In any case, it was possible to use a Starter Rack as a Meso-scale !OpenFlow Site, but required GPO Infrastructure support for implementation. Furthermore, details were provided in the [#GetYourOwnGENIRack section] below to build your own Starter Rack. == Starter Racks Components == A Starter Rack delivered software and hardware components that enabled a site to be a GENI site. Each GENI Starter Rack delivered the following types of systems: * Router - Cisco IOS router sets up standard routed IP to the local network provider. * !OpenFlow switch - HP Procurve 6600 switch carries experimental traffic via layer2 to GENI backbone (I2, NLR) and to carry Eucalyptus communication between local VMs. * Eucalyptus Head Host - Host running Eucalyptus service manages Eucalyptus hosts and provides public interface to access Site VMs via NAT. * Eucalyptus Worker Hosts - Two Eucalyptus Worker hosts provide VMs. The number of VMs allowed is based on address space available at each site. * Application Host (aka Bare-metal node) - A High performance host provides experimenters a real network interfaces to be provisioned manually. * Monitoring Host - Monitors both compute and network resources for the GENI site. The Rack resource above were connected as follows: [[Image(GENI-StarterRacks-components.jpg)]] ''Note: The data plane connection from the Euca Head host to the Cisco router is used to provide public access Euca Worker VMs via NAT.'' == Starter Racks Specifications == ''__Compute Resources__'' * 5 Dellâ„¢ !PowerEdgeâ„¢ R510 - 1 for Eucalyptus Head, 2 for Worker hosts, 1 for Monitoring, and 1 for bare-metal node. ''__Network Components__'' * 1 Cisco 2901 Integrated Services Router - Access to commodity internet. * 1 HP !ProCurve 6600-48G-4Xg - Access to GENI backbone. ''__Misc. Components__'' General purpose hardware included in the Starter Racks: * 1 APC Swiched Rack PDU - Load monitoring, remote power cycle. * 1 APC Smart-UPS - Network power protection * IOGEAR 8-port KVM switch - Console access * Lantronix !SecureLinx Spider Compact Remote - One port for KVM over IP access == Starter Racks Implementation == Each GENI Starter Rack systems required a specific setup, which was captured for each of the rack components: Router, !OpenFlow Switch, IPKVM, Eucalyptus Head Host, Eucalyptus Worker Hosts, and Monitor Node. See the '''[wiki:GENIRacks/StarterCompSetup Starter Component Setup]''' for details about the required configuration. Some examples are available to get insight into '''[wiki:GENIRacksAdministration#StarterracksAdmin Starter Racks Administration]''' tasks. == Starter Racks Monitoring == Starter Racks met the following [wiki:GeniRacks#D.MonitoringRequirements monitoring requirements]. Monitoring data for the 3 deployed Starter Racks, GPO, Chattanooga and Cleveland was available at the [http://monitor.gpolab.bbn.com/ganglia/ GPOLab Monitor] portal, where the user selected a location and received monitoring detail for ''System load'', ''CPU load'', ''Memory usage'', and ''Network usage''. In addition, ''Services Health'' was monitored on each of the GENI Starter Racks and alert notifications were available upon request. Access to the ''Service Health'' details was provided via the [http://monitor.gpolab.bbn.com/nagios/cgi-bin/status.cgi Service Status Details] page for all Starter Rack sites. == Starter Rack Site Requirements == Starter Racks contained the following site requirements: * Network Setup - Define how the rack will connect to the Internet and to the GENI backbones. Ex Regional connections, connection speed, VLANs to be used, etc. * Site Security Requirements- Determine changes required for rack connectivity, such as FV rules, IP filters, etc. * Address assignment for rack components - Define which address, subnet mask, routing is to be configured for the rack components. * Power requirements - based on site requirements * Administrative accounts - Setup of site administrator account that will be created on the management/head node. * Delivery logistics - Details for ''where'' the rack is to be delivered, ''who'' will accept the delivers, and ''when'' the delivery will take place. Also covers any physical restrictions for the rack delivery. == Get Your Own GENI Rack == Below were some of the guidelines provided by the GPO to build your own GENI Starter Rack: * Develop specification for GENI racks, defining storage, compute, network resources, etc. * Evaluate, integrate and manage new software and configurations for rack solution. * Test and integrate early rack hardware and software. * Define acceptance criteria to demonstrate successful rack deployment. ---- {{{ #!html Email help@geni.net for GENI support or email me with feedback on this page! }}}