Opened 5 years ago

Closed 5 years ago

#1332 closed (fixed)

Middleware for Hadoop-in-a-Hybrid-Cloud

Reported by: Owned by:
Priority: major Milestone:
Component: GPO Version: SPIRAL7
Keywords: GEC21 Cc:


Demo description paragraph (three sentence minimum): A middleware for Hadoop-in-a-Hybrid-Cloud

MapReduce is a programming model for processing and generating large data sets, and Hadoop, a MapReduce implementation, is a good tool to handle Big Data. Cloud computing with its ubiquitous characteristic, on demand and dynamic resource provisioning at low cost has potential to be the environment to treat big data. However, using Hadoop on the cloud spends time and requires technical knowledge from users. The hybrid cloud leverages these requirements, because it’s necessary to evaluate the resources in private cloud and, if necessary, obtain and prepare on-demand resources in the public cloud. Moreover, the simultaneous management of private and public domains requires an appropriate model that combines performance with minimal cost. We propose an architecture to make the orchestration of Hadoop applications in hybrid clouds. The core of the model consists of a web portal for submissions, an orchestration engine and an execution services factory. Through these three components it’s possible to automate the preparation of a cross-domain cluster, performing the provisioning of files involved, managing the execution of the application, and making the results available to the user.

List of equipment that will need AC connections (e.g. laptop, switch, monitor): Laptop with AC power plug IEC 60906-1 (

Total number of wired network connections (sum standard IP and VLAN connections): 1 (standard wired network)

Number of wired layer 2 VLANs (if any): 0 Specify VLAN number, if known, approximate bandwidth, and whether tagged or untagged.

Number of wireless network connections (include required bandwidth if significant): 1

Number of static addresses needed (if any): 0

Monitor (y/n, specify VGA or DVI): y, VGA. Specify resolution only if your software has resolution restrictions.

Number of posters (max size poster boards are 30" x 40"): 30" x 40".

Special requests: none. Include any specific network connectivity needs (e.g. VLANs to a particular GENI location, projects you'd like to be near, etc.)

Change History (7)

comment:1 Changed 5 years ago by

Summary: GEC21 Demo RequestMiddleware for Hadoop-in-a-Hybrid-Cloud

comment:2 Changed 5 years ago by

Status: newaccepted

Thanks for the demo request. We should have no problem getting you space. See you in Indiana!

But Xuan, I'm not sure we'll be able to power that plug. We'll look into it, but you should plan to buy some kind of adapter.

comment:3 Changed 5 years ago by

Since Luis is not coming to GEC21, so I think the power adapter for the laptop is not needed at this time. My lab mate Shuai Zhao will use his laptop to present the demo on behalf of Luis.

Also, I would like to make a request to put this demo next to my other demo (Dynamic Virtual Router failure recovery), so that it will be easier for us.

I found that this demo is not listed on the EveningDemoSession wiki page. Could you please add it to the wiki page, and I can modify the detail information from there.

comment:4 Changed 5 years ago by

Sorry about that! Your demos should both be on the wiki now. Both your demos are sharing the same table!

comment:5 Changed 5 years ago by


I was editing my demo description on the EveningDemoSession wiki page, and I think I accidentally deleted part of the page when I submitted my changes. I sincerely apologize for the trouble.

Since I have opened the same page in another tab on my browser earlier, I have been able to recover the content that I accidentally deleted. I want to report this to you so that you are aware of this updates. You may want to double check if everything looks alright.

I'm very sorry about this.


-- Xuan

comment:6 Changed 5 years ago by

No problem Xuan, I think it's still OK.

comment:7 Changed 5 years ago by

Resolution: fixed
Status: acceptedclosed

Thanks for joining us in Bloomington this year. We hope everything worked as you expected. Don't hesitate to offer any suggestions.

Please feel free to update / append the wiki page for the Demo Night here:

Note: See TracTickets for help on using tickets.