Job Scheduling for Multi-User MapReduce Clusters

TitleJob Scheduling for Multi-User MapReduce Clusters
Publication TypeTechnical Report
Year of Publication2009
AuthorsZaharia, M., Borthakur D., Sarma J. Sen, Elmeleegy K., Shenker S. J., & Stoica I.
Other Numbers3535

We would like to thank the Hadoop teams at Yahoo! and Facebook for the discussions based on practical experience that guided this work. We are also grateful to Joe Hellerstein and Hans Zeller for their pointers to related work in database systems. This research was supported by California MICRO, California Discovery, the Natural Sciences and Engineering Research Council of Canada, as well as the following Berkeley Reliable Adaptive Distributed systems lab sponsors: Sun Microsystems, Google, Microsoft, HP, Cisco, Facebook and Amazon.

Bibliographic Notes

EECS Department, University of California, Berkeley, Technical Report UCB/EECS-2009-55

Abbreviated Authors

M. Zaharia, D. Borthakur, J. Sen Sarma, K. Elmeleegy, S. Shenker, and I. Stoica

ICSI Research Group

Networking and Security

ICSI Publication Type

Technical Report