学术报告:Leveraging the power of Distributed High Throughput Computing with HTCondor

题目:Leveraging the power of Distributed High Throughput Computing with HTCondor

主讲人:Miron Livny 威斯康辛-麦迪逊大学 教授

日期:2018年10月22日(星期一)

时间:上午10:00 - 11:30

地点数据科学与计算机学院 A101

主持:吴迪  教授

 

摘要:The HTCondor open-source software tools are offering a diverse set of job and resource management capabilities that are based on a novel approach to Distributed High Throughput Computing (HTC). These capabilities have been developed over more than three decades and have been driving a broad adoption of HTCondor by research groups and academic institutions across the world. On the UW-Madison campus, HTCondor has been used to deliver over the past 12 months more than 360M core hours to over 250 projects. These projects range from large scale international collaborations in High energy Physics and Astrophysics to single investigator studies in genetics and machine learning techniques. The national Open Science Grid (OSG) distributed research computing infrastructure also employs HTCondor to harness the capacity of more than 60 sites across the US to deliver annually more than 1.6B core hours. 

We will present the principals that guided the design and evolution of HTCondor and outline the architecture and interactions of its main components. A review of different deployment scenarios will be provided. These include commercial clouds and facilities that operate large scale computers. We will also discuss recent and future development efforts that include among others new authentication and storage techniques.

个人介绍:

 

Miron Livny received a B.Sc. degree in Physics and Mathematics in 1975 from the Hebrew University and M.Sc. and Ph.D. degrees in Computer Science from the Weizmann Institute of Science in 1978 and 1984, respectively. Since 1983 he has been on the Computer Sciences Department faculty at the University of Wisconsin-Madison, where he is currently the John P. Morgridge Professor of Computer Science, the director of the Center for High Throughput Computing (CHTC), is leading the HTCondor project and serves as the principal investigator and technical director of the Open Science Grid (OSG). He is a member of the scientific leadership team of the Morgridge Institute of Research where he is leading the Software Assurance Market Place (SWAMP) project and is serving as the Chief Technology Officer of the Wisconsin Institutes of Discovery.

Dr. Livny's research focuses on distributed processing and data management systems and involves close collaboration with researchers from a wide spectrum of disciplines. He pioneered the area of High Throughput Computing (HTC) and developed frameworks and software tools that have been widely adopted by academic and commercial organizations around the world.