Torsten Hoefler - Episode 74

In this episode of ACM ByteCast, Bruke Kifle hosts 2024 ACM Prize in Computing recipient Torsten Hoefler, a Professor of Computer Science at ETH Zurich (the Swiss Federal Institute of Technology), where he serves as Director of the Scalable Parallel Computing Laboratory. He is also the Chief Architect for AI and Machine Learning at the Swiss National Supercomputing Centre (CSCS). His honors include the Max Planck-Humboldt Medal, an award for outstanding mid-career scientists; the IEEE CS Sidney Fernbach Award, which recognizes outstanding contributions in the application of high-performance computers; and the ACM Gordon Bell Prize, which recognizes outstanding achievement in high-performance computing. He is a member of the European Academy of Sciences (Academia Europaea), a Fellow of IEEE, and a Fellow of ACM. In the interview, Torsten reminisces on early interest with multiple computers to solve problems faster and on building large cluster systems in graduate school that were later turned into supercomputers. He also delves into high-performance computing (HPC) and its central role in simulation and modeling across all modern sciences. Bruke and Torsten cover the various requirements that power HPC, the intersection of HPC and recent innovations in AI, and his key contributions in popularizing 3D parallelism for training AI models. Torsten highlights challenges, such as AI’s propensity to cheat, as well as the promise of turning reasoning models into scientific collaborators. He also offers advice to young researchers on balancing academic learning with industry exposure. We want to hear from you!

In this episode of ACM ByteCast, Bruke Kifle hosts 2024 ACM Athena Lecturer and ACM Eugene L. Lawler Award recipient Maja Matarić, the Chan Soon-Shiong Chaired and Distinguished Professor of Computer Science, Neuroscience, and Pediatrics at the University of Southern California (USC), and a Principal Scientist at Google DeepMind. Maja is a roboticist and AI researcher known for her work in human-robot interaction for socially assistive robotics, a field she pioneered. She is the founding director of the USC Robotics and Autonomous Systems Center and co-director of the USC Robotics Research Lab. Maja is a member of the American Academy of Arts and Sciences (AMACAD), Fellow of the American Association for the Advancement of Science (AAAS), IEEE, AAAI, and ACM. She received the US Presidential Award for Excellence in Science, Mathematics, and Engineering Mentoring (PAESMEM) from President Obama in 2011. She also received the Okawa Foundation, NSF Career, the MIT TR35 Innovation, the IEEE Robotics and Automation Society Early Career, and the Anita Borg Institute Women of Vision Innovation Awards, among others, and is an ACM Distinguished Lecturer. She is featured in the documentary movie Me & Isaac Newton. In the interview, Maja talks about moving to the U.S. from Belgrade, Serbia and how her early interest in both computer and behavioral sciences led her to socially assistive robotics, a field she saw as measurably helpful. She discusses the challenges of social assistance as compared to physical assistance and why progress in the field is slow. Maja explains why Generative AI is conducive to creating socially engaging robots, and touches on the issues of privacy, bias, ethics, and personalization in the context of assistive robotics. She also shares some concerns about the future, such as the dehumanization of AI interactions, and also what she’s looking forward to in the field. We want to hear from you!

In this episode of ACM ByteCast, Rashmi Mohan hosts ACM Fellow and 2016 ACM Software System Award recipient Alfred Spector, Professor of Practice in the MIT EECS Department. He was previously CTO of Two Sigma Investments, and before that Vice President of Research and Special Initiatives at Google. Alfred played a key role in developing the Andrew File System (AFS), a breakthrough in distributed computing that later became a commercial venture. He is also known for coining the term “CS + X.” He is a Fellow of the American Academy of Arts and Sciences, Hertz Foundation, and National Academy of Engineering, and recipient of the IEEE Kanai Award for Distributed Computing. Alfred recounts how he initially pursued programming out of personal enjoyment in college. He talks about developing AFS at Carnegie Mellon University, the challenges of turning academic research into commercial products, and the transition from academia to entrepreneurship, sharing some of the lessons learned along the way. Alfred touches on his time at IBM, which acquired his startup Transarc, and the differences between startups and large corporations. He also talks about some of his most notable work as a technical leader at Google, such as Google Translate. Finally, he offers a unique perspective on the rapid evolution of AI and advocates for a more multidisciplinary approach for developing responsible technology. “Google’s hybrid approach to research” paper “More Than Just Algorithms” (ACM Queue article)

In this episode of ACM ByteCast, Rashmi Mohan hosts Henrique Malvar, a signal processing researcher at Microsoft Research (Emeritus). He spent more than 25 years at Microsoft as a distinguished engineer and chief scientist, leading the Redmond, Washington lab (managing more than 350 researchers). At Microsoft, he contributed to the development of audio coding and digital rights management for the Windows Media Audio, Windows Media Video, and to image compression technologies, such as HD Photo/JPEG XR formats and the RemoteFX bitmap compression, as well as to a variety of tools for signal analysis and synthesis. Henrique is also an Affiliate Professor at the Electrical and Computer Engineering Department at the University of Washington and a member of the National Academy of Engineers. He has published over 180 articles, has been issued over 120 patents, and has been the recipient for countless awards for his service. Henrique explains his early love of electrical engineering, building circuits from an early age growing up in Brazil, and later fulfilling his dream of researching digital signal processing at MIT. He describes his work as Vice President for Research and Advanced Technology at PictureTel, one of the first commercial videoconferencing product companies (later acquired by Polycom) and stresses the importance of working with customers to solve a variety of technical challenges. Henrique also shares his journey at Microsoft, including working on videoconferencing, accessibility, and machine learning products. He also offers advice to aspiring researchers and emphasizes the importance of diversity to research and product teams.

In this episode of ACM ByteCast, our special guest host Scott Hanselman (of The Hanselminutes Podcast) welcomes Kate Kallot, founder and CEO of Amini, an impact-driven AI company based in Nairobi, which focuses on the critical issue of data scarcity in Africa and its implications for AI development. Before Amini, her career spanned leadership positions at global tech companies, including NVIDIA, where she led global developer relations and expansion into emerging markets, and Arm, where she was a pivotal figure in the Tiny Machine Learning (TinyML) movement. At Intel, she led the development of the world’s first AI development kit in a USB form factor, the Neural Compute Stick, bringing computer vision and Al to IoT and edge devices to millions for the first time. Kate is a recognized expert and influencer in the AI field, advising international organizations and governments on the potential and challenges of AI for good. Her work has been recognized by TIME’s 100 Most Influential People in AI, the World Economic Forum as a Tech Pioneer, and One Young World as Entrepreneur of the Year 2024. A trusted voice in global AI policy and digital equity, Kate serves as Vice Chair of the ICC Global Environmental and Energy Commission and is a member of EY’s Global AI Advisory Council. In the interview, Kate explains the barriers to AI adoption in Africa, stemming from challenges with digital and environmental data infrastructure. She shares her work collecting and validating data in key areas such as climate and agriculture through state-of-the-art technologies and partnerships with private companies, using a bottom-up approach. Kate and Scott also talk about Amini’s commitment to open source and community collaboration in areas such as geospatial data science, and the global applications of Amini’s work in Africa to other geographies with similar characteristics. We want to hear from you!

In this episode of ACM ByteCast, Rashmi Mohan hosts ACM Fellow Michael J. Freedman, Robert E. Kahn Professor of Computer Science at Princeton University and co-Founder and CTO of Timescale. Michael’s research interests are in distributed systems, networking, and security. Over the course of his student and professional career, he designed and operated the Coral Content Distribution Network, a peer-to-peer content distribution network; co-founded (with Martin Casado) Illuminics Systems, an IP analytics company; and designed TimescaleDB and JetStream. His many honors and recognitions include the 2018 ACM Grace Murray Hopper Award, Presidential Early Career Award for Scientists and Engineers, and SIGOPS Mark Weiser Award. Michael shares what drew him to computer science, highlighting the value of initiative and gumption as an undergraduate student, and how he became interested in security and privacy, working on peer-to-peer systems before cloud computing became ubiquitous. He discusses his work on Coral CDN during his PhD research, applying research outcomes to build scalable systems and learning to harness customer feedback good user experience. Michael also talks extensively about Timescale, one of the fastest databases for real-time analytics, or time series data, and explains the roles of CTO and head engineer at a technology company.

In this episode of ACM ByteCast, our special guest host Scott Hanselman (of The Hanselminutes Podcast) welcomes ACM Fellow Peter Lee, President of Microsoft Research. As leader of Microsoft Research, Peter incubates new research-powered products and lines of business in areas such as AI, computing foundations, health, and life sciences. Before Microsoft, he established a new technology office that created operational capabilities in ML, data science, and computational social science at DARPA, and before that he was head of the CS department at CMU. Peter served on President Obama’s Commission on Enhancing National Cybersecurity and has testified before both the US House Science and Technology Committee and the US Senate Commerce Committee. He coauthored the bestselling book The AI Revolution in Medicine: GPT-4 and Beyond. In 2024, he was named by Time magazine as one of the 100 most influential people in health and life sciences. In the interview, Peter reflects on his 40+ years in computer science, from working on PDP-11s and Commodore Amigas to modern AI advancements. He highlights how modern technologies, built on decades of research, have become indispensable. He also talks about his healthcare journey, including work that earned him election to the National Academy of Medicine, and the potential (and limitations) of AI in medicine. Peter and Scott touch on the impact of LLMs, the lack of ethics education in traditional CS curricula, the challenges posed by growing AI complexity. Peter also highlights some important Microsoft Research work in AI for Science and Quantum Computing.

In this episode of ACM ByteCast, our special guest host Scott Hanselman (of The Hanselminutes Podcast) welcomes Mary Lou Jepsen, CEO and Founder of Openwater, a technical executive and inventor in the fields of display, imaging, and computer hardware with about 300 patents published or issued to her name. She founded and led two moonshots at Google X and was later an executive at Facebook/Oculus VR. Prior to this, she was a professor at the MIT Media Lab, where she co-founded and was the first CTO of One Laptop per Child (OLPC), and later founded Pixel Qi in Taipei, Taiwan, focused on the design and manufacture of displays. Jepsen has been named as one of the 100 most influential people in the world by Time Magazine (“Time 100”), CNN’s top “10 thinkers” in science and technology and has won numerous awards numerous from professional societies in the fields of optics, display, and electronics. She’s a frequent keynote speaker, has given two highly viewed TED talks, and is frequently featured in top global press publications. Mary Lou discusses her work with Openwater, a startup working on innovative imaging technology using infrared light, ultrasound, and electromagnetics to diagnose and potentially treat diseases, and aims to leapfrog traditional drug development. She and Scott talk about the role of patents in manufacturing, and regulatory and technological barriers in healthcare innovation. They also dive into the advantages of the company’s open-source model, both for its software and hardware designs. Mary Lou highlights some of their breakthroughs, including stroke detection and non-invasive cancer treatment. She also talks about reducing cost and scaling production, next steps in clinical trials, and future possibilities with open source.

In this episode of ACM ByteCast, Rashmi Mohan hosts Travis S. Humble, Director of the Quantum Science Center (QSC), a Distinguished Scientist at Oak Ridge National Laboratory, and Director of the lab’s Quantum Computing Institute. He leads the development of new quantum technologies and infrastructure to impact the DOE mission of scientific discovery through quantum computing. As director of the QSC, Travis leads the innovation of scalable, resilient quantum information technologies through new materials, devices, and algorithms and facilitates the transfer of quantum technologies to the broadest audience. He also holds a joint faculty appointment with the University of Tennessee Bredesen Center for Interdisciplinary Research and Graduate Education working with students on energy-efficient computing solutions. Travis is Editor-in-Chief for ACM Transactions on Quantum Computing, Associate Editor for Quantum Information Processing, and Co-Chair of the IEEE Quantum Initiative.  Travis describes his journey into quantum computing, which began in theoretical chemistry, where he studied quantum processes in chemical reactions. He explains the difference between classical and quantum computing and why quantum computing is particularly well suited for scientific applications such as drug discovery and energy solutions. He talks about Oak Ridge’s quantum computing resources and how researchers can access them. Travis also stresses the role education in advancing quantum computing and shares his predictions for its near future.

In this episode of ACM ByteCast, Harald Störrle hosts Darja Smite, Professor of Software Engineering at Blekinge Institute of Technology and a part-time research scientist at SINTEF ICT. Darja is an expert on the future of work and the impact of globalization and offshoring in software companies. She has conducted research with and international companies such as ABB, Boss Media, CALVI, DXC, Emerson Process Management, Ericsson, SONY, Spotify, and, Telenor and has insights from cooperating with offshore vendors in India, China, Poland, Latvia, Ukraine and Russia. Darja shares her background, growing up in Latvia with a love for math, and later moving to Sweden for work and Norway to conduct research at SINTEF, one of Europe's largest independent research organizations. She shares some of her research findings on outsourcing and discusses the effect automation will have on outsourcing and profitability. She also discusses reasons why people stay or leave their jobs, as well as cultural differences and the challenge of people from different cultures finding common ground. Darja also touches on the impact of COVID on work practices in the past five years and offers advice for people considering a career in IT.