Flashlight: PyTorch Compiler Extensions to Accelerate Attention Variants
Bozhi You, Irene Wang, Z. Mustafaoglu, Abhinav Jangda, Angelica Moreira, Roshan Dathathri, Divya Mahajan, K. Pingali
9th MLSys Conference 2026 | May 2026
Roshan Dathathri
Principal Researcher
Publications
-
-
-
Flashlight: A PyTorch Compiler Framework for Accelerating Attention Variants
Bozhi You, Irene Wang, Zelal Su Mustafaoglu, Abhinav Jangda, Angelica Moreira, Roshan Dathathri, Divya Mahajan, Keshav Pingali
Ninth Annual Conference on Machine Learning and Systems (MLSys) | May 2026
-
MSCCL++: Rethinking GPU Communication Abstractions for AI Inference
Changho Hwang, Peng Cheng, Roshan Dathathri, Abhinav Jangda, Saeed Maleki, Madan Musuvathi, Olli Saarikivi, Aashaka Shah, Ziyue Yang, Binyang Li, Caio Rocha, Qinghua Zhou, Mahdieh Ghazimirsaeed, Sreevatsa Anantharamu, Jithin Jose
ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2026
Best Paper - Honorable Mention
-
-
-
Kimbap: A Node-Property Map System for Distributed Graph Analytics
Hochan Lee, Roshan Dathathri, Keshav Pingali
Architectural Support for Programming Languages and Operating Systems | April 2024
-
-
-
EVA: An Encrypted Vector Arithmetic Language and Compiler for Efficient Homomorphic Computation
Roshan Dathathri, Blagovesta Kostova, Olli Saarikivi, Wei Dai, Kim Laine, Madan Musuvathi
PLDI 2020 | June 2020
-
-
-
CHET: An Optimizing Compiler for Fully-Homomorphic Neural-Network Inferencing
Roshan Dathathri, Olli Saarikivi, Hao Chen, Kim Laine, Kristin Lauter, Saeed Maleki, Madan Musuvathi, Todd Mytkowicz
PLDI 2019 | June 2019
-
-
-
Flashlight: PyTorch Compiler Extensions to Accelerate Attention Variants
Bozhi You, Irene Wang, Z. Mustafaoglu, Abhinav Jangda, Angelica Moreira, Roshan Dathathri, Divya Mahajan, K. Pingali
9th MLSys Conference 2026 | May 2026
-
-
-
Flashlight: PyTorch Compiler Extensions to Accelerate Attention Variants
Bozhi You, Irene Wang, Z. Mustafaoglu, Abhinav Jangda, Angelica Moreira, Roshan Dathathri, Divya Mahajan, K. Pingali
9th MLSys Conference 2026 | May 2026
-
Flashlight: A PyTorch Compiler Framework for Accelerating Attention Variants
Bozhi You, Irene Wang, Zelal Su Mustafaoglu, Abhinav Jangda, Angelica Moreira, Roshan Dathathri, Divya Mahajan, Keshav Pingali
Ninth Annual Conference on Machine Learning and Systems (MLSys) | May 2026
-
MSCCL++: Rethinking GPU Communication Abstractions for AI Inference
Changho Hwang, Peng Cheng, Roshan Dathathri, Abhinav Jangda, Saeed Maleki, Madan Musuvathi, Olli Saarikivi, Aashaka Shah, Ziyue Yang, Binyang Li, Caio Rocha, Qinghua Zhou, Mahdieh Ghazimirsaeed, Sreevatsa Anantharamu, Jithin Jose
ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2026
Best Paper - Honorable Mention
-
Kimbap: A Node-Property Map System for Distributed Graph Analytics
Hochan Lee, Roshan Dathathri, Keshav Pingali
Architectural Support for Programming Languages and Operating Systems | April 2024
-
-
-
Flashlight: A PyTorch Compiler Framework for Accelerating Attention Variants
Bozhi You, Irene Wang, Zelal Su Mustafaoglu, Abhinav Jangda, Angelica Moreira, Roshan Dathathri, Divya Mahajan, Keshav Pingali
Ninth Annual Conference on Machine Learning and Systems (MLSys) | May 2026
-
MSCCL++: Rethinking GPU Communication Abstractions for AI Inference
Changho Hwang, Peng Cheng, Roshan Dathathri, Abhinav Jangda, Saeed Maleki, Madan Musuvathi, Olli Saarikivi, Aashaka Shah, Ziyue Yang, Binyang Li, Caio Rocha, Qinghua Zhou, Mahdieh Ghazimirsaeed, Sreevatsa Anantharamu, Jithin Jose
ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2026
Best Paper - Honorable Mention
-
Kimbap: A Node-Property Map System for Distributed Graph Analytics
Hochan Lee, Roshan Dathathri, Keshav Pingali
Architectural Support for Programming Languages and Operating Systems | April 2024
-
CHET: An Optimizing Compiler for Fully-Homomorphic Neural-Network Inferencing
Roshan Dathathri, Olli Saarikivi, Hao Chen, Kim Laine, Kristin Lauter, Saeed Maleki, Madan Musuvathi, Todd Mytkowicz
PLDI 2019 | June 2019
-
-
-
EVA: An Encrypted Vector Arithmetic Language and Compiler for Efficient Homomorphic Computation
Roshan Dathathri, Blagovesta Kostova, Olli Saarikivi, Wei Dai, Kim Laine, Madan Musuvathi
PLDI 2020 | June 2020
-
CHET: An Optimizing Compiler for Fully-Homomorphic Neural-Network Inferencing
Roshan Dathathri, Olli Saarikivi, Hao Chen, Kim Laine, Kristin Lauter, Saeed Maleki, Madan Musuvathi, Todd Mytkowicz
PLDI 2019 | June 2019
-
-
-
Flashlight: PyTorch Compiler Extensions to Accelerate Attention Variants
Bozhi You, Irene Wang, Z. Mustafaoglu, Abhinav Jangda, Angelica Moreira, Roshan Dathathri, Divya Mahajan, K. Pingali
9th MLSys Conference 2026 | May 2026
-
Flashlight: A PyTorch Compiler Framework for Accelerating Attention Variants
Bozhi You, Irene Wang, Zelal Su Mustafaoglu, Abhinav Jangda, Angelica Moreira, Roshan Dathathri, Divya Mahajan, Keshav Pingali
Ninth Annual Conference on Machine Learning and Systems (MLSys) | May 2026
-
MSCCL++: Rethinking GPU Communication Abstractions for AI Inference
Changho Hwang, Peng Cheng, Roshan Dathathri, Abhinav Jangda, Saeed Maleki, Madan Musuvathi, Olli Saarikivi, Aashaka Shah, Ziyue Yang, Binyang Li, Caio Rocha, Qinghua Zhou, Mahdieh Ghazimirsaeed, Sreevatsa Anantharamu, Jithin Jose
ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2026
Best Paper - Honorable Mention
-
Kimbap: A Node-Property Map System for Distributed Graph Analytics
Hochan Lee, Roshan Dathathri, Keshav Pingali
Architectural Support for Programming Languages and Operating Systems | April 2024
-
EVA: An Encrypted Vector Arithmetic Language and Compiler for Efficient Homomorphic Computation
Roshan Dathathri, Blagovesta Kostova, Olli Saarikivi, Wei Dai, Kim Laine, Madan Musuvathi
PLDI 2020 | June 2020
-
CHET: An Optimizing Compiler for Fully-Homomorphic Neural-Network Inferencing
Roshan Dathathri, Olli Saarikivi, Hao Chen, Kim Laine, Kristin Lauter, Saeed Maleki, Madan Musuvathi, Todd Mytkowicz
PLDI 2019 | June 2019
-