Steven S. Lyubomirsky

sslyu (at) cs.washington.edu

I am a Senior Software Engineer at NVIDIA. Previously, I was a Machine Learning Systems Engineer at OctoAI/OctoML (since acquired by NVIDIA), where I contributed to Apache TVM and, in particular, the design of the Relax language. My background is in programming languages: I defended my dissertation at the University of Washington, which I completed under the supervision of Prof. Zachary Tatlock in the Programming Languages and Software Engineering group.

I am broadly interested in compilers and tools related to compilers, such as in producing tools to enable new kinds of programming, including tools built on proof assistants and SMT solvers to develop programs with proven correctness properties and compilers for domain-specific languages that better encode expert knowledge to achieve greater performance and expressiveness.

During my graduate studies, I did research with the SAMPL group, which is an interdisciplinary research group holistically exploring problems spanning the machine learning stack. I worked on projects related to TVM Relay, whose purpose is to enable new abstractions and optimizations in machine-learning frameworks by providing an expressive intermediate representation and new compilation pipeline for TVM, for which I am a committer.

I also previously worked on the Bagpipe project, for verifying BGP configurations. An offshoot of the Bagpipe project is the SpaceSearch library, allowing for reasoning about the reduction of a problem to SMT in Coq and then extracting the proof of correctness to a solver-aided tool in Rosette.

During my graduate studies, I came to be associated with a certain doctrine for managing research projects, which I have modestly named after myself: lex Lyubomiricus.

I am not a member of the PLSE running club, Race Condition Running. I am, however, the only member of the Mutual Exclusion Walking Association. Its membership is very exclusive. In fact, no one can join because the waiting list is deadlocked.

Publications

Dissertation

Compiler and Runtime Techniques for Optimizing Deep Learning Applications. 2022. Reading Committee: Zachary Tatlock (chair), Luis Ceze, and Kevin Jamieson. PDF. Defense (public session).

Conference and Journal Papers

Gus Henry Smith, Benjamin Kushigian, Vishal Canumalla, Andrew Cheung, Steven Lyubomirsky, Sorawee Porncharoenwase, René Just, Gilbert Louis Bernstein, and Zachary Tatlock. 2024. FPGA Technology Mapping Using Sketch-Guided Program Synthesis. In Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2 (ASPLOS '24), Vol. 2. Association for Computing Machinery, New York, NY, USA, 416–432. https://doi.org/10.1145/3620665.3640387. ArXiv link.

Bo-Yuan Huang*, Steven Lyubomirsky*, Yi Li, Mike He, Gus Henry Smith, Thierry Tambe, Akash Gaonkar, Vishal Canumalla, Andrew Cheung, Gu-Yeon Wei, Aarti Gupta, Zachary Tatlock, and Sharad Malik. 2023. Application-Level Validation of Accelerator Designs Using a Formal Software/Hardware Interface. ACM Trans. Des. Autom. Electron. Syst. December 2023. https://doi.org/10.1145/3639051. (*Equal contribution.)

Marisa Kirisame*, Steven Lyubomirsky*, Altan Haan*, Jennifer Brennan, Mike He, Jared Roesch, Tianqi Chen, and Zachary Tatlock. 2021. Dynamic Tensor Rematerialization. ICLR 2021 (spotlight). ArXiv link. Recorded talk. Conference page. (*Equal contribution.)

Konstantin Weitz, Steven Lyubomirsky, Stefan Heule, Emina Torlak, Michael D. Ernst, and Zachary Tatlock. 2017. SpaceSearch: a library for building and verifying solver-aided tools. Proc. ACM Program. Lang. 1, ICFP, Article 25 (August 2017), 28 pages. DOI: https://doi.org/10.1145/3110269

Workshop Papers

Gus Henry Smith, Andrew Liu, Steven Lyubomirsky, Scott Davidson, Joseph McMahan, Michael Taylor, Luis Ceze, and Zachary Tatlock. 2021. Pure Tensor Program Rewriting via Access Patterns (Representation Pearl). In Proceedings of the 5th ACM SIGPLAN International Symposium on Machine Programming (MAPS 2021). Association for Computing Machinery, New York, NY, USA, 21–31. DOI: https://doi.org/10.1145/3460945.3464953. ArXiv: https://arxiv.org/abs/2105.09377.

Bo-Yuan Huang*, Steven Lyubomirsky*, Thierry Tambe*, Yi Li, Mike He, Gus Smith, Gu-Yeon Wei, Aarti Gupta, Sharad Malik, and Zachary Tatlock. 2021. From DSLs to Accelerator-Rich Platform Implementations: Addressing the Mapping Gap. LATTE '21 (ASPLOS Workshop). https://capra.cs.cornell.edu/latte21/paper/30.pdf. Recorded talk. (*Equal contribution.)

Jared Roesch, Steven Lyubomirsky, Logan Weber, Josh Pollock, Marisa Kirisame, Tianqi Chen, and Zachary Tatlock. 2018. Relay: a new IR for machine learning frameworks. In Proceedings of the 2nd ACM SIGPLAN International Workshop on Machine Learning and Programming Languages (MAPL 2018). ACM, New York, NY, USA, 58-68. DOI: https://dl.acm.org/citation.cfm?doid=3211346.3211348

Preprints

Ruihang Lai, Junru Shao, Siyuan Feng, Steven S. Lyubomirsky, Bohan Hou, Wuwei Lin, Zihao Ye, Hongyi Jin, Yuchen Jin, Jiawei Liu, Lesheng Jin, Yaxing Cai, Ziheng Jiang, Yong Wu, Sunghyun Park, Prakalp Srivastava, Jared G. Roesch, Todd C. Mowry, and Tianqi Chen. 2023. Relax: Composable Abstractions for End-to-End Dynamic Machine Learning. ArXiv:2311.02103 [cs.LG], arXiv.org, https://arxiv.org/abs/2311.02103

Jared Roesch, Steven Lyubomirsky, Marisa Kirisame, Logan Weber, Josh Pollock, Luis Vega, Ziheng Jiang, Tianqi Chen, Thierry Moreau, and Zachary Tatlock. 2019. Relay: A High-Level Compiler for Deep Learning. ArXiv:1904.08368 [Cs, Stat], arXiv.org, http://arxiv.org/abs/1904.08368.

Academic Service

Note: My website's background is a late Victorian pattern from William Morris and Co.