This page is currently being updated with full paper details. Please check back soon!

Efficient Fine-Grained GPU Performance Modeling for Distributed Deep Learning of LLM

Biyao Zhang¹, Mingkai Zheng², Debargha Ganguly¹, Xuecen Zhang¹, Vikash Singh¹, Vipin Chaudhary¹, Zhao Zhang²

¹Case Western Reserve University, Cleveland, OH, USA
²Rutgers University, Brunswick, NJ, USA