System-Aware Optimization For Machine Learning At Scale