Large scale analytics for workload segmentation

Abstract

As the complexity and size of workload landscapes continue to evolve, traditional tools that are useful for characterizing workloads have gradually become inadequate. Approaches such as scaling studies or isolated analyses of a single workload are gradually becoming insufficient to understand the broad state of the workload universe. To address this problem, we follow a machine learning methodology to leverage large numbers of workload experiments that already exist on Intel. We advanced a workload analysis platform that stores, manages, and facilitates the analysis of workload information using two big data analysis software tools, a top-down workload decision classifier and a workload universe mapping tool, to characterize large-scale workloads. Both analysis tools present a novel way to look at workload data from a higher level and consider these new characteristics at the workload segmentation level. We seek to achieve this goal in alignment with the strategic goals of developing new benchmarks, informing market sizing, and detecting emerging workloads.