基准测试很难：CMS 工作负载基准测试的“密封”容器.pdf

1、Grant Mackey,Jackrabbit LabsVikrant Soman,UberBenchmarking is HARD:A Hermetically Sealed Container for CMS Workload BenchmarkingSERVER:COMPOSABLE MEMORY SYSTEMS(CMS)CMS project provides end users the ability to deploy a variety of native and pooled memory solutions using industry standard device cap

2、abilities and configurationsFor end-user adoption its important to be able to map the right CMS solution to the right workload configurations via benchmarks to realize TCO benefitsCMSBench announced on github to provide the community ability to access benchmark configs and results run against variou

3、s CMS solutions Challenges to adoption of this repo-How do I trust the results?How can I setup and configure the benchmarks easily?What benchmarks should I be running to evaluate a specific CMS solution?Executive SummaryNew folder structure aligned with CMS solutions and workload configurations that

4、 help TCO analysis(more in the next talk)Hermetically sealed container to make it easy to run the benchmarks Immutable container config during execution to build trust in the submitted resultsRebooting CMSBench to address adoption challenges Host w/Firmware,OS&VMMDDRCXL.memPCIeDRAMCXL Memory Buffer(

5、Direct Attached)CXL ControllerMedia CPUMemory controllerApplication server using CXL memory onlyApplication server using DRAM main memory onlyTopology specific foldersDocker compose files for specific benchmarks CMSBench github overviewHermetically sealed(adjective)/hmet.kl.i sild/:separated and pro

6、tected from very different conditions outside.A container or space tightly closed that no air can leave or enter it.Runtime containers are very good at capturing and replicating a software stack suitable for the task it is made to execute,and can drastically simplify execution of said taskDocker bui