52 min read

SPEC vs SPEC

- Benchmark hacking

SPEC CPU 2006 benchmark is retired in January 2018 and replaced by the SPEC CPU 2017 suite https://www.spec.org/retired.html#cpu

What are you going to do while your faivorite CPUs are not tested in SPEC CPU 2017?

Since Estimates are allowed you can download all records as CSV and find conversion coefficient. https://www.spec.org/cgi-bin/osgresults?conf=rint2006 https://www.spec.org/cgi-bin/osgresults?conf=rint2017

rint_Result_2017 = 0.1062927 x rint_Result_2006

## Saving 7 x 5 in image
## 
## Call:
## lm(formula = Result_2017 ~ Result_2006 + 0, data = spec_vs_spec)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -257.468   -3.228   -0.522    2.581   60.780 
## 
## Coefficients:
##              Estimate Std. Error t value Pr(>|t|)    
## Result_2006 0.1062927  0.0002263   469.7   <2e-16 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 15.43 on 620 degrees of freedom
## Multiple R-squared:  0.9972, Adjusted R-squared:  0.9972 
## F-statistic: 2.206e+05 on 1 and 620 DF,  p-value: < 2.2e-16

You can leave comments under video about this blog post https://youtu.be/hXMpDZ8sfd0 or on Twitter.