1<!DOCTYPE html> 2<html> 3 4<head> 5 <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> 6 <title>{title} - Criterion.rs</title> 7 <style type="text/css"> 8 body \{ 9 font: 14px Helvetica Neue; 10 text-rendering: optimizelegibility; 11 } 12 13 .body \{ 14 width: 960px; 15 margin: auto; 16 } 17 18 th \{ 19 font-weight: 200 20 } 21 22 th, 23 td \{ 24 padding-right: 3px; 25 padding-bottom: 3px; 26 } 27 28 a:link \{ 29 color: #1F78B4; 30 text-decoration: none; 31 } 32 33 th.ci-bound \{ 34 opacity: 0.6 35 } 36 37 td.ci-bound \{ 38 opacity: 0.5 39 } 40 41 .stats \{ 42 width: 80%; 43 margin: auto; 44 display: flex; 45 } 46 47 .additional_stats \{ 48 flex: 0 0 60% 49 } 50 51 .additional_plots \{ 52 flex: 1 53 } 54 55 h2 \{ 56 font-size: 36px; 57 font-weight: 300; 58 } 59 60 h3 \{ 61 font-size: 24px; 62 font-weight: 300; 63 } 64 65 #footer \{ 66 height: 40px; 67 background: #888; 68 color: white; 69 font-size: larger; 70 font-weight: 300; 71 } 72 73 #footer a \{ 74 color: white; 75 text-decoration: underline; 76 } 77 78 #footer p \{ 79 text-align: center 80 } 81 </style> 82</head> 83 84<body> 85 <div class="body"> 86 <h2>{title}</h2> 87 <div class="absolute"> 88 <section class="plots"> 89 <table width="100%"> 90 <tbody> 91 <tr> 92 <td> 93 <a href="pdf.svg"> 94 <img src="pdf_small.svg" alt="PDF of Slope" width="{thumbnail_width}" height="{thumbnail_height}" /> 95 </a> 96 </td> 97 <td> 98 {{- if slope }} 99 <a href="regression.svg"> 100 <img src="regression_small.svg" alt="Regression" width="{thumbnail_width}" height="{thumbnail_height}" /> 101 </a> 102 {{- else }} 103 <a href="iteration_times.svg"> 104 <img src="iteration_times_small.svg" alt="Iteration Times" width="{thumbnail_width}" height="{thumbnail_height}" /> 105 </a> 106 {{- endif }} 107 </td> 108 </tr> 109 </tbody> 110 </table> 111 </section> 112 <section class="stats"> 113 <div class="additional_stats"> 114 <h4>Additional Statistics:</h4> 115 <table> 116 <thead> 117 <tr> 118 <th></th> 119 <th title="{confidence} confidence level" class="ci-bound">Lower bound</th> 120 <th>Estimate</th> 121 <th title="{confidence} confidence level" class="ci-bound">Upper bound</th> 122 </tr> 123 </thead> 124 <tbody> 125 {{- if slope }} 126 <tr> 127 <td>Slope</td> 128 <td class="ci-bound">{slope.lower}</td> 129 <td>{slope.point}</td> 130 <td class="ci-bound">{slope.upper}</td> 131 </tr> 132 {{- endif }} 133 {{- if throughput }} 134 <tr> 135 <td>Throughput</td> 136 <td class="ci-bound">{throughput.lower}</td> 137 <td>{throughput.point}</td> 138 <td class="ci-bound">{throughput.upper}</td> 139 </tr> 140 {{- endif }} 141 <tr> 142 <td>R²</td> 143 <td class="ci-bound">{r2.lower}</td> 144 <td>{r2.point}</td> 145 <td class="ci-bound">{r2.upper}</td> 146 </tr> 147 <tr> 148 <td>Mean</td> 149 <td class="ci-bound">{mean.lower}</td> 150 <td>{mean.point}</td> 151 <td class="ci-bound">{mean.upper}</td> 152 </tr> 153 <tr> 154 <td title="Standard Deviation">Std. Dev.</td> 155 <td class="ci-bound">{std_dev.lower}</td> 156 <td>{std_dev.point}</td> 157 <td class="ci-bound">{std_dev.upper}</td> 158 </tr> 159 <tr> 160 <td>Median</td> 161 <td class="ci-bound">{median.lower}</td> 162 <td>{median.point}</td> 163 <td class="ci-bound">{median.upper}</td> 164 </tr> 165 <tr> 166 <td title="Median Absolute Deviation">MAD</td> 167 <td class="ci-bound">{mad.lower}</td> 168 <td>{mad.point}</td> 169 <td class="ci-bound">{mad.upper}</td> 170 </tr> 171 </tbody> 172 </table> 173 </div> 174 {{- if additional_plots }} 175 <div class="additional_plots"> 176 <h4>Additional Plots:</h4> 177 <ul> 178 {{for plot in additional_plots }} 179 <li> 180 <a href="{plot.url}">{plot.name}</a> 181 </li> 182 {{- endfor }} 183 </ul> 184 </div> 185 {{- endif }} 186 </section> 187 <section class="explanation"> 188 <h4>Understanding this report:</h4> 189 <p>The plot on the left displays the average time per iteration for this benchmark. The shaded region 190 shows the estimated probability of an iteration taking a certain amount of time, while the line 191 shows the mean. Click on the plot for a larger view showing the outliers.</p> 192 {{- if slope }} 193 <p>The plot on the right shows the linear regression calculated from the measurements. Each point 194 represents a sample, though here it shows the total time for the sample rather than time per 195 iteration. The line is the line of best fit for these measurements.</p> 196 {{- else }} 197 <p>The plot on the right shows the average time per iteration for the samples. Each point 198 represents one sample.</p> 199 {{- endif }} 200 <p>See <a href="https://bheisler.github.io/criterion.rs/book/user_guide/command_line_output.html#additional-statistics">the 201 documentation</a> for more details on the additional statistics.</p> 202 </section> 203 </div> 204 {{- if comparison }} 205 <section class="plots"> 206 <h3>Change Since Previous Benchmark</h3> 207 <div class="relative"> 208 <table width="100%"> 209 <tbody> 210 <tr> 211 <td> 212 <a href="both/pdf.svg"> 213 <img src="relative_pdf_small.svg" alt="PDF Comparison" width="{thumbnail_width}" 214 height="{thumbnail_height}" /> 215 </a> 216 </td> 217 <td> 218 {{- if slope }} 219 <a href="both/regression.svg"> 220 <img src="relative_regression_small.svg" alt="Regression Comparison" width="{thumbnail_width}" 221 height="{thumbnail_height}" /> 222 </a> 223 {{- else }} 224 <a href="both/iteration_times.svg"> 225 <img src="relative_iteration_times_small.svg" alt="Iteration Time Comparison" width="{thumbnail_width}" 226 height="{thumbnail_height}" /> 227 </a> 228 {{- endif }} 229 </td> 230 </tr> 231 </tbody> 232 </table> 233 </div> 234 </section> 235 <section class="stats"> 236 <div class="additional_stats"> 237 <h4>Additional Statistics:</h4> 238 <table> 239 <thead> 240 <tr> 241 <th></th> 242 <th title="{confidence} confidence level" class="ci-bound">Lower bound</th> 243 <th>Estimate</th> 244 <th title="{confidence} confidence level" class="ci-bound">Upper bound</th> 245 <th></th> 246 </tr> 247 </thead> 248 <tbody> 249 <tr> 250 <td>Change in time</td> 251 <td class="ci-bound">{comparison.change.lower}</td> 252 <td>{comparison.change.point}</td> 253 <td class="ci-bound">{comparison.change.upper}</td> 254 <td>(p = {comparison.p_value} {comparison.inequality} 255 {comparison.significance_level})</td> 256 </tr> 257 {{- if comparison.thrpt_change }} 258 <tr> 259 <td>Change in throughput</td> 260 <td class="ci-bound">{comparison.thrpt_change.lower}</td> 261 <td>{comparison.thrpt_change.point}</td> 262 <td class="ci-bound">{comparison.thrpt_change.upper}</td> 263 <td></td> 264 </tr> 265 {{- endif }} 266 </tbody> 267 </table> 268 {comparison.explanation} 269 </div> 270 {{- if comparison.additional_plots }} 271 <div class="additional_plots"> 272 <h4>Additional Plots:</h4> 273 <ul> 274 {{ for plot in comparison.additional_plots }} 275 <li> 276 <a href="{plot.url}">{plot.name}</a> 277 </li> 278 {{- endfor }} 279 </ul> 280 </div> 281 {{- endif }} 282 </section> 283 <section class="explanation"> 284 <h4>Understanding this report:</h4> 285 <p>The plot on the left shows the probability of the function taking a certain amount of time. The red 286 curve represents the saved measurements from the last time this benchmark was run, while the blue curve 287 shows the measurements from this run. The lines represent the mean time per iteration. Click on the 288 plot for a larger view.</p> 289 {{- if slope }} 290 <p>The plot on the right shows the two regressions. Again, the red line represents the previous measurement 291 while the blue line shows the current measurement.</p> 292 {{- else }} 293 <p>The plot on the right shows the iteration times for the two measurements. Again, the red dots represent 294 the previous measurement while the blue dots show the current measurement.</p> 295 {{- endif}} 296 <p>See <a href="https://bheisler.github.io/criterion.rs/book/user_guide/command_line_output.html#change">the 297 documentation</a> for more details on the additional statistics.</p> 298 </section> 299 {{- endif }} 300 </div> 301 <div id="footer"> 302 <p>This report was generated by 303 <a href="https://github.com/bheisler/criterion.rs">Criterion.rs</a>, a statistics-driven benchmarking 304 library in Rust.</p> 305 </div> 306</body> 307 308</html>
