Skip to content

Commit

Permalink
Auto-merge updates from auto-update branch
Browse files Browse the repository at this point in the history
  • Loading branch information
mlcommons-bot committed Jan 1, 2025
2 parents 3e43c3e + a2801ec commit cb6a67d
Show file tree
Hide file tree
Showing 122 changed files with 25,066 additions and 25,104 deletions.
Original file line number Diff line number Diff line change
@@ -1 +1,2 @@
hash=45991cc797d516718c2278e3139f534c1798ffc5832ae5009be749c49e69411c

hash=1869d7a0a9e524f735f7d3b1bb1435b249e16629dff1fef578b553fa636dd7b0

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
Expand Up @@ -4,35 +4,35 @@ MLPerf Results Summary
SUT name : LWIS_Server
Scenario : MultiStream
Mode : PerformanceOnly
99th percentile latency (ns) : 10905990
99th percentile latency (ns) : 10923863
Result is : VALID
Min duration satisfied : Yes
Min queries satisfied : Yes
Early stopping satisfied: Yes
Early Stopping Result:
* Processed at least 662 queries (55677).
* Processed at least 662 queries (55693).
* Would discard 501 highest latency queries.
* Early stopping 99th percentile estimate: 10912316
* Early stopping 99th percentile estimate: 10931085

================================================
Additional Stats
================================================
Per-query latency:
Min latency (ns) : 10510144
Max latency (ns) : 11527091
Mean latency (ns) : 10738958
50.00 percentile latency (ns) : 10734688
90.00 percentile latency (ns) : 10827668
95.00 percentile latency (ns) : 10850422
97.00 percentile latency (ns) : 10861010
99.00 percentile latency (ns) : 10905990
99.90 percentile latency (ns) : 11021942
Min latency (ns) : 10535046
Max latency (ns) : 11471887
Mean latency (ns) : 10738125
50.00 percentile latency (ns) : 10733490
90.00 percentile latency (ns) : 10827990
95.00 percentile latency (ns) : 10849996
97.00 percentile latency (ns) : 10860358
99.00 percentile latency (ns) : 10923863
99.90 percentile latency (ns) : 11037146

================================================
Test Parameters Used
================================================
samples_per_query : 8
target_qps : 232.871
target_qps : 232.339
target_latency (ns): 0
max_async_queries : 1
min_duration (ms): 600000
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
Verifying performance.
reference score = 10899176
test score = 10912316
reference score = 10957955
test score = 10931085
TEST PASS
Original file line number Diff line number Diff line change
@@ -1 +1,2 @@
hash=479a56bbd5a13ed13fb0e20dbe8320fa540ef7965e509d32cd6059dd730464ed

hash=7bcfae3cb42049effef83f2a7a1d22cc9442e20425843c18de386dcdadca91f8

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ MLPerf Results Summary
SUT name : LWIS_Server
Scenario : Offline
Mode : PerformanceOnly
Samples per second: 862.916
Samples per second: 864.152
Result is : VALID
Min duration satisfied : Yes
Min queries satisfied : Yes
Expand All @@ -13,21 +13,21 @@ Result is : VALID
================================================
Additional Stats
================================================
Min latency (ns) : 5750380
Max latency (ns) : 665548920533
Mean latency (ns) : 332197218855
50.00 percentile latency (ns) : 332103606263
90.00 percentile latency (ns) : 598837671958
95.00 percentile latency (ns) : 632224012861
97.00 percentile latency (ns) : 645563358548
99.00 percentile latency (ns) : 658881212252
99.90 percentile latency (ns) : 664876282230
Min latency (ns) : 5857395
Max latency (ns) : 665487988375
Mean latency (ns) : 332133000326
50.00 percentile latency (ns) : 332044511243
90.00 percentile latency (ns) : 598723176562
95.00 percentile latency (ns) : 632096376023
97.00 percentile latency (ns) : 645444786210
99.00 percentile latency (ns) : 658797572160
99.90 percentile latency (ns) : 664810860394

================================================
Test Parameters Used
================================================
samples_per_query : 574313
target_qps : 870.172
samples_per_query : 575083
target_qps : 871.338
target_latency (ns): 0
max_async_queries : 1
min_duration (ms): 600000
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,8 @@ Reading performance mode results...
num_acc_log_entries = 24781
num_acc_log_duplicate_keys = 0
num_acc_log_data_mismatch = 0
num_perf_log_entries = 258
num_perf_log_qsl_idx_match = 258
num_perf_log_entries = 256
num_perf_log_qsl_idx_match = 256
num_perf_log_data_mismatch = 0
num_missing_qsl_idxs = 0
TEST PASS
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
Verifying performance.
reference score = 861.556
test score = 862.916
reference score = 862.711
test score = 864.152
TEST PASS
Original file line number Diff line number Diff line change
@@ -1 +1,2 @@
hash=d3ded21923fa0172329a5477dbb009707a7e8d59e857daeeb7663d1edbe6ea34

hash=49faa4eae471defba3035096cdf69af049be97f2e377697ea51129e09234c789

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
Expand Up @@ -18,15 +18,15 @@ Additional Stats
================================================
Completed samples per second : 611.66

Min latency (ns) : 2287330
Max latency (ns) : 33562366
Mean latency (ns) : 14138085
50.00 percentile latency (ns) : 14037092
90.00 percentile latency (ns) : 18906924
95.00 percentile latency (ns) : 20158026
97.00 percentile latency (ns) : 21187212
99.00 percentile latency (ns) : 23403139
99.90 percentile latency (ns) : 27654920
Min latency (ns) : 2311304
Max latency (ns) : 33610838
Mean latency (ns) : 14231788
50.00 percentile latency (ns) : 14128256
90.00 percentile latency (ns) : 19045217
95.00 percentile latency (ns) : 20352423
97.00 percentile latency (ns) : 21401337
99.00 percentile latency (ns) : 23653453
99.90 percentile latency (ns) : 27843452

================================================
Test Parameters Used
Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
Verifying performance.
reference score = 637.17
reference score = 637.18
test score = 611.66
TEST PASS
Original file line number Diff line number Diff line change
@@ -1 +1,2 @@
hash=28f90fe7162d03bc83b2c814138e4090b59e84547f5590705b4f6a64bdfb5d34

hash=5e2ed3676724db5d924021bdacdc4d665bd086b41f17b725766a7cce737559b0

Large diffs are not rendered by default.

Loading

0 comments on commit cb6a67d

Please sign in to comment.