From 146270918773698a3437f1ca373cba1b8e923a5e Mon Sep 17 00:00:00 2001 From: guschmue Date: Mon, 7 Sep 2020 16:35:28 -0700 Subject: [PATCH] create r0.7 branch --- README.md | 33 +++++++++------------------------ 1 file changed, 9 insertions(+), 24 deletions(-) diff --git a/README.md b/README.md index ac23e8474..7097d3c39 100644 --- a/README.md +++ b/README.md @@ -14,32 +14,17 @@ Please see the [MLPerf Inference benchmark paper](https://arxiv.org/abs/1911.025 } ``` -## MLPerf Inference master -The master of this repository contains work in progress for the next official release. This is currently ***v0.7***. -It provides the benchmarks below. - -See the individual Readme files in the reference app for details. - - -| model | reference app | framework | dataset | -| ---- | ---- | ---- | ---- | -| resnet50-v1.5 | [vision/classification_and_detection](vision/classification_and_detection) | tensorflow, pytorch, onnx | imagenet2012 | -| ssd-mobilenet 300x300 | [vision/classification_and_detection](vision/classification_and_detection) | tensorflow, pytorch, onnx| coco resized to 300x300 | -| ssd-resnet34 1200x1200 | [vision/classification_and_detection](vision/classification_and_detection) | tensorflow, pytorch, onnx | coco resized to 1200x1200| -| bert | [language/bert](language/bert) | tensorflow, pytorch, onnx | squad-1.1 | -| dlrm | [recommendation/dlrm](recommendation/dlrm/pytorch) | pytorch, tensorflow(?), onnx(?) | Criteo Terabyte | -| 3d-unet | [vision/medical_imageing/3d-unet](vision/medical_imageing/3d-unet) | pytorch, tensorflow(?), onnx(?) | BraTS 2019 | -| rnnt | [speech_recognition/rnnt](speech_recognition/rnnt) | pytorch | OpenSLR LibriSpeech Corpus | - - -## MLPerf Inference v0.5 +## MLPerf Inference v0.7 (submission 9/18/2020) +Use the r0.7 branch (```git checkout r0.7```) if you want to submit or reproduce v0.7 results. See the individual Readme files in the reference app for details. | model | reference app | framework | dataset | | ---- | ---- | ---- | ---- | -| resnet50-v1.5 | [v0.5/classification_and_detection](https://github.com/mlperf/inference/tree/r0.5/v0.5/classification_and_detection) | tensorflow, pytorch, onnx | imagenet2012 | -| mobilenet-v1 | [v0.5/classification_and_detection](https://github.com/mlperf/inference/tree/r0.5/v0.5/classification_and_detection) |tensorflow, pytorch, onnx | imagenet2012 | -| ssd-mobilenet 300x300 | [v0.5/classification_and_detection](https://github.com/mlperf/inference/tree/r0.5/v0.5/classification_and_detection) |tensorflow, pytorch, onnx | coco resized to 300x300 | -| ssd-resnet34 1200x1200 | [v0.5/classification_and_detection](https://github.com/mlperf/inference/tree/r0.5/v0.5/classification_and_detection) | tensorflow, pytorch, onnx | coco resized to 1200x1200 | -| gnmt | [v0.5/translation/gnmt/](https://github.com/mlperf/inference/tree/r0.5/v0.5/translation/gnmt/tensorflow) | tensorflow, pytorch | See Readme | +| resnet50-v1.5 | [vision/classification_and_detection](https://github.com/mlperf/inference/tree/r0.7/vision/classification_and_detection) | tensorflow, pytorch, onnx | imagenet2012 | +| ssd-mobilenet 300x300 | [vision/classification_and_detection](https://github.com/mlperf/inference/tree/r0.7/vision/classification_and_detection) | tensorflow, pytorch, onnx| coco resized to 300x300 | +| ssd-resnet34 1200x1200 | [vision/classification_and_detection](https://github.com/mlperf/inference/tree/r0.7/vision/classification_and_detection) | tensorflow, pytorch, onnx | coco resized to 1200x1200| +| bert | [language/bert](https://github.com/mlperf/inference/tree/r0.7/language/bert) | tensorflow, pytorch, onnx | squad-1.1 | +| dlrm | [recommendation/dlrm](https://github.com/mlperf/inference/tree/r0.7/recommendation/dlrm/pytorch) | pytorch, tensorflow(?), onnx(?) | Criteo Terabyte | +| 3d-unet | [vision/medical_imageing/3d-unet](https://github.com/mlperf/inference/tree/r0.7/vision/medical_imaging/3d-unet) | pytorch, tensorflow(?), onnx(?) | BraTS 2019 | +| rnnt | [speech_recognition/rnnt](https://github.com/mlperf/inference/tree/r0.7/speech_recognition/rnnt) | pytorch | OpenSLR LibriSpeech Corpus |