diff --git a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/README.md b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/README.md index 862da9165..dcb142eaf 100644 --- a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/README.md +++ b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/README.md @@ -19,7 +19,7 @@ pip install -U cmind cm rm cache -f -cm pull repo mlcommons@mlperf-automations --checkout=a90475d2de72bf0622cebe8d5ca8eb8c9d872fbd +cm pull repo mlcommons@mlperf-automations --checkout=467517e4a572872046058e394a0d83512cfff38b cm run script \ --tags=app,mlperf,inference,generic,_nvidia,_3d-unet-99.9,_tensorrt,_cuda,_valid,_r4.1-dev_default,_singlestream \ @@ -126,4 +126,4 @@ Model Precision: int8 `DICE`: `0.86236`, Required accuracy for closed division `>= 0.86084` ### Performance Results -`90th percentile latency (ns)`: `437330110.0` +`90th percentile latency (ns)`: `437613279.0` diff --git a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/accuracy_console.out b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/accuracy_console.out index ed87b1bd6..9b5c597a4 100644 --- a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/accuracy_console.out +++ b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/accuracy_console.out @@ -1,8 +1,8 @@ -[2024-12-24 21:14:19,911 main.py:229 INFO] Detected system ID: KnownSystem.RTX4090x1 -[2024-12-24 21:14:20,085 harness.py:249 INFO] The harness will load 3 plugins: ['build/plugins/pixelShuffle3DPlugin/libpixelshuffle3dplugin.so', 'build/plugins/conv3D1X1X1K4Plugin/libconv3D1X1X1K4Plugin.so', 'build/plugins/conv3D3X3X3C1K32Plugin/libconv3D3X3X3C1K32Plugin.so'] -[2024-12-24 21:14:20,086 generate_conf_files.py:107 INFO] Generated measurements/ entries for RTX4090x1_TRT/3d-unet-99.9/SingleStream -[2024-12-24 21:14:20,086 __init__.py:46 INFO] Running command: ./build/bin/harness_3dunet --plugins="build/plugins/pixelShuffle3DPlugin/libpixelshuffle3dplugin.so,build/plugins/conv3D1X1X1K4Plugin/libconv3D1X1X1K4Plugin.so,build/plugins/conv3D3X3X3C1K32Plugin/libconv3D3X3X3C1K32Plugin.so" --logfile_outdir="/cm-mount/home/arjun/gh_action_results/valid_results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/accuracy" --logfile_prefix="mlperf_log_" --performance_sample_count=43 --test_mode="AccuracyOnly" --gpu_copy_streams=1 --gpu_inference_streams=1 --use_deque_limit=true --gpu_batch_size=1 --map_path="data_maps/kits19/val_map.txt" --mlperf_conf_path="/home/cmuser/CM/repos/local/cache/c1d8c371d52d46a3/inference/mlperf.conf" --tensor_path="build/preprocessed_data/KiTS19/inference/int8" --use_graphs=false --user_conf_path="/home/cmuser/CM/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/ce680103d365484b88716a62f18175c8.conf" --unet3d_sw_gaussian_patch_path="/home/cmuser/CM/repos/local/cache/5b2b0cc913a4453a/preprocessed_data/KiTS19/etc/gaussian_patches.npy" --gpu_engines="./build/engines/RTX4090x1/3d-unet/SingleStream/3d-unet-SingleStream-gpu-b1-int8.custom_k_99_9_MaxP.plan" --max_dlas=0 --slice_overlap_patch_kernel_cg_impl=false --scenario SingleStream --model 3d-unet -[2024-12-24 21:14:20,086 __init__.py:53 INFO] Overriding Environment +[2024-12-27 19:48:10,290 main.py:229 INFO] Detected system ID: KnownSystem.RTX4090x1 +[2024-12-27 19:48:10,462 harness.py:249 INFO] The harness will load 3 plugins: ['build/plugins/pixelShuffle3DPlugin/libpixelshuffle3dplugin.so', 'build/plugins/conv3D1X1X1K4Plugin/libconv3D1X1X1K4Plugin.so', 'build/plugins/conv3D3X3X3C1K32Plugin/libconv3D3X3X3C1K32Plugin.so'] +[2024-12-27 19:48:10,463 generate_conf_files.py:107 INFO] Generated measurements/ entries for RTX4090x1_TRT/3d-unet-99.9/SingleStream +[2024-12-27 19:48:10,463 __init__.py:46 INFO] Running command: ./build/bin/harness_3dunet --plugins="build/plugins/pixelShuffle3DPlugin/libpixelshuffle3dplugin.so,build/plugins/conv3D1X1X1K4Plugin/libconv3D1X1X1K4Plugin.so,build/plugins/conv3D3X3X3C1K32Plugin/libconv3D3X3X3C1K32Plugin.so" --logfile_outdir="/cm-mount/home/arjun/gh_action_results/valid_results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/accuracy" --logfile_prefix="mlperf_log_" --performance_sample_count=43 --test_mode="AccuracyOnly" --gpu_copy_streams=1 --gpu_inference_streams=1 --use_deque_limit=true --gpu_batch_size=1 --map_path="data_maps/kits19/val_map.txt" --mlperf_conf_path="/home/cmuser/CM/repos/local/cache/c1d8c371d52d46a3/inference/mlperf.conf" --tensor_path="build/preprocessed_data/KiTS19/inference/int8" --use_graphs=false --user_conf_path="/home/cmuser/CM/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/e5e3ac975a6a48c49bfdc79eb904188d.conf" --unet3d_sw_gaussian_patch_path="/home/cmuser/CM/repos/local/cache/5b2b0cc913a4453a/preprocessed_data/KiTS19/etc/gaussian_patches.npy" --gpu_engines="./build/engines/RTX4090x1/3d-unet/SingleStream/3d-unet-SingleStream-gpu-b1-int8.custom_k_99_9_MaxP.plan" --max_dlas=0 --slice_overlap_patch_kernel_cg_impl=false --scenario SingleStream --model 3d-unet +[2024-12-27 19:48:10,463 __init__.py:53 INFO] Overriding Environment benchmark : Benchmark.UNET3D buffer_manager_thread_count : 0 data_dir : /home/cmuser/CM/repos/local/cache/5b2b0cc913a4453a/data @@ -11,7 +11,7 @@ gpu_copy_streams : 1 gpu_inference_streams : 1 input_dtype : int8 input_format : linear -log_dir : /home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/logs/2024.12.24-21.14.19 +log_dir : /home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/logs/2024.12.27-19.48.09 map_path : data_maps/kits19/val_map.txt mlperf_conf_path : /home/cmuser/CM/repos/local/cache/c1d8c371d52d46a3/inference/mlperf.conf precision : int8 @@ -25,7 +25,7 @@ test_mode : AccuracyOnly unet3d_sw_gaussian_patch_path : /home/cmuser/CM/repos/local/cache/5b2b0cc913a4453a/preprocessed_data/KiTS19/etc/gaussian_patches.npy use_deque_limit : True use_graphs : False -user_conf_path : /home/cmuser/CM/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/ce680103d365484b88716a62f18175c8.conf +user_conf_path : /home/cmuser/CM/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/e5e3ac975a6a48c49bfdc79eb904188d.conf system_id : RTX4090x1 config_name : RTX4090x1_3d-unet_SingleStream workload_setting : WorkloadSetting(HarnessType.Custom, AccuracyTarget.k_99_9, PowerSetting.MaxP) @@ -39,7 +39,7 @@ power_limit : None cpu_freq : None &&&& RUNNING MLPerf_Inference_3DUNet_Harness # ./build/bin/harness_3dunet [I] mlperf.conf path: /home/cmuser/CM/repos/local/cache/c1d8c371d52d46a3/inference/mlperf.conf -[I] user.conf path: /home/cmuser/CM/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/ce680103d365484b88716a62f18175c8.conf +[I] user.conf path: /home/cmuser/CM/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/e5e3ac975a6a48c49bfdc79eb904188d.conf Creating QSL. Finished Creating QSL. Setting up SUT. @@ -55,7 +55,7 @@ Setting up SUT. [I] Creating batcher thread: 0 EnableBatcherThreadPerDevice: true Finished setting up SUT. Starting warmup. Running for a minimum of 5 seconds. -Finished warmup. Ran for 5.05304s. +Finished warmup. Ran for 5.0542s. Starting running actual test. No warnings encountered during test. @@ -68,8 +68,8 @@ Device Device:0 processed: PerSampleCudaMemcpy Calls: 43 BatchedCudaMemcpy Calls: 0 &&&& PASSED MLPerf_Inference_3DUNet_Harness # ./build/bin/harness_3dunet -[2024-12-24 21:14:36,037 run_harness.py:166 INFO] Result: Accuracy run detected. -[2024-12-24 21:14:36,037 __init__.py:46 INFO] Running command: python3 code/3d-unet/tensorrt/accuracy_kits.py --log_file /cm-mount/home/arjun/gh_action_results/valid_results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/accuracy/mlperf_log_accuracy.json +[2024-12-27 19:48:26,406 run_harness.py:166 INFO] Result: Accuracy run detected. +[2024-12-27 19:48:26,406 __init__.py:46 INFO] Running command: python3 code/3d-unet/tensorrt/accuracy_kits.py --log_file /cm-mount/home/arjun/gh_action_results/valid_results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/accuracy/mlperf_log_accuracy.json Loading necessary metadata... Loading loadgen accuracy log... Running postprocessing... diff --git a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/cm-deps.mmd b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/cm-deps.mmd index 5b2c86baa..0f80a9f06 100644 --- a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/cm-deps.mmd +++ b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/cm-deps.mmd @@ -20,17 +20,17 @@ graph TD get-generic-python-lib,94b62a682bc44791_(_package.numpy_) --> get,generic-python-lib,_pip get-cuda-devices,7a3ede4d3558427a_(_with-pycuda_) --> get,generic-python-lib,_package.numpy app-mlperf-inference,d775cac873ee4231_(_nvidia,_3d-unet-99.9,_tensorrt,_cuda,_valid,_r4.1-dev_default,_singlestream_) --> get,cuda-devices,_with-pycuda - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> detect,os + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> detect,os detect-cpu,586c8a43320142f7 --> detect,os - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> detect,cpu - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> get,sys-utils-cm - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> get,mlperf,inference,nvidia,scratch,space + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> detect,cpu + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> get,sys-utils-cm + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> get,mlperf,inference,nvidia,scratch,space get-generic-python-lib,94b62a682bc44791_(_mlperf_logging_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> get,generic-python-lib,_mlperf_logging - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> get,mlcommons,inference,src - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> get,nvidia,mlperf,inference,common-code,_mlcommons + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> get,generic-python-lib,_mlperf_logging + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> get,mlcommons,inference,src + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> get,nvidia,mlperf,inference,common-code,_mlcommons pull-git-repo,c23132ed65c4421d --> detect,os - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> pull,git,repo + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> pull,git,repo generate-mlperf-inference-user-conf,3af4475745964b93 --> detect,os detect-cpu,586c8a43320142f7 --> detect,os generate-mlperf-inference-user-conf,3af4475745964b93 --> detect,cpu @@ -38,9 +38,9 @@ graph TD generate-mlperf-inference-user-conf,3af4475745964b93 --> get,mlcommons,inference,src get-mlperf-inference-sut-configs,c2fbf72009e2445b --> get,cache,dir,_name.mlperf-inference-sut-configs generate-mlperf-inference-user-conf,3af4475745964b93 --> get,sut,configs - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> generate,user-conf,mlperf,inference + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> generate,user-conf,mlperf,inference get-generic-python-lib,94b62a682bc44791_(_package.pycuda_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> get,generic-python-lib,_package.pycuda + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> get,generic-python-lib,_package.pycuda get-nvidia-mitten,1c045f2902374de9 --> detect,os get-nvidia-mitten,1c045f2902374de9 --> get,python3 get-generic-python-lib,94b62a682bc44791_(_pycuda_) --> detect,os @@ -53,9 +53,9 @@ graph TD get-nvidia-mitten,1c045f2902374de9 --> get,generic-python-lib,_pycuda get-git-repo,ed603e7292974f10_(_repo.https://github.com/NVIDIA/mitten_) --> detect,os get-nvidia-mitten,1c045f2902374de9 --> get,git,_repo.https://github.com/NVIDIA/mitten - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> get,nvidia,mitten - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> get,cuda,_cudnn - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> get,tensorrt + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> get,nvidia,mitten + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> get,cuda,_cudnn + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> get,tensorrt build-mlperf-inference-server-nvidia,f37403af5e9f4541_(_mlcommons_) --> detect,os detect-cpu,586c8a43320142f7 --> detect,os build-mlperf-inference-server-nvidia,f37403af5e9f4541_(_mlcommons_) --> detect,cpu @@ -113,101 +113,101 @@ graph TD get-generic-python-lib,94b62a682bc44791_(_pycuda_) --> get,python3 add-custom-nvidia-system,b2e6c46c6e8745a3_(_mlcommons_) --> get,generic-python-lib,_pycuda build-mlperf-inference-server-nvidia,f37403af5e9f4541_(_mlcommons_) --> add,custom,system,nvidia,_mlcommons - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> build,nvidia,inference,server,_mlcommons - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> detect,os + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> build,nvidia,inference,server,_mlcommons + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> detect,os detect-cpu,586c8a43320142f7 --> detect,os - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> detect,cpu - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,sys-utils-cm - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,mlperf,inference,nvidia,scratch,space,_version.4_0 + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> detect,cpu + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,sys-utils-cm + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,mlperf,inference,nvidia,scratch,space,_version.4_0 get-generic-python-lib,94b62a682bc44791_(_mlperf_logging_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_mlperf_logging - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,mlcommons,inference,src - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,nvidia,mlperf,inference,common-code,_mlcommons + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_mlperf_logging + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,mlcommons,inference,src + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,nvidia,mlperf,inference,common-code,_mlcommons pull-git-repo,c23132ed65c4421d --> detect,os - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> pull,git,repo + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> pull,git,repo get-generic-python-lib,94b62a682bc44791_(_package.pycuda_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.pycuda - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,nvidia,mitten - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,cuda,_cudnn - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,tensorrt - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> build,nvidia,inference,server,_mlcommons - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> detect,os + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.pycuda + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,nvidia,mitten + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,cuda,_cudnn + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,tensorrt + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> build,nvidia,inference,server,_mlcommons + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> detect,os detect-cpu,586c8a43320142f7 --> detect,os - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> detect,cpu - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,sys-utils-cm - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,mlperf,inference,nvidia,scratch,space,_version.4_0 + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> detect,cpu + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,sys-utils-cm + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,mlperf,inference,nvidia,scratch,space,_version.4_0 get-generic-python-lib,94b62a682bc44791_(_mlperf_logging_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_mlperf_logging - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,mlcommons,inference,src - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,nvidia,mlperf,inference,common-code,_mlcommons + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_mlperf_logging + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,mlcommons,inference,src + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,nvidia,mlperf,inference,common-code,_mlcommons pull-git-repo,c23132ed65c4421d --> detect,os - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> pull,git,repo + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> pull,git,repo get-generic-python-lib,94b62a682bc44791_(_package.pycuda_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.pycuda - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,nvidia,mitten + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.pycuda + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,nvidia,mitten get-generic-python-lib,94b62a682bc44791_(_transformers_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_transformers + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_transformers get-generic-python-lib,94b62a682bc44791_(_package.nibabel_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.nibabel + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.nibabel get-generic-python-lib,94b62a682bc44791_(_pandas_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_pandas + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_pandas get-generic-python-lib,94b62a682bc44791_(_onnx-graphsurgeon_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_onnx-graphsurgeon + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_onnx-graphsurgeon get-generic-python-lib,94b62a682bc44791_(_package.onnx_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.onnx - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> save,mlperf,inference,state - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> reproduce,mlperf,inference,nvidia,harness,_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> detect,os + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.onnx + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> save,mlperf,inference,state + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> reproduce,mlperf,inference,nvidia,harness,_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> detect,os detect-cpu,586c8a43320142f7 --> detect,os - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> detect,cpu - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,sys-utils-cm - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,mlperf,inference,nvidia,scratch,space,_version.4_0 + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> detect,cpu + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,sys-utils-cm + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,mlperf,inference,nvidia,scratch,space,_version.4_0 get-generic-python-lib,94b62a682bc44791_(_mlperf_logging_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_mlperf_logging - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,mlcommons,inference,src - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,nvidia,mlperf,inference,common-code,_mlcommons + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_mlperf_logging + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,mlcommons,inference,src + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,nvidia,mlperf,inference,common-code,_mlcommons pull-git-repo,c23132ed65c4421d --> detect,os - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> pull,git,repo + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> pull,git,repo get-generic-python-lib,94b62a682bc44791_(_package.pycuda_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.pycuda - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,nvidia,mitten + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.pycuda + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,nvidia,mitten get-generic-python-lib,94b62a682bc44791_(_transformers_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_transformers + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_transformers get-generic-python-lib,94b62a682bc44791_(_package.nibabel_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.nibabel + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.nibabel get-generic-python-lib,94b62a682bc44791_(_pandas_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_pandas + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_pandas get-generic-python-lib,94b62a682bc44791_(_onnx-graphsurgeon_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_onnx-graphsurgeon + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_onnx-graphsurgeon get-generic-python-lib,94b62a682bc44791_(_package.onnx_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.onnx - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev_) --> save,mlperf,inference,state - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> reproduce,mlperf,inference,nvidia,harness,_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.onnx + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev_) --> save,mlperf,inference,state + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> reproduce,mlperf,inference,nvidia,harness,_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev get-generic-python-lib,94b62a682bc44791_(_transformers_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_transformers + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_transformers get-generic-python-lib,94b62a682bc44791_(_package.nibabel_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.nibabel + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.nibabel get-generic-python-lib,94b62a682bc44791_(_pandas_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_pandas + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_pandas get-generic-python-lib,94b62a682bc44791_(_onnx-graphsurgeon_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_onnx-graphsurgeon + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_onnx-graphsurgeon get-generic-python-lib,94b62a682bc44791_(_package.onnx_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.onnx - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> save,mlperf,inference,state - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> reproduce,mlperf,inference,nvidia,harness,_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> reproduce,mlperf,inference,nvidia,harness,_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> reproduce,mlperf,inference,nvidia,harness,_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> get,generic-python-lib,_package.onnx + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev_) --> save,mlperf,inference,state + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> reproduce,mlperf,inference,nvidia,harness,_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> reproduce,mlperf,inference,nvidia,harness,_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> reproduce,mlperf,inference,nvidia,harness,_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev get-generic-python-lib,94b62a682bc44791_(_transformers_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> get,generic-python-lib,_transformers + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> get,generic-python-lib,_transformers get-generic-python-lib,94b62a682bc44791_(_package.nibabel_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> get,generic-python-lib,_package.nibabel + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> get,generic-python-lib,_package.nibabel get-generic-python-lib,94b62a682bc44791_(_pandas_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> get,generic-python-lib,_pandas + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> get,generic-python-lib,_pandas get-generic-python-lib,94b62a682bc44791_(_onnx-graphsurgeon_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> get,generic-python-lib,_onnx-graphsurgeon + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> get,generic-python-lib,_onnx-graphsurgeon get-generic-python-lib,94b62a682bc44791_(_package.onnx_) --> get,python3 - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> get,generic-python-lib,_package.onnx + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> get,generic-python-lib,_package.onnx detect-cpu,586c8a43320142f7 --> detect,os benchmark-program,19f369ef47084895 --> detect,cpu benchmark-program-mlperf,cfff0132a8aa4018 --> benchmark-program,program - app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090_) --> benchmark-mlperf \ No newline at end of file + app-mlperf-inference-nvidia,bc3b17fb430f4732_(_run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090_) --> benchmark-mlperf \ No newline at end of file diff --git a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/cm-deps.png b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/cm-deps.png index d353fe55f..befb1b73d 100644 Binary files a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/cm-deps.png and b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/cm-deps.png differ diff --git a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/cm-version-info.json b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/cm-version-info.json index 3deb03b84..f18fc65e7 100644 --- a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/cm-version-info.json +++ b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/cm-version-info.json @@ -217,7 +217,7 @@ "script_tags": "detect-os,detect,os,info", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -237,7 +237,7 @@ "script_tags": "detect,cpu,detect-cpu,info", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -247,7 +247,7 @@ "script_tags": "get,sys-utils-cm", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -257,7 +257,7 @@ "script_tags": "get,mlperf,inference,nvidia,scratch,space", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -277,7 +277,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "mlperf_logging", "version": "4.1.1", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -287,7 +287,7 @@ "script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons", "script_variations": "", "version": "master-git-2fdb814e6a765d994872fb99ee38f8c43418d5b0", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -297,7 +297,7 @@ "script_tags": "get,nvidia,mlperf,inference,common-code", "script_variations": "mlcommons", "version": "r4.0", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -317,7 +317,7 @@ "script_tags": "pull,git,repo,repository", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -397,7 +397,7 @@ "script_tags": "generate,mlperf,inference,user-conf,inference-user-conf", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -417,7 +417,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "package.pycuda", "version": "2022.2.2", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -547,7 +547,7 @@ "script_tags": "get,nvidia,mitten,nvidia-mitten", "script_variations": "", "version": "master", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -557,7 +557,7 @@ "script_tags": "get,cuda,cuda-compiler,cuda-lib,toolkit,lib,nvcc,get-nvcc,get-cuda,46d133d9ef92422d", "script_variations": "cudnn", "version": "12.2", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -567,7 +567,7 @@ "script_tags": "get,tensorrt,nvidia", "script_variations": "", "version": "vdetected", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -1147,7 +1147,7 @@ "script_tags": "build,mlcommons,mlperf,inference,inference-server,server,nvidia-harness,nvidia", "script_variations": "mlcommons", "version": "r4.0", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -1157,7 +1157,7 @@ "script_tags": "detect-os,detect,os,info", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1177,7 +1177,7 @@ "script_tags": "detect,cpu,detect-cpu,info", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1187,7 +1187,7 @@ "script_tags": "get,sys-utils-cm", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1197,7 +1197,7 @@ "script_tags": "get,mlperf,inference,nvidia,scratch,space", "script_variations": "version.4_0", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1217,7 +1217,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "mlperf_logging", "version": "4.1.1", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1227,7 +1227,7 @@ "script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons", "script_variations": "", "version": "master-git-2fdb814e6a765d994872fb99ee38f8c43418d5b0", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1237,7 +1237,7 @@ "script_tags": "get,nvidia,mlperf,inference,common-code", "script_variations": "mlcommons", "version": "r4.0", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1257,7 +1257,7 @@ "script_tags": "pull,git,repo,repository", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1277,7 +1277,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "package.pycuda", "version": "2022.2.2", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1287,7 +1287,7 @@ "script_tags": "get,nvidia,mitten,nvidia-mitten", "script_variations": "", "version": "master", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1297,7 +1297,7 @@ "script_tags": "get,cuda,cuda-compiler,cuda-lib,toolkit,lib,nvcc,get-nvcc,get-cuda,46d133d9ef92422d", "script_variations": "cudnn", "version": "12.2", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1307,7 +1307,7 @@ "script_tags": "get,tensorrt,nvidia", "script_variations": "", "version": "vdetected", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1317,7 +1317,7 @@ "script_tags": "build,mlcommons,mlperf,inference,inference-server,server,nvidia-harness,nvidia", "script_variations": "mlcommons", "version": "r4.0", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1327,7 +1327,7 @@ "script_tags": "detect-os,detect,os,info", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1347,7 +1347,7 @@ "script_tags": "detect,cpu,detect-cpu,info", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1357,7 +1357,7 @@ "script_tags": "get,sys-utils-cm", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1367,7 +1367,7 @@ "script_tags": "get,mlperf,inference,nvidia,scratch,space", "script_variations": "version.4_0", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1387,7 +1387,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "mlperf_logging", "version": "4.1.1", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1397,7 +1397,7 @@ "script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons", "script_variations": "", "version": "master-git-2fdb814e6a765d994872fb99ee38f8c43418d5b0", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1407,7 +1407,7 @@ "script_tags": "get,nvidia,mlperf,inference,common-code", "script_variations": "mlcommons", "version": "r4.0", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1427,7 +1427,7 @@ "script_tags": "pull,git,repo,repository", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1447,7 +1447,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "package.pycuda", "version": "2022.2.2", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1457,7 +1457,7 @@ "script_tags": "get,nvidia,mitten,nvidia-mitten", "script_variations": "", "version": "master", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1477,7 +1477,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "transformers", "version": "4.46.3", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1497,7 +1497,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "package.nibabel", "version": "5.2.1", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1517,7 +1517,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "pandas", "version": "1.5.3", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1537,7 +1537,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "onnx-graphsurgeon", "version": "0.3.27", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1557,7 +1557,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "package.onnx", "version": "1.13.1", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1567,17 +1567,17 @@ "script_tags": "save,mlperf,inference,implementation,state", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { - "reproduce,mlperf,inference,nvidia,harness,_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev": { + "reproduce,mlperf,inference,nvidia,harness,_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev": { "script_uid": "bc3b17fb430f4732", "script_alias": "app-mlperf-inference-nvidia", "script_tags": "reproduce,mlcommons,mlperf,inference,harness,nvidia-harness,nvidia", - "script_variations": "preprocess_data,tensorrt,cuda,3d-unet-99.9,3d-unet_,v4.1-dev", + "script_variations": "preprocess_data,3d-unet-99.9,tensorrt,cuda,3d-unet_,v4.1-dev", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1587,7 +1587,7 @@ "script_tags": "detect-os,detect,os,info", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1607,7 +1607,7 @@ "script_tags": "detect,cpu,detect-cpu,info", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1617,7 +1617,7 @@ "script_tags": "get,sys-utils-cm", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1627,7 +1627,7 @@ "script_tags": "get,mlperf,inference,nvidia,scratch,space", "script_variations": "version.4_0", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1647,7 +1647,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "mlperf_logging", "version": "4.1.1", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1657,7 +1657,7 @@ "script_tags": "get,src,source,inference,inference-src,inference-source,mlperf,mlcommons", "script_variations": "", "version": "master-git-2fdb814e6a765d994872fb99ee38f8c43418d5b0", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1667,7 +1667,7 @@ "script_tags": "get,nvidia,mlperf,inference,common-code", "script_variations": "mlcommons", "version": "r4.0", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1687,7 +1687,7 @@ "script_tags": "pull,git,repo,repository", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1707,7 +1707,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "package.pycuda", "version": "2022.2.2", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1717,7 +1717,7 @@ "script_tags": "get,nvidia,mitten,nvidia-mitten", "script_variations": "", "version": "master", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1737,7 +1737,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "transformers", "version": "4.46.3", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1757,7 +1757,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "package.nibabel", "version": "5.2.1", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1777,7 +1777,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "pandas", "version": "1.5.3", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1797,7 +1797,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "onnx-graphsurgeon", "version": "0.3.27", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1817,7 +1817,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "package.onnx", "version": "1.13.1", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { @@ -1827,17 +1827,17 @@ "script_tags": "save,mlperf,inference,implementation,state", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev )" } }, { - "reproduce,mlperf,inference,nvidia,harness,_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev": { + "reproduce,mlperf,inference,nvidia,harness,_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev": { "script_uid": "bc3b17fb430f4732", "script_alias": "app-mlperf-inference-nvidia", "script_tags": "reproduce,mlcommons,mlperf,inference,harness,nvidia-harness,nvidia", - "script_variations": "download_model,tensorrt,cuda,3d-unet-99.9,3d-unet_,v4.1-dev", + "script_variations": "download_model,3d-unet-99.9,tensorrt,cuda,3d-unet_,v4.1-dev", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1857,7 +1857,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "transformers", "version": "4.46.3", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1877,7 +1877,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "package.nibabel", "version": "5.2.1", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1897,7 +1897,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "pandas", "version": "1.5.3", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1917,7 +1917,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "onnx-graphsurgeon", "version": "0.3.27", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1937,7 +1937,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "package.onnx", "version": "1.13.1", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { @@ -1947,37 +1947,37 @@ "script_tags": "save,mlperf,inference,implementation,state", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev )" } }, { - "reproduce,mlperf,inference,nvidia,harness,_build_engine,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev": { + "reproduce,mlperf,inference,nvidia,harness,_build_engine,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_batch_size.1,_3d-unet_,_v4.1-dev": { "script_uid": "bc3b17fb430f4732", "script_alias": "app-mlperf-inference-nvidia", "script_tags": "reproduce,mlcommons,mlperf,inference,harness,nvidia-harness,nvidia", - "script_variations": "build_engine,tensorrt,cuda,3d-unet-99.9,singlestream,batch_size.1,3d-unet_,v4.1-dev", + "script_variations": "build_engine,3d-unet-99.9,tensorrt,cuda,singlestream,batch_size.1,3d-unet_,v4.1-dev", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { - "reproduce,mlperf,inference,nvidia,harness,_preprocess_data,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev": { + "reproduce,mlperf,inference,nvidia,harness,_preprocess_data,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev": { "script_uid": "bc3b17fb430f4732", "script_alias": "app-mlperf-inference-nvidia", "script_tags": "reproduce,mlcommons,mlperf,inference,harness,nvidia-harness,nvidia", - "script_variations": "preprocess_data,tensorrt,cuda,3d-unet-99.9,3d-unet_,v4.1-dev", + "script_variations": "preprocess_data,3d-unet-99.9,tensorrt,cuda,3d-unet_,v4.1-dev", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { - "reproduce,mlperf,inference,nvidia,harness,_download_model,_tensorrt,_cuda,_3d-unet-99.9,_3d-unet_,_v4.1-dev": { + "reproduce,mlperf,inference,nvidia,harness,_download_model,_3d-unet-99.9,_tensorrt,_cuda,_3d-unet_,_v4.1-dev": { "script_uid": "bc3b17fb430f4732", "script_alias": "app-mlperf-inference-nvidia", "script_tags": "reproduce,mlcommons,mlperf,inference,harness,nvidia-harness,nvidia", - "script_variations": "download_model,tensorrt,cuda,3d-unet-99.9,3d-unet_,v4.1-dev", + "script_variations": "download_model,3d-unet-99.9,tensorrt,cuda,3d-unet_,v4.1-dev", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -1997,7 +1997,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "transformers", "version": "4.46.3", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -2017,7 +2017,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "package.nibabel", "version": "5.2.1", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -2037,7 +2037,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "pandas", "version": "1.5.3", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -2057,7 +2057,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "onnx-graphsurgeon", "version": "0.3.27", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -2077,7 +2077,7 @@ "script_tags": "get,install,generic,pip-package,generic-python-lib", "script_variations": "package.onnx", "version": "1.13.1", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } }, { @@ -2117,7 +2117,7 @@ "script_tags": "mlperf,benchmark-mlperf", "script_variations": "", "version": "", - "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_tensorrt,_cuda,_3d-unet-99.9,_singlestream,_rtx_4090 )" + "parent": "app-mlperf-inference-nvidia,bc3b17fb430f4732 ( run_harness,_3d-unet-99.9,_tensorrt,_cuda,_singlestream,_rtx_4090 )" } } ] diff --git a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/os_info.json b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/os_info.json index 0b6b2e0c2..6e711d0c7 100644 --- a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/os_info.json +++ b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/os_info.json @@ -26,5 +26,5 @@ ], "CM_HOST_PLATFORM_FLAVOR": "x86_64", "CM_HOST_PYTHON_BITS": "64", - "CM_HOST_SYSTEM_NAME": "fece196767e4" + "CM_HOST_SYSTEM_NAME": "3cb20f87a9b6" } \ No newline at end of file diff --git a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/performance_console.out b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/performance_console.out index 2888066a1..fe2d66862 100644 --- a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/performance_console.out +++ b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/performance_console.out @@ -1,8 +1,8 @@ -[2024-12-24 21:00:55,291 main.py:229 INFO] Detected system ID: KnownSystem.RTX4090x1 -[2024-12-24 21:00:55,472 harness.py:249 INFO] The harness will load 3 plugins: ['build/plugins/pixelShuffle3DPlugin/libpixelshuffle3dplugin.so', 'build/plugins/conv3D1X1X1K4Plugin/libconv3D1X1X1K4Plugin.so', 'build/plugins/conv3D3X3X3C1K32Plugin/libconv3D3X3X3C1K32Plugin.so'] -[2024-12-24 21:00:55,473 generate_conf_files.py:107 INFO] Generated measurements/ entries for RTX4090x1_TRT/3d-unet-99.9/SingleStream -[2024-12-24 21:00:55,473 __init__.py:46 INFO] Running command: ./build/bin/harness_3dunet --plugins="build/plugins/pixelShuffle3DPlugin/libpixelshuffle3dplugin.so,build/plugins/conv3D1X1X1K4Plugin/libconv3D1X1X1K4Plugin.so,build/plugins/conv3D3X3X3C1K32Plugin/libconv3D3X3X3C1K32Plugin.so" --logfile_outdir="/cm-mount/home/arjun/gh_action_results/valid_results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/performance/run_1" --logfile_prefix="mlperf_log_" --performance_sample_count=43 --test_mode="PerformanceOnly" --gpu_copy_streams=1 --gpu_inference_streams=1 --use_deque_limit=true --gpu_batch_size=1 --map_path="data_maps/kits19/val_map.txt" --mlperf_conf_path="/home/cmuser/CM/repos/local/cache/c1d8c371d52d46a3/inference/mlperf.conf" --tensor_path="build/preprocessed_data/KiTS19/inference/int8" --use_graphs=false --user_conf_path="/home/cmuser/CM/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/9c10909c6d9848f5bcb470fde587edb7.conf" --unet3d_sw_gaussian_patch_path="/home/cmuser/CM/repos/local/cache/5b2b0cc913a4453a/preprocessed_data/KiTS19/etc/gaussian_patches.npy" --gpu_engines="./build/engines/RTX4090x1/3d-unet/SingleStream/3d-unet-SingleStream-gpu-b1-int8.custom_k_99_9_MaxP.plan" --max_dlas=0 --slice_overlap_patch_kernel_cg_impl=false --scenario SingleStream --model 3d-unet -[2024-12-24 21:00:55,473 __init__.py:53 INFO] Overriding Environment +[2024-12-27 19:34:43,104 main.py:229 INFO] Detected system ID: KnownSystem.RTX4090x1 +[2024-12-27 19:34:43,285 harness.py:249 INFO] The harness will load 3 plugins: ['build/plugins/pixelShuffle3DPlugin/libpixelshuffle3dplugin.so', 'build/plugins/conv3D1X1X1K4Plugin/libconv3D1X1X1K4Plugin.so', 'build/plugins/conv3D3X3X3C1K32Plugin/libconv3D3X3X3C1K32Plugin.so'] +[2024-12-27 19:34:43,285 generate_conf_files.py:107 INFO] Generated measurements/ entries for RTX4090x1_TRT/3d-unet-99.9/SingleStream +[2024-12-27 19:34:43,285 __init__.py:46 INFO] Running command: ./build/bin/harness_3dunet --plugins="build/plugins/pixelShuffle3DPlugin/libpixelshuffle3dplugin.so,build/plugins/conv3D1X1X1K4Plugin/libconv3D1X1X1K4Plugin.so,build/plugins/conv3D3X3X3C1K32Plugin/libconv3D3X3X3C1K32Plugin.so" --logfile_outdir="/cm-mount/home/arjun/gh_action_results/valid_results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/performance/run_1" --logfile_prefix="mlperf_log_" --performance_sample_count=43 --test_mode="PerformanceOnly" --gpu_copy_streams=1 --gpu_inference_streams=1 --use_deque_limit=true --gpu_batch_size=1 --map_path="data_maps/kits19/val_map.txt" --mlperf_conf_path="/home/cmuser/CM/repos/local/cache/c1d8c371d52d46a3/inference/mlperf.conf" --tensor_path="build/preprocessed_data/KiTS19/inference/int8" --use_graphs=false --user_conf_path="/home/cmuser/CM/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/55c8def1ae1a4cf1957892aab44877fe.conf" --unet3d_sw_gaussian_patch_path="/home/cmuser/CM/repos/local/cache/5b2b0cc913a4453a/preprocessed_data/KiTS19/etc/gaussian_patches.npy" --gpu_engines="./build/engines/RTX4090x1/3d-unet/SingleStream/3d-unet-SingleStream-gpu-b1-int8.custom_k_99_9_MaxP.plan" --max_dlas=0 --slice_overlap_patch_kernel_cg_impl=false --scenario SingleStream --model 3d-unet +[2024-12-27 19:34:43,285 __init__.py:53 INFO] Overriding Environment benchmark : Benchmark.UNET3D buffer_manager_thread_count : 0 data_dir : /home/cmuser/CM/repos/local/cache/5b2b0cc913a4453a/data @@ -11,7 +11,7 @@ gpu_copy_streams : 1 gpu_inference_streams : 1 input_dtype : int8 input_format : linear -log_dir : /home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/logs/2024.12.24-21.00.54 +log_dir : /home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/logs/2024.12.27-19.34.42 map_path : data_maps/kits19/val_map.txt mlperf_conf_path : /home/cmuser/CM/repos/local/cache/c1d8c371d52d46a3/inference/mlperf.conf precision : int8 @@ -25,7 +25,7 @@ test_mode : PerformanceOnly unet3d_sw_gaussian_patch_path : /home/cmuser/CM/repos/local/cache/5b2b0cc913a4453a/preprocessed_data/KiTS19/etc/gaussian_patches.npy use_deque_limit : True use_graphs : False -user_conf_path : /home/cmuser/CM/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/9c10909c6d9848f5bcb470fde587edb7.conf +user_conf_path : /home/cmuser/CM/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/55c8def1ae1a4cf1957892aab44877fe.conf system_id : RTX4090x1 config_name : RTX4090x1_3d-unet_SingleStream workload_setting : WorkloadSetting(HarnessType.Custom, AccuracyTarget.k_99_9, PowerSetting.MaxP) @@ -39,7 +39,7 @@ power_limit : None cpu_freq : None &&&& RUNNING MLPerf_Inference_3DUNet_Harness # ./build/bin/harness_3dunet [I] mlperf.conf path: /home/cmuser/CM/repos/local/cache/c1d8c371d52d46a3/inference/mlperf.conf -[I] user.conf path: /home/cmuser/CM/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/9c10909c6d9848f5bcb470fde587edb7.conf +[I] user.conf path: /home/cmuser/CM/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/55c8def1ae1a4cf1957892aab44877fe.conf Creating QSL. Finished Creating QSL. Setting up SUT. @@ -55,7 +55,7 @@ Setting up SUT. [I] Creating batcher thread: 0 EnableBatcherThreadPerDevice: true Finished setting up SUT. Starting warmup. Running for a minimum of 5 seconds. -Finished warmup. Ran for 5.05332s. +Finished warmup. Ran for 5.05385s. Starting running actual test. ================================================ MLPerf Results Summary @@ -63,7 +63,7 @@ MLPerf Results Summary SUT name : Server_3DUNet Scenario : SingleStream Mode : PerformanceOnly -90th percentile latency (ns) : 437159808 +90th percentile latency (ns) : 437327789 Result is : VALID Min duration satisfied : Yes Min queries satisfied : Yes @@ -71,24 +71,24 @@ Result is : VALID Early Stopping Result: * Processed at least 64 queries (3354). * Would discard 294 highest latency queries. - * Early stopping 90th percentile estimate: 437330110 - * Early stopping 99th percentile estimate: 503219208 + * Early stopping 90th percentile estimate: 437613279 + * Early stopping 99th percentile estimate: 503468351 ================================================ Additional Stats ================================================ -QPS w/ loadgen overhead : 4.45 +QPS w/ loadgen overhead : 4.44 QPS w/o loadgen overhead : 4.45 -Min latency (ns) : 28717857 -Max latency (ns) : 503573435 -Mean latency (ns) : 224819833 -50.00 percentile latency (ns) : 175759007 -90.00 percentile latency (ns) : 437159808 -95.00 percentile latency (ns) : 502458917 -97.00 percentile latency (ns) : 502834841 -99.00 percentile latency (ns) : 503129116 -99.90 percentile latency (ns) : 503459579 +Min latency (ns) : 28690940 +Max latency (ns) : 503889841 +Mean latency (ns) : 224893578 +50.00 percentile latency (ns) : 175828106 +90.00 percentile latency (ns) : 437327789 +95.00 percentile latency (ns) : 502531619 +97.00 percentile latency (ns) : 503072001 +99.00 percentile latency (ns) : 503361736 +99.90 percentile latency (ns) : 503702990 ================================================ Test Parameters Used @@ -123,7 +123,7 @@ Device Device:0 processed: PerSampleCudaMemcpy Calls: 3354 BatchedCudaMemcpy Calls: 0 &&&& PASSED MLPerf_Inference_3DUNet_Harness # ./build/bin/harness_3dunet -[2024-12-24 21:13:35,767 run_harness.py:166 INFO] Result: result_90.00_percentile_latency_ns: 437159808, Result is VALID +[2024-12-27 19:47:23,827 run_harness.py:166 INFO] Result: result_90.00_percentile_latency_ns: 437327789, Result is VALID ======================== Result summaries: ======================== diff --git a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/system_info.txt b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/system_info.txt index 5344c045b..d9d979e12 100644 --- a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/system_info.txt +++ b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/system_info.txt @@ -2,10 +2,10 @@ Platform Details ------------------------------------------------------------ 1. uname -a -Linux fece196767e4 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux +Linux 3cb20f87a9b6 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux ------------------------------------------------------------ 2. w - 21:13:53 up 14 days, 22:12, 0 users, load average: 0.97, 1.14, 1.53 + 19:47:42 up 17 days, 20:46, 0 users, load average: 0.86, 1.15, 1.70 USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT ------------------------------------------------------------ 3. Username @@ -40,7 +40,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 2830.828 +cpu MHz : 5500.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -96,7 +96,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 800.000 +cpu MHz : 5500.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -152,7 +152,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 800.000 +cpu MHz : 5500.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -208,7 +208,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 3892.827 +cpu MHz : 800.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -320,7 +320,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 2290.646 +cpu MHz : 5500.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -376,7 +376,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 2426.779 +cpu MHz : 5499.952 cache size : 36864 KB physical id : 0 siblings : 32 @@ -432,7 +432,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 3272.091 +cpu MHz : 5500.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -516,7 +516,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 800.000 +cpu MHz : 4300.202 cache size : 36864 KB physical id : 0 siblings : 32 @@ -544,7 +544,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 800.000 +cpu MHz : 4203.750 cache size : 36864 KB physical id : 0 siblings : 32 @@ -572,7 +572,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 1704.813 +cpu MHz : 800.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -600,7 +600,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 1639.849 +cpu MHz : 4251.282 cache size : 36864 KB physical id : 0 siblings : 32 @@ -768,7 +768,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 1764.953 +cpu MHz : 800.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -796,7 +796,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 800.000 +cpu MHz : 4347.500 cache size : 36864 KB physical id : 0 siblings : 32 @@ -852,7 +852,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 800.000 +cpu MHz : 4299.986 cache size : 36864 KB physical id : 0 siblings : 32 @@ -880,7 +880,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 1679.950 +cpu MHz : 800.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -946,7 +946,7 @@ CPU family: 6 Model: 183 Model name: 13th Gen Intel(R) Core(TM) i9-13900K Stepping: 1 -CPU MHz: 2830.828 +CPU MHz: 5500.000 CPU max MHz: 5800.0000 CPU min MHz: 800.0000 BogoMIPS: 5990.40 @@ -975,49 +975,49 @@ Flags: fpu vme de pse tsc msr pae mce cx8 apic se available: 1 nodes (0) node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 node 0 size: 128549 MB -node 0 free: 18883 MB +node 0 free: 20349 MB node distances: node 0 0: 10 ------------------------------------------------------------ 9. /proc/meminfo MemTotal: 131634476 kB -MemFree: 19336540 kB -MemAvailable: 127303980 kB -Buffers: 336092 kB -Cached: 104881092 kB -SwapCached: 21780 kB -Active: 2956976 kB -Inactive: 102641320 kB -Active(anon): 428720 kB -Inactive(anon): 98580 kB -Active(file): 2528256 kB -Inactive(file): 102542740 kB -Unevictable: 105328 kB +MemFree: 20837568 kB +MemAvailable: 127211808 kB +Buffers: 331380 kB +Cached: 103285952 kB +SwapCached: 27692 kB +Active: 1511688 kB +Inactive: 102448672 kB +Active(anon): 397040 kB +Inactive(anon): 86440 kB +Active(file): 1114648 kB +Inactive(file): 102362232 kB +Unevictable: 98284 kB Mlocked: 0 kB SwapTotal: 1023999996 kB -SwapFree: 1023670012 kB +SwapFree: 1023665916 kB Zswap: 0 kB Zswapped: 0 kB -Dirty: 20924 kB -Writeback: 0 kB -AnonPages: 481160 kB -Mapped: 304188 kB -Shmem: 146152 kB -KReclaimable: 4148256 kB -Slab: 4916692 kB -SReclaimable: 4148256 kB -SUnreclaim: 768436 kB -KernelStack: 15568 kB -PageTables: 21408 kB +Dirty: 22420 kB +Writeback: 16 kB +AnonPages: 431100 kB +Mapped: 260376 kB +Shmem: 140444 kB +KReclaimable: 4149172 kB +Slab: 4919080 kB +SReclaimable: 4149172 kB +SUnreclaim: 769908 kB +KernelStack: 15520 kB +PageTables: 21460 kB SecPageTables: 0 kB NFS_Unstable: 0 kB Bounce: 0 kB WritebackTmp: 0 kB CommitLimit: 1089817232 kB -Committed_AS: 5163908 kB +Committed_AS: 5146956 kB VmallocTotal: 34359738367 kB -VmallocUsed: 375236 kB +VmallocUsed: 375180 kB VmallocChunk: 0 kB Percpu: 35584 kB HardwareCorrupted: 0 kB @@ -1033,8 +1033,8 @@ HugePages_Rsvd: 0 HugePages_Surp: 0 Hugepagesize: 2048 kB Hugetlb: 0 kB -DirectMap4k: 29726156 kB -DirectMap2M: 103178240 kB +DirectMap4k: 32128460 kB +DirectMap2M: 100775936 kB DirectMap1G: 1048576 kB ------------------------------------------------------------ 10. who -r @@ -1291,7 +1291,7 @@ dev.tty.ldisc_autoload = 1 dev.tty.legacy_tiocsti = 0 fs.aio-max-nr = 65536 fs.aio-nr = 0 -fs.dentry-state = 1670718 1401642 45 0 769947 0 +fs.dentry-state = 1810505 1540729 45 0 910546 0 fs.dir-notify-enable = 1 fs.epoll.max_user_watches = 29287112 fs.fanotify.max_queued_events = 16384 @@ -1299,8 +1299,8 @@ fs.fanotify.max_user_groups = 128 fs.fanotify.max_user_marks = 1048576 fs.file-max = 9223372036854775807 fs.file-nr = 6688 0 9223372036854775807 -fs.inode-nr = 948834 56511 -fs.inode-state = 948834 56511 0 0 0 0 0 +fs.inode-nr = 944631 51860 +fs.inode-state = 944631 51860 0 0 0 0 0 fs.inotify.max_queued_events = 16384 fs.inotify.max_user_instances = 128 fs.inotify.max_user_watches = 65536 @@ -1328,7 +1328,7 @@ fs.quota.drops = 0 fs.quota.free_dquots = 0 fs.quota.lookups = 0 fs.quota.reads = 0 -fs.quota.syncs = 748 +fs.quota.syncs = 778 fs.quota.writes = 0 fs.suid_dumpable = 2 fs.verity.require_signatures = 0 @@ -1355,7 +1355,7 @@ kernel.ftrace_dump_on_oops = 0 kernel.ftrace_enabled = 1 kernel.hardlockup_all_cpu_backtrace = 0 kernel.hardlockup_panic = 0 -kernel.hostname = fece196767e4 +kernel.hostname = 3cb20f87a9b6 kernel.hotplug = kernel.hung_task_all_cpu_backtrace = 0 kernel.hung_task_check_count = 4194304 @@ -1424,7 +1424,7 @@ kernel.random.boot_id = df9374fa-6020-4b1a-8d05-62de67144998 kernel.random.entropy_avail = 256 kernel.random.poolsize = 256 kernel.random.urandom_min_reseed_secs = 60 -kernel.random.uuid = 6b352722-8ceb-4461-9624-f85b0602e77c +kernel.random.uuid = 7c5d8289-a98f-45dd-b3dc-6a49b87f7de0 kernel.random.write_wakeup_threshold = 256 kernel.randomize_va_space = 2 kernel.real-root-dev = 0 diff --git a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/system_info.txt b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/system_info.txt index bfa8e2347..32728fc80 100644 --- a/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/system_info.txt +++ b/open/MLCommons/measurements/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/system_info.txt @@ -2,10 +2,10 @@ Platform Details ------------------------------------------------------------ 1. uname -a -Linux fece196767e4 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux +Linux 3cb20f87a9b6 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux ------------------------------------------------------------ 2. w - 21:51:01 up 14 days, 22:49, 0 users, load average: 1.00, 1.00, 1.00 + 20:24:51 up 17 days, 21:23, 0 users, load average: 1.06, 1.01, 1.01 USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT ------------------------------------------------------------ 3. Username @@ -152,7 +152,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 5500.229 +cpu MHz : 800.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -208,7 +208,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 5500.000 +cpu MHz : 800.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -320,7 +320,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 800.000 +cpu MHz : 5500.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -376,7 +376,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 800.000 +cpu MHz : 5500.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -404,7 +404,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 800.000 +cpu MHz : 4540.738 cache size : 36864 KB physical id : 0 siblings : 32 @@ -488,7 +488,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 4289.102 +cpu MHz : 4299.920 cache size : 36864 KB physical id : 0 siblings : 32 @@ -544,7 +544,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 4328.110 +cpu MHz : 4285.884 cache size : 36864 KB physical id : 0 siblings : 32 @@ -572,7 +572,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 4312.139 +cpu MHz : 800.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -600,7 +600,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 4299.583 +cpu MHz : 800.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -628,7 +628,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 4300.023 +cpu MHz : 800.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -656,7 +656,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 800.000 +cpu MHz : 4299.876 cache size : 36864 KB physical id : 0 siblings : 32 @@ -684,7 +684,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 4295.942 +cpu MHz : 800.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -712,7 +712,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 800.000 +cpu MHz : 4356.603 cache size : 36864 KB physical id : 0 siblings : 32 @@ -796,7 +796,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 4300.019 +cpu MHz : 800.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -824,7 +824,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 800.000 +cpu MHz : 4305.847 cache size : 36864 KB physical id : 0 siblings : 32 @@ -852,7 +852,7 @@ model : 183 model name : 13th Gen Intel(R) Core(TM) i9-13900K stepping : 1 microcode : 0x129 -cpu MHz : 4300.422 +cpu MHz : 800.000 cache size : 36864 KB physical id : 0 siblings : 32 @@ -975,49 +975,49 @@ Flags: fpu vme de pse tsc msr pae mce cx8 apic se available: 1 nodes (0) node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 node 0 size: 128549 MB -node 0 free: 7962 MB +node 0 free: 7846 MB node distances: node 0 0: 10 ------------------------------------------------------------ 9. /proc/meminfo MemTotal: 131634476 kB -MemFree: 8153576 kB -MemAvailable: 127728160 kB -Buffers: 318500 kB -Cached: 116145292 kB -SwapCached: 21840 kB -Active: 4138992 kB -Inactive: 112715996 kB -Active(anon): 439416 kB -Inactive(anon): 98240 kB -Active(file): 3699576 kB -Inactive(file): 112617756 kB -Unevictable: 105328 kB +MemFree: 8034752 kB +MemAvailable: 127693936 kB +Buffers: 327464 kB +Cached: 116206000 kB +SwapCached: 27584 kB +Active: 1731500 kB +Inactive: 115155356 kB +Active(anon): 408408 kB +Inactive(anon): 86440 kB +Active(file): 1323092 kB +Inactive(file): 115068916 kB +Unevictable: 98284 kB Mlocked: 0 kB SwapTotal: 1023999996 kB -SwapFree: 1023670012 kB +SwapFree: 1023666684 kB Zswap: 0 kB Zswapped: 0 kB -Dirty: 180 kB +Dirty: 0 kB Writeback: 0 kB -AnonPages: 491196 kB -Mapped: 266524 kB -Shmem: 146460 kB -KReclaimable: 4509064 kB -Slab: 5317888 kB -SReclaimable: 4509064 kB -SUnreclaim: 808824 kB -KernelStack: 15600 kB -PageTables: 21208 kB +AnonPages: 441704 kB +Mapped: 262148 kB +Shmem: 141456 kB +KReclaimable: 4518988 kB +Slab: 5332844 kB +SReclaimable: 4518988 kB +SUnreclaim: 813856 kB +KernelStack: 15392 kB +PageTables: 21284 kB SecPageTables: 0 kB NFS_Unstable: 0 kB Bounce: 0 kB WritebackTmp: 0 kB CommitLimit: 1089817232 kB -Committed_AS: 5170280 kB +Committed_AS: 5170508 kB VmallocTotal: 34359738367 kB -VmallocUsed: 375252 kB +VmallocUsed: 375084 kB VmallocChunk: 0 kB Percpu: 35584 kB HardwareCorrupted: 0 kB @@ -1033,8 +1033,8 @@ HugePages_Rsvd: 0 HugePages_Surp: 0 Hugepagesize: 2048 kB Hugetlb: 0 kB -DirectMap4k: 29892044 kB -DirectMap2M: 103012352 kB +DirectMap4k: 32304588 kB +DirectMap2M: 100599808 kB DirectMap1G: 1048576 kB ------------------------------------------------------------ 10. who -r @@ -1291,16 +1291,16 @@ dev.tty.ldisc_autoload = 1 dev.tty.legacy_tiocsti = 0 fs.aio-max-nr = 65536 fs.aio-nr = 0 -fs.dentry-state = 1685946 1413289 45 0 775651 0 +fs.dentry-state = 1825764 1552394 45 0 916253 0 fs.dir-notify-enable = 1 fs.epoll.max_user_watches = 29287112 fs.fanotify.max_queued_events = 16384 fs.fanotify.max_user_groups = 128 fs.fanotify.max_user_marks = 1048576 fs.file-max = 9223372036854775807 -fs.file-nr = 6816 0 9223372036854775807 -fs.inode-nr = 958352 56511 -fs.inode-state = 958352 56511 0 0 0 0 0 +fs.file-nr = 6304 0 9223372036854775807 +fs.inode-nr = 954177 51860 +fs.inode-state = 954177 51860 0 0 0 0 0 fs.inotify.max_queued_events = 16384 fs.inotify.max_user_instances = 128 fs.inotify.max_user_watches = 65536 @@ -1328,7 +1328,7 @@ fs.quota.drops = 0 fs.quota.free_dquots = 0 fs.quota.lookups = 0 fs.quota.reads = 0 -fs.quota.syncs = 748 +fs.quota.syncs = 778 fs.quota.writes = 0 fs.suid_dumpable = 2 fs.verity.require_signatures = 0 @@ -1355,7 +1355,7 @@ kernel.ftrace_dump_on_oops = 0 kernel.ftrace_enabled = 1 kernel.hardlockup_all_cpu_backtrace = 0 kernel.hardlockup_panic = 0 -kernel.hostname = fece196767e4 +kernel.hostname = 3cb20f87a9b6 kernel.hotplug = kernel.hung_task_all_cpu_backtrace = 0 kernel.hung_task_check_count = 4194304 @@ -1387,7 +1387,7 @@ kernel.msgmnb = 16384 kernel.msgmni = 32000 kernel.ngroups_max = 65536 kernel.nmi_watchdog = 1 -kernel.ns_last_pid = 17516 +kernel.ns_last_pid = 17515 kernel.numa_balancing = 0 kernel.numa_balancing_promote_rate_limit_MBps = 65536 kernel.oops_all_cpu_backtrace = 0 @@ -1424,7 +1424,7 @@ kernel.random.boot_id = df9374fa-6020-4b1a-8d05-62de67144998 kernel.random.entropy_avail = 256 kernel.random.poolsize = 256 kernel.random.urandom_min_reseed_secs = 60 -kernel.random.uuid = 959ceabe-076a-4527-ab48-7d2831693510 +kernel.random.uuid = 7442c72b-4328-4839-9294-d2d4f032605d kernel.random.write_wakeup_threshold = 256 kernel.randomize_va_space = 2 kernel.real-root-dev = 0 diff --git a/open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/accuracy/mlperf_log_detail.txt b/open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/accuracy/mlperf_log_detail.txt index 5e121a908..d3236fbb8 100644 --- a/open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/accuracy/mlperf_log_detail.txt +++ b/open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/accuracy/mlperf_log_detail.txt @@ -1,69 +1,69 @@ -:::MLLOG {"key": "loadgen_version", "value": "4.0 @ 486a629ea4", "time_ms": 0.005307, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 53, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "loadgen_build_date_local", "value": "2024-12-24T20:54:17.813696", "time_ms": 0.005307, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 55, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "loadgen_build_date_utc", "value": "2024-12-25T04:54:17.813701", "time_ms": 0.005307, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 56, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "loadgen_git_commit_date", "value": "2024-02-15T15:46:50-05:00", "time_ms": 0.005307, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 57, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "loadgen_git_log_message", "value": "486a629ea4d5c5150f452d0b0a196bf71fd2021e Hotfix: DLRMv2 Audit Test01 fallback failure (#1626)\nf9a643c0a0e920588da1b51a1d822e1071a9dbec Add number of tokens to offline (#1623)\nf06b920eac2170df38b5502c7443f50c9afa6045 Bugfix: equal-issue mode on offline causing accuracy run to fail (3D-UNet) (#1624)\n0ed5190e82e1ca1cf95626e50e61cb6678c7f2ff Fix submission checker and TEST06 for Llama2 (#1616)\n817dd961221d3ca284b024368130bd5dc5e4b54a Turn equal issue mode off for TEST06 (#1615)\n840435a1abe8be823e0a5a18ad3173bc520aa24f Update README.md with CM commands to download stable-diffusion, gptj and dlrmv2 models (#1604)\n3190d09a148bc1d72c9d946e4cf3b54db0d0e60a Typo fix in README.md (#1588)\nb0777f0bd3b7e5cd6a51d670d8b4df656cf6fb29 Update README.md - remove unwanted lines in CM commands (#1601)\nd7dba0826ac96a0e8bcae525086961e47c409a38 Remove loadgen warnings (#1608)\nd45a66c33bb0b6548d6172b38645bf94ffe24b39 Add upper limit to tokens per sample (#1612)\n44285d9a44041c3d4f7df0acf1e72c375e9fcbd2 Set completed samples per second as llama metric (#1613)\n357ccefca4db55ff373e029d5d1e3e6246bde5d4 Enable equal issue mode for LLM benchmarks (#1610)\n104d85531af7ae2a07ded36dd6e8c7f2c7746d06 Add sample length check to test06 (#1603)\n473053fc9f1b8c5edf60e11ec74607126938fbc4 Fix loadgen token metrics latency constrains (#1596)\ncc3daae3c7f18d7eedc5ffbc271d324e5aca6233 #1598: fix token and sample logging for Llama2 when accuracy_log_sampling_target is enabled (#1599)\n3a902e598e5a17013c26fea975c0a60e6d7feae1 Add support to dump 10 compliance images during accuracy run for SDXL (#1591)", "time_ms": 0.005307, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 58, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "loadgen_git_status_message", "value": "", "time_ms": 0.005307, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 60, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "loadgen_file_sha1", "value": {"/.clang-format":"012aad77e5206c89d50718c46c119d1f3cb056b2","/CMakeLists.txt":"05d4a62d355a90363847358e58afeee4a54ad838","/README.md":"20a55bb946c2c0bbb564ced2af1e48efd096b3a8","/README_BUILD.md":"5f6c6a784e9cd6995db47f9b9f70b1769909c9d8","/README_FAQ.md":"01f9ae9887f50bc030dc6107e740f40c43ca388f","/bindings/c_api.cc":"32181da9e161c285f8fe46ddaa49e6cba2f9f918","/bindings/c_api.h":"91f58bd79b83b278f3240174a9af747fc38aff74","/bindings/python_api.cc":"1dc0865130371c6a8ddb97cd8039244d74d6fe46","/demos/py_demo_multi_stream.py":"6ccf7dcbe08f8382ed2d3618370c2b21e205ca13","/demos/py_demo_offline.py":"6c3075538e0a3df5e93edee917f4537099759e11","/demos/py_demo_server.py":"40e37ea121ac08b21ed6af41aca8eb5eda641b89","/demos/py_demo_single_stream.py":"4ee5f048fb0dffc415342a2bc2049fb155bd2894","/diagram_network_submission.png":"53dba8ad4272190ceb6335c12fd25e53dc02a8cb","/diagram_submission.png":"84c2f79309b237cef652aef6a187ba8e875a3952","/early_stopping.cc":"0cd7b546a389deac73f7955cd39255ed76557d62","/early_stopping.h":"158fcae6a5f47e82150d6416fa1f7bcef37e77fe","/issue_query_controller.cc":"126e952d00f4ea9efd12405fb209aa3ed585e4b2","/issue_query_controller.h":"923d9d5cdf598e3ec33d7a1110a31f7e11527ec7","/loadgen.cc":"6650091ba7a918f343b06eb7a5aa540eae87275f","/loadgen.h":"e00fdc6dbc85a8c9a8485dbcbfe2944f81251c4e","/loadgen_integration_diagram.svg":"47f748307536f80cfc606947b440dd732afc2637","/logging.cc":"197efc96d178e5d33a750d07fa7b2966417506ea","/logging.h":"ddb961df7bcc145bcd7cce8c21f7cf075350dcbe","/pyproject.toml":"974adb632af4b76a1c72b914cc2cf9b3cbc66aa3","/query_dispatch_library.h":"13ad6d842200cb161d6927eb74a3fafd79c46c75","/query_sample.h":"e9187c8612bbdc972305b789feb6e15c26e96cfe","/query_sample_library.h":"8323a2225be1dff31f08ecc86b76eb3de06568bc","/requirements.txt":"a5ff7e77caa6e9e22ada90f0de0c865c987bf167","/results.cc":"a170f991de69f8a5e45616e871b39a30ffed5598","/results.h":"d82500c326c2de83db411f1146882aa4692b419c","/setup.py":"e3e707e1191478332c00f1b6ff806f0ef98e0f65","/system_under_test.h":"18d4809589dae33317d88d9beeb5491a6e1ccdec","/test_settings.h":"aaf3803e700f3431a5ada72559eef5cce996ea64","/test_settings_internal.cc":"42aa46b17ac3fb2748cd5cde60fa8742e916f3c8","/test_settings_internal.h":"73b11c02228f3afb4c924db7a86fd8a2b5b9e483","/utils.cc":"3df8fdabf6eaea4697cf25d1dcb89cae88e36efd","/utils.h":"40775e32d619ea6356826ae5ea4174c7911f6894","/version.cc":"cbec2a5f98f9786c8c3d8b06b3d12df0b6550fa0","/version.h":"9d574baa64424e9c708fcfedd3dbb0b518a65fcc","/version_generator.py":"4c9d98360b507d5673049ed70154fcfb2934f8a6"}, "time_ms": 0.005307, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 67, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "test_datetime", "value": "2024-12-24T21:14:25Z", "time_ms": 0.009343, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1198, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "sut_name", "value": "Server_3DUNet", "time_ms": 0.009343, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1199, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "get_sut_name_duration_ns", "value": 269, "time_ms": 0.009343, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1200, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "qsl_name", "value": "LWIS_SampleLibrary", "time_ms": 0.009343, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1201, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "qsl_reported_total_count", "value": 43, "time_ms": 0.009343, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1202, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "qsl_reported_performance_count", "value": 43, "time_ms": 0.009343, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1203, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_scenario", "value": "SingleStream", "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 268, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_test_mode", "value": "AccuracyOnly", "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 269, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_single_stream_expected_latency_ns", "value": 2.02338e+08, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 274, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_single_stream_target_latency_percentile", "value": 0.9, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 276, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_min_duration_ms", "value": 600000, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 312, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_max_duration_ms", "value": 0, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 313, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_min_query_count", "value": 100, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 314, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_max_query_count", "value": 0, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 315, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_qsl_rng_seed", "value": 3066443479025735752, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 316, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_sample_index_rng_seed", "value": 10688027786191513374, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 317, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_schedule_rng_seed", "value": 14962580496156340209, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 319, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_accuracy_log_rng_seed", "value": 0, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 320, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_accuracy_log_probability", "value": 0, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 322, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_accuracy_log_sampling_target", "value": 0, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 324, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_print_timestamps", "value": false, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 326, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_performance_issue_unique", "value": false, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 327, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_performance_issue_same", "value": false, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 329, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_performance_issue_same_index", "value": 0, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 331, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "requested_performance_sample_count_override", "value": 0, "time_ms": 0.026886, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 333, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_scenario", "value": "SingleStream", "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 409, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_test_mode", "value": "AccuracyOnly", "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 410, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_samples_per_query", "value": 1, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 412, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_target_qps", "value": 4.94223, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 413, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_target_latency_ns", "value": 0, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 414, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_target_latency_percentile", "value": 0.9, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 415, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_max_async_queries", "value": 1, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 417, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_target_duration_ms", "value": 600000, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 418, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_min_duration_ms", "value": 600000, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 420, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_max_duration_ms", "value": 0, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 421, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_min_query_count", "value": 5934, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 422, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_max_query_count", "value": 0, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 423, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_min_sample_count", "value": 5934, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 424, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_qsl_rng_seed", "value": 3066443479025735752, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 425, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_sample_index_rng_seed", "value": 10688027786191513374, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 426, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_schedule_rng_seed", "value": 14962580496156340209, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 428, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_accuracy_log_rng_seed", "value": 0, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 429, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_accuracy_log_probability", "value": 0, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 431, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_accuracy_log_sampling_target", "value": 0, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 433, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_print_timestamps", "value": false, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 435, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_performance_issue_unique", "value": false, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 436, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_performance_issue_same", "value": false, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 438, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_performance_issue_same_index", "value": 0, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 440, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "effective_performance_sample_count", "value": 43, "time_ms": 0.026965, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 442, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "generic_message", "value": "Starting accuracy mode", "time_ms": 0.027887, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1090, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "loaded_qsl_set", "value": [42,25,26,37,2,23,3,10,30,4,33,15,41,6,36,0,32,35,9,29,24,1,31,39,28,27,17,13,20,7,40,19,5,14,12,11,16,21,8,34,22,38,18], "time_ms": 0.034404, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 613, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "generated_query_count", "value": 43, "time_ms": 376.180298, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 428, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "generated_samples_per_query", "value": 1, "time_ms": 376.180298, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 429, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "generated_query_duration", "value": 8700527507, "time_ms": 376.180298, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 430, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "logger_swap_request_slots_retry_count", "value": 0, "time_ms": 10276.979439, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 898, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "logger_swap_request_slots_retry_retry_count", "value": 0, "time_ms": 10276.979439, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 900, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "logger_swap_request_slots_retry_reencounter_count", "value": 0, "time_ms": 10276.979439, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 902, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "logger_start_reading_entries_retry_count", "value": 0, "time_ms": 10276.979439, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 904, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "logger_tls_total_log_cas_fail_count", "value": 0, "time_ms": 10276.979439, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 906, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "logger_tls_total_swap_buffers_slot_retry_count", "value": 0, "time_ms": 10276.979439, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 908, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "power_begin", "value": "12-25-2024 05:14:25.960", "time_ms": 10276.979884, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 564, "pid": 13210, "tid": 13210}} -:::MLLOG {"key": "power_end", "value": "12-25-2024 05:14:35.796", "time_ms": 10276.979884, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 566, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "loadgen_version", "value": "4.0 @ 486a629ea4", "time_ms": 0.010718, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 53, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "loadgen_build_date_local", "value": "2024-12-27T19:28:05.892677", "time_ms": 0.010718, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 55, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "loadgen_build_date_utc", "value": "2024-12-28T03:28:05.892681", "time_ms": 0.010718, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 56, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "loadgen_git_commit_date", "value": "2024-02-15T15:46:50-05:00", "time_ms": 0.010718, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 57, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "loadgen_git_log_message", "value": "486a629ea4d5c5150f452d0b0a196bf71fd2021e Hotfix: DLRMv2 Audit Test01 fallback failure (#1626)\nf9a643c0a0e920588da1b51a1d822e1071a9dbec Add number of tokens to offline (#1623)\nf06b920eac2170df38b5502c7443f50c9afa6045 Bugfix: equal-issue mode on offline causing accuracy run to fail (3D-UNet) (#1624)\n0ed5190e82e1ca1cf95626e50e61cb6678c7f2ff Fix submission checker and TEST06 for Llama2 (#1616)\n817dd961221d3ca284b024368130bd5dc5e4b54a Turn equal issue mode off for TEST06 (#1615)\n840435a1abe8be823e0a5a18ad3173bc520aa24f Update README.md with CM commands to download stable-diffusion, gptj and dlrmv2 models (#1604)\n3190d09a148bc1d72c9d946e4cf3b54db0d0e60a Typo fix in README.md (#1588)\nb0777f0bd3b7e5cd6a51d670d8b4df656cf6fb29 Update README.md - remove unwanted lines in CM commands (#1601)\nd7dba0826ac96a0e8bcae525086961e47c409a38 Remove loadgen warnings (#1608)\nd45a66c33bb0b6548d6172b38645bf94ffe24b39 Add upper limit to tokens per sample (#1612)\n44285d9a44041c3d4f7df0acf1e72c375e9fcbd2 Set completed samples per second as llama metric (#1613)\n357ccefca4db55ff373e029d5d1e3e6246bde5d4 Enable equal issue mode for LLM benchmarks (#1610)\n104d85531af7ae2a07ded36dd6e8c7f2c7746d06 Add sample length check to test06 (#1603)\n473053fc9f1b8c5edf60e11ec74607126938fbc4 Fix loadgen token metrics latency constrains (#1596)\ncc3daae3c7f18d7eedc5ffbc271d324e5aca6233 #1598: fix token and sample logging for Llama2 when accuracy_log_sampling_target is enabled (#1599)\n3a902e598e5a17013c26fea975c0a60e6d7feae1 Add support to dump 10 compliance images during accuracy run for SDXL (#1591)", "time_ms": 0.010718, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 58, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "loadgen_git_status_message", "value": "", "time_ms": 0.010718, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 60, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "loadgen_file_sha1", "value": {"/.clang-format":"012aad77e5206c89d50718c46c119d1f3cb056b2","/CMakeLists.txt":"05d4a62d355a90363847358e58afeee4a54ad838","/README.md":"20a55bb946c2c0bbb564ced2af1e48efd096b3a8","/README_BUILD.md":"5f6c6a784e9cd6995db47f9b9f70b1769909c9d8","/README_FAQ.md":"01f9ae9887f50bc030dc6107e740f40c43ca388f","/bindings/c_api.cc":"32181da9e161c285f8fe46ddaa49e6cba2f9f918","/bindings/c_api.h":"91f58bd79b83b278f3240174a9af747fc38aff74","/bindings/python_api.cc":"1dc0865130371c6a8ddb97cd8039244d74d6fe46","/demos/py_demo_multi_stream.py":"6ccf7dcbe08f8382ed2d3618370c2b21e205ca13","/demos/py_demo_offline.py":"6c3075538e0a3df5e93edee917f4537099759e11","/demos/py_demo_server.py":"40e37ea121ac08b21ed6af41aca8eb5eda641b89","/demos/py_demo_single_stream.py":"4ee5f048fb0dffc415342a2bc2049fb155bd2894","/diagram_network_submission.png":"53dba8ad4272190ceb6335c12fd25e53dc02a8cb","/diagram_submission.png":"84c2f79309b237cef652aef6a187ba8e875a3952","/early_stopping.cc":"0cd7b546a389deac73f7955cd39255ed76557d62","/early_stopping.h":"158fcae6a5f47e82150d6416fa1f7bcef37e77fe","/issue_query_controller.cc":"126e952d00f4ea9efd12405fb209aa3ed585e4b2","/issue_query_controller.h":"923d9d5cdf598e3ec33d7a1110a31f7e11527ec7","/loadgen.cc":"6650091ba7a918f343b06eb7a5aa540eae87275f","/loadgen.h":"e00fdc6dbc85a8c9a8485dbcbfe2944f81251c4e","/loadgen_integration_diagram.svg":"47f748307536f80cfc606947b440dd732afc2637","/logging.cc":"197efc96d178e5d33a750d07fa7b2966417506ea","/logging.h":"ddb961df7bcc145bcd7cce8c21f7cf075350dcbe","/pyproject.toml":"974adb632af4b76a1c72b914cc2cf9b3cbc66aa3","/query_dispatch_library.h":"13ad6d842200cb161d6927eb74a3fafd79c46c75","/query_sample.h":"e9187c8612bbdc972305b789feb6e15c26e96cfe","/query_sample_library.h":"8323a2225be1dff31f08ecc86b76eb3de06568bc","/requirements.txt":"a5ff7e77caa6e9e22ada90f0de0c865c987bf167","/results.cc":"a170f991de69f8a5e45616e871b39a30ffed5598","/results.h":"d82500c326c2de83db411f1146882aa4692b419c","/setup.py":"e3e707e1191478332c00f1b6ff806f0ef98e0f65","/system_under_test.h":"18d4809589dae33317d88d9beeb5491a6e1ccdec","/test_settings.h":"aaf3803e700f3431a5ada72559eef5cce996ea64","/test_settings_internal.cc":"42aa46b17ac3fb2748cd5cde60fa8742e916f3c8","/test_settings_internal.h":"73b11c02228f3afb4c924db7a86fd8a2b5b9e483","/utils.cc":"3df8fdabf6eaea4697cf25d1dcb89cae88e36efd","/utils.h":"40775e32d619ea6356826ae5ea4174c7911f6894","/version.cc":"cbec2a5f98f9786c8c3d8b06b3d12df0b6550fa0","/version.h":"9d574baa64424e9c708fcfedd3dbb0b518a65fcc","/version_generator.py":"4c9d98360b507d5673049ed70154fcfb2934f8a6"}, "time_ms": 0.010718, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 67, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "test_datetime", "value": "2024-12-27T19:48:15Z", "time_ms": 0.014555, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1198, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "sut_name", "value": "Server_3DUNet", "time_ms": 0.014555, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1199, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "get_sut_name_duration_ns", "value": 218, "time_ms": 0.014555, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1200, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "qsl_name", "value": "LWIS_SampleLibrary", "time_ms": 0.014555, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1201, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "qsl_reported_total_count", "value": 43, "time_ms": 0.014555, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1202, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "qsl_reported_performance_count", "value": 43, "time_ms": 0.014555, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1203, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_scenario", "value": "SingleStream", "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 268, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_test_mode", "value": "AccuracyOnly", "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 269, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_single_stream_expected_latency_ns", "value": 2.02404e+08, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 274, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_single_stream_target_latency_percentile", "value": 0.9, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 276, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_min_duration_ms", "value": 600000, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 312, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_max_duration_ms", "value": 0, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 313, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_min_query_count", "value": 100, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 314, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_max_query_count", "value": 0, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 315, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_qsl_rng_seed", "value": 3066443479025735752, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 316, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_sample_index_rng_seed", "value": 10688027786191513374, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 317, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_schedule_rng_seed", "value": 14962580496156340209, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 319, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_accuracy_log_rng_seed", "value": 0, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 320, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_accuracy_log_probability", "value": 0, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 322, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_accuracy_log_sampling_target", "value": 0, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 324, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_print_timestamps", "value": false, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 326, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_performance_issue_unique", "value": false, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 327, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_performance_issue_same", "value": false, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 329, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_performance_issue_same_index", "value": 0, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 331, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "requested_performance_sample_count_override", "value": 0, "time_ms": 0.019123, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 333, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_scenario", "value": "SingleStream", "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 409, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_test_mode", "value": "AccuracyOnly", "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 410, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_samples_per_query", "value": 1, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 412, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_target_qps", "value": 4.94061, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 413, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_target_latency_ns", "value": 0, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 414, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_target_latency_percentile", "value": 0.9, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 415, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_max_async_queries", "value": 1, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 417, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_target_duration_ms", "value": 600000, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 418, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_min_duration_ms", "value": 600000, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 420, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_max_duration_ms", "value": 0, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 421, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_min_query_count", "value": 5934, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 422, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_max_query_count", "value": 0, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 423, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_min_sample_count", "value": 5934, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 424, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_qsl_rng_seed", "value": 3066443479025735752, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 425, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_sample_index_rng_seed", "value": 10688027786191513374, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 426, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_schedule_rng_seed", "value": 14962580496156340209, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 428, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_accuracy_log_rng_seed", "value": 0, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 429, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_accuracy_log_probability", "value": 0, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 431, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_accuracy_log_sampling_target", "value": 0, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 433, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_print_timestamps", "value": false, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 435, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_performance_issue_unique", "value": false, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 436, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_performance_issue_same", "value": false, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 438, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_performance_issue_same_index", "value": 0, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 440, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "effective_performance_sample_count", "value": 43, "time_ms": 0.019328, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 442, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "generic_message", "value": "Starting accuracy mode", "time_ms": 0.020208, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1090, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "loaded_qsl_set", "value": [42,25,26,37,2,23,3,10,30,4,33,15,41,6,36,0,32,35,9,29,24,1,31,39,28,27,17,13,20,7,40,19,5,14,12,11,16,21,8,34,22,38,18], "time_ms": 0.023964, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 613, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "generated_query_count", "value": 43, "time_ms": 370.032210, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 428, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "generated_samples_per_query", "value": 1, "time_ms": 370.032210, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 429, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "generated_query_duration", "value": 8703381460, "time_ms": 370.032210, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 430, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "logger_swap_request_slots_retry_count", "value": 0, "time_ms": 10255.068876, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 898, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "logger_swap_request_slots_retry_retry_count", "value": 0, "time_ms": 10255.068876, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 900, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "logger_swap_request_slots_retry_reencounter_count", "value": 0, "time_ms": 10255.068876, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 902, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "logger_start_reading_entries_retry_count", "value": 0, "time_ms": 10255.068876, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 904, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "logger_tls_total_log_cas_fail_count", "value": 0, "time_ms": 10255.068876, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 906, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "logger_tls_total_swap_buffers_slot_retry_count", "value": 0, "time_ms": 10255.068876, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 908, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "power_begin", "value": "12-28-2024 03:48:16.343", "time_ms": 10255.069419, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 564, "pid": 13210, "tid": 13210}} +:::MLLOG {"key": "power_end", "value": "12-28-2024 03:48:26.168", "time_ms": 10255.069419, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 566, "pid": 13210, "tid": 13210}} diff --git a/open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/performance/run_1/mlperf_log_detail.txt b/open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/performance/run_1/mlperf_log_detail.txt index 5f7bd9c5f..b447ef055 100644 --- a/open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/performance/run_1/mlperf_log_detail.txt +++ b/open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/performance/run_1/mlperf_log_detail.txt @@ -1,89 +1,89 @@ -:::MLLOG {"key": "loadgen_version", "value": "4.0 @ 486a629ea4", "time_ms": 0.004968, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 53, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "loadgen_build_date_local", "value": "2024-12-24T20:54:17.813696", "time_ms": 0.004968, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 55, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "loadgen_build_date_utc", "value": "2024-12-25T04:54:17.813701", "time_ms": 0.004968, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 56, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "loadgen_git_commit_date", "value": "2024-02-15T15:46:50-05:00", "time_ms": 0.004968, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 57, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "loadgen_git_log_message", "value": "486a629ea4d5c5150f452d0b0a196bf71fd2021e Hotfix: DLRMv2 Audit Test01 fallback failure (#1626)\nf9a643c0a0e920588da1b51a1d822e1071a9dbec Add number of tokens to offline (#1623)\nf06b920eac2170df38b5502c7443f50c9afa6045 Bugfix: equal-issue mode on offline causing accuracy run to fail (3D-UNet) (#1624)\n0ed5190e82e1ca1cf95626e50e61cb6678c7f2ff Fix submission checker and TEST06 for Llama2 (#1616)\n817dd961221d3ca284b024368130bd5dc5e4b54a Turn equal issue mode off for TEST06 (#1615)\n840435a1abe8be823e0a5a18ad3173bc520aa24f Update README.md with CM commands to download stable-diffusion, gptj and dlrmv2 models (#1604)\n3190d09a148bc1d72c9d946e4cf3b54db0d0e60a Typo fix in README.md (#1588)\nb0777f0bd3b7e5cd6a51d670d8b4df656cf6fb29 Update README.md - remove unwanted lines in CM commands (#1601)\nd7dba0826ac96a0e8bcae525086961e47c409a38 Remove loadgen warnings (#1608)\nd45a66c33bb0b6548d6172b38645bf94ffe24b39 Add upper limit to tokens per sample (#1612)\n44285d9a44041c3d4f7df0acf1e72c375e9fcbd2 Set completed samples per second as llama metric (#1613)\n357ccefca4db55ff373e029d5d1e3e6246bde5d4 Enable equal issue mode for LLM benchmarks (#1610)\n104d85531af7ae2a07ded36dd6e8c7f2c7746d06 Add sample length check to test06 (#1603)\n473053fc9f1b8c5edf60e11ec74607126938fbc4 Fix loadgen token metrics latency constrains (#1596)\ncc3daae3c7f18d7eedc5ffbc271d324e5aca6233 #1598: fix token and sample logging for Llama2 when accuracy_log_sampling_target is enabled (#1599)\n3a902e598e5a17013c26fea975c0a60e6d7feae1 Add support to dump 10 compliance images during accuracy run for SDXL (#1591)", "time_ms": 0.004968, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 58, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "loadgen_git_status_message", "value": "", "time_ms": 0.004968, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 60, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "loadgen_file_sha1", "value": {"/.clang-format":"012aad77e5206c89d50718c46c119d1f3cb056b2","/CMakeLists.txt":"05d4a62d355a90363847358e58afeee4a54ad838","/README.md":"20a55bb946c2c0bbb564ced2af1e48efd096b3a8","/README_BUILD.md":"5f6c6a784e9cd6995db47f9b9f70b1769909c9d8","/README_FAQ.md":"01f9ae9887f50bc030dc6107e740f40c43ca388f","/bindings/c_api.cc":"32181da9e161c285f8fe46ddaa49e6cba2f9f918","/bindings/c_api.h":"91f58bd79b83b278f3240174a9af747fc38aff74","/bindings/python_api.cc":"1dc0865130371c6a8ddb97cd8039244d74d6fe46","/demos/py_demo_multi_stream.py":"6ccf7dcbe08f8382ed2d3618370c2b21e205ca13","/demos/py_demo_offline.py":"6c3075538e0a3df5e93edee917f4537099759e11","/demos/py_demo_server.py":"40e37ea121ac08b21ed6af41aca8eb5eda641b89","/demos/py_demo_single_stream.py":"4ee5f048fb0dffc415342a2bc2049fb155bd2894","/diagram_network_submission.png":"53dba8ad4272190ceb6335c12fd25e53dc02a8cb","/diagram_submission.png":"84c2f79309b237cef652aef6a187ba8e875a3952","/early_stopping.cc":"0cd7b546a389deac73f7955cd39255ed76557d62","/early_stopping.h":"158fcae6a5f47e82150d6416fa1f7bcef37e77fe","/issue_query_controller.cc":"126e952d00f4ea9efd12405fb209aa3ed585e4b2","/issue_query_controller.h":"923d9d5cdf598e3ec33d7a1110a31f7e11527ec7","/loadgen.cc":"6650091ba7a918f343b06eb7a5aa540eae87275f","/loadgen.h":"e00fdc6dbc85a8c9a8485dbcbfe2944f81251c4e","/loadgen_integration_diagram.svg":"47f748307536f80cfc606947b440dd732afc2637","/logging.cc":"197efc96d178e5d33a750d07fa7b2966417506ea","/logging.h":"ddb961df7bcc145bcd7cce8c21f7cf075350dcbe","/pyproject.toml":"974adb632af4b76a1c72b914cc2cf9b3cbc66aa3","/query_dispatch_library.h":"13ad6d842200cb161d6927eb74a3fafd79c46c75","/query_sample.h":"e9187c8612bbdc972305b789feb6e15c26e96cfe","/query_sample_library.h":"8323a2225be1dff31f08ecc86b76eb3de06568bc","/requirements.txt":"a5ff7e77caa6e9e22ada90f0de0c865c987bf167","/results.cc":"a170f991de69f8a5e45616e871b39a30ffed5598","/results.h":"d82500c326c2de83db411f1146882aa4692b419c","/setup.py":"e3e707e1191478332c00f1b6ff806f0ef98e0f65","/system_under_test.h":"18d4809589dae33317d88d9beeb5491a6e1ccdec","/test_settings.h":"aaf3803e700f3431a5ada72559eef5cce996ea64","/test_settings_internal.cc":"42aa46b17ac3fb2748cd5cde60fa8742e916f3c8","/test_settings_internal.h":"73b11c02228f3afb4c924db7a86fd8a2b5b9e483","/utils.cc":"3df8fdabf6eaea4697cf25d1dcb89cae88e36efd","/utils.h":"40775e32d619ea6356826ae5ea4174c7911f6894","/version.cc":"cbec2a5f98f9786c8c3d8b06b3d12df0b6550fa0","/version.h":"9d574baa64424e9c708fcfedd3dbb0b518a65fcc","/version_generator.py":"4c9d98360b507d5673049ed70154fcfb2934f8a6"}, "time_ms": 0.004968, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 67, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "test_datetime", "value": "2024-12-24T21:01:00Z", "time_ms": 0.009127, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1198, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "sut_name", "value": "Server_3DUNet", "time_ms": 0.009127, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1199, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "get_sut_name_duration_ns", "value": 217, "time_ms": 0.009127, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1200, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "qsl_name", "value": "LWIS_SampleLibrary", "time_ms": 0.009127, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1201, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "qsl_reported_total_count", "value": 43, "time_ms": 0.009127, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1202, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "qsl_reported_performance_count", "value": 43, "time_ms": 0.009127, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1203, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_scenario", "value": "SingleStream", "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 268, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_test_mode", "value": "PerformanceOnly", "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 269, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_single_stream_expected_latency_ns", "value": 3.6e+08, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 274, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_single_stream_target_latency_percentile", "value": 0.9, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 276, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_min_duration_ms", "value": 600000, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 312, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_max_duration_ms", "value": 0, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 313, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_min_query_count", "value": 100, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 314, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_max_query_count", "value": 0, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 315, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_qsl_rng_seed", "value": 3066443479025735752, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 316, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_sample_index_rng_seed", "value": 10688027786191513374, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 317, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_schedule_rng_seed", "value": 14962580496156340209, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 319, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_accuracy_log_rng_seed", "value": 0, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 320, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_accuracy_log_probability", "value": 0, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 322, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_accuracy_log_sampling_target", "value": 0, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 324, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_print_timestamps", "value": false, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 326, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_performance_issue_unique", "value": false, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 327, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_performance_issue_same", "value": false, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 329, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_performance_issue_same_index", "value": 0, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 331, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "requested_performance_sample_count_override", "value": 0, "time_ms": 0.012604, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 333, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_scenario", "value": "SingleStream", "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 409, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_test_mode", "value": "PerformanceOnly", "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 410, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_samples_per_query", "value": 1, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 412, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_target_qps", "value": 2.77778, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 413, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_target_latency_ns", "value": 0, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 414, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_target_latency_percentile", "value": 0.9, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 415, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_max_async_queries", "value": 1, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 417, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_target_duration_ms", "value": 600000, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 418, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_min_duration_ms", "value": 600000, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 420, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_max_duration_ms", "value": 0, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 421, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_min_query_count", "value": 3354, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 422, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_max_query_count", "value": 0, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 423, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_min_sample_count", "value": 3354, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 424, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_qsl_rng_seed", "value": 3066443479025735752, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 425, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_sample_index_rng_seed", "value": 10688027786191513374, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 426, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_schedule_rng_seed", "value": 14962580496156340209, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 428, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_accuracy_log_rng_seed", "value": 0, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 429, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_accuracy_log_probability", "value": 0, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 431, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_accuracy_log_sampling_target", "value": 0, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 433, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_print_timestamps", "value": false, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 435, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_performance_issue_unique", "value": false, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 436, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_performance_issue_same", "value": false, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 438, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_performance_issue_same_index", "value": 0, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 440, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "effective_performance_sample_count", "value": 43, "time_ms": 0.012693, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 442, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "generic_message", "value": "Starting performance mode", "time_ms": 0.016573, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 841, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "loaded_qsl_set", "value": [42,25,26,37,2,23,3,10,30,4,33,15,41,6,36,0,32,35,9,29,24,1,31,39,28,27,17,13,20,7,40,19,5,14,12,11,16,21,8,34,22,38,18], "time_ms": 0.027889, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 613, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "generated_query_count", "value": 3354, "time_ms": 370.308529, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 428, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "generated_samples_per_query", "value": 1, "time_ms": 370.308529, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 429, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "generated_query_duration", "value": 1207440000000, "time_ms": 370.308529, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 430, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "generic_message", "value": "Ending naturally: Minimum query count and test duration met.", "time_ms": 754500.779136, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/issue_query_controller.cc", "line_no": 482, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "logger_swap_request_slots_retry_count", "value": 0, "time_ms": 754618.381888, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 898, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "logger_swap_request_slots_retry_retry_count", "value": 0, "time_ms": 754618.381888, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 900, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "logger_swap_request_slots_retry_reencounter_count", "value": 0, "time_ms": 754618.381888, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 902, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "logger_start_reading_entries_retry_count", "value": 0, "time_ms": 754618.381888, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 904, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "logger_tls_total_log_cas_fail_count", "value": 0, "time_ms": 754618.381888, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 906, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "logger_tls_total_swap_buffers_slot_retry_count", "value": 0, "time_ms": 754618.381888, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 908, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "power_begin", "value": "12-25-2024 05:01:01.349", "time_ms": 754618.382091, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 564, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "power_end", "value": "12-25-2024 05:13:35.592", "time_ms": 754618.382091, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 566, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "result_validity", "value": "VALID", "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 644, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "result_min_duration_met", "value": true, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 649, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "result_min_queries_met", "value": true, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 650, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "early_stopping_met", "value": true, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 651, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "early_stopping_result", "value": " * Processed at least 64 queries (3354). * Would discard 294 highest latency queries. * Early stopping 90th percentile estimate: 437330110 * Early stopping 99th percentile estimate: 503219208", "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 669, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "result_query_count", "value": 3354, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 679, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "result_qps_with_loadgen_overhead", "value": 4.44618, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 702, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "result_qps_without_loadgen_overhead", "value": 4.44801, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 703, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "early_stopping_latency_ss", "value": 437330110, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 704, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "early_stopping_latency_ms", "value": 503219208, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 706, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "result_min_latency_ns", "value": 28717857, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 741, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "result_max_latency_ns", "value": 503573435, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 742, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "result_mean_latency_ns", "value": 224819833, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 743, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "result_50.00_percentile_latency_ns", "value": 175759007, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 745, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "result_90.00_percentile_latency_ns", "value": 437159808, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 745, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "result_95.00_percentile_latency_ns", "value": 502458917, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 745, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "result_97.00_percentile_latency_ns", "value": 502834841, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 745, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "result_99.00_percentile_latency_ns", "value": 503129116, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 745, "pid": 10088, "tid": 10088}} -:::MLLOG {"key": "result_99.90_percentile_latency_ns", "value": 503459579, "time_ms": 754618.580262, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 745, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "loadgen_version", "value": "4.0 @ 486a629ea4", "time_ms": 0.005642, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 53, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "loadgen_build_date_local", "value": "2024-12-27T19:28:05.892677", "time_ms": 0.005642, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 55, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "loadgen_build_date_utc", "value": "2024-12-28T03:28:05.892681", "time_ms": 0.005642, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 56, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "loadgen_git_commit_date", "value": "2024-02-15T15:46:50-05:00", "time_ms": 0.005642, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 57, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "loadgen_git_log_message", "value": "486a629ea4d5c5150f452d0b0a196bf71fd2021e Hotfix: DLRMv2 Audit Test01 fallback failure (#1626)\nf9a643c0a0e920588da1b51a1d822e1071a9dbec Add number of tokens to offline (#1623)\nf06b920eac2170df38b5502c7443f50c9afa6045 Bugfix: equal-issue mode on offline causing accuracy run to fail (3D-UNet) (#1624)\n0ed5190e82e1ca1cf95626e50e61cb6678c7f2ff Fix submission checker and TEST06 for Llama2 (#1616)\n817dd961221d3ca284b024368130bd5dc5e4b54a Turn equal issue mode off for TEST06 (#1615)\n840435a1abe8be823e0a5a18ad3173bc520aa24f Update README.md with CM commands to download stable-diffusion, gptj and dlrmv2 models (#1604)\n3190d09a148bc1d72c9d946e4cf3b54db0d0e60a Typo fix in README.md (#1588)\nb0777f0bd3b7e5cd6a51d670d8b4df656cf6fb29 Update README.md - remove unwanted lines in CM commands (#1601)\nd7dba0826ac96a0e8bcae525086961e47c409a38 Remove loadgen warnings (#1608)\nd45a66c33bb0b6548d6172b38645bf94ffe24b39 Add upper limit to tokens per sample (#1612)\n44285d9a44041c3d4f7df0acf1e72c375e9fcbd2 Set completed samples per second as llama metric (#1613)\n357ccefca4db55ff373e029d5d1e3e6246bde5d4 Enable equal issue mode for LLM benchmarks (#1610)\n104d85531af7ae2a07ded36dd6e8c7f2c7746d06 Add sample length check to test06 (#1603)\n473053fc9f1b8c5edf60e11ec74607126938fbc4 Fix loadgen token metrics latency constrains (#1596)\ncc3daae3c7f18d7eedc5ffbc271d324e5aca6233 #1598: fix token and sample logging for Llama2 when accuracy_log_sampling_target is enabled (#1599)\n3a902e598e5a17013c26fea975c0a60e6d7feae1 Add support to dump 10 compliance images during accuracy run for SDXL (#1591)", "time_ms": 0.005642, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 58, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "loadgen_git_status_message", "value": "", "time_ms": 0.005642, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 60, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "loadgen_file_sha1", "value": {"/.clang-format":"012aad77e5206c89d50718c46c119d1f3cb056b2","/CMakeLists.txt":"05d4a62d355a90363847358e58afeee4a54ad838","/README.md":"20a55bb946c2c0bbb564ced2af1e48efd096b3a8","/README_BUILD.md":"5f6c6a784e9cd6995db47f9b9f70b1769909c9d8","/README_FAQ.md":"01f9ae9887f50bc030dc6107e740f40c43ca388f","/bindings/c_api.cc":"32181da9e161c285f8fe46ddaa49e6cba2f9f918","/bindings/c_api.h":"91f58bd79b83b278f3240174a9af747fc38aff74","/bindings/python_api.cc":"1dc0865130371c6a8ddb97cd8039244d74d6fe46","/demos/py_demo_multi_stream.py":"6ccf7dcbe08f8382ed2d3618370c2b21e205ca13","/demos/py_demo_offline.py":"6c3075538e0a3df5e93edee917f4537099759e11","/demos/py_demo_server.py":"40e37ea121ac08b21ed6af41aca8eb5eda641b89","/demos/py_demo_single_stream.py":"4ee5f048fb0dffc415342a2bc2049fb155bd2894","/diagram_network_submission.png":"53dba8ad4272190ceb6335c12fd25e53dc02a8cb","/diagram_submission.png":"84c2f79309b237cef652aef6a187ba8e875a3952","/early_stopping.cc":"0cd7b546a389deac73f7955cd39255ed76557d62","/early_stopping.h":"158fcae6a5f47e82150d6416fa1f7bcef37e77fe","/issue_query_controller.cc":"126e952d00f4ea9efd12405fb209aa3ed585e4b2","/issue_query_controller.h":"923d9d5cdf598e3ec33d7a1110a31f7e11527ec7","/loadgen.cc":"6650091ba7a918f343b06eb7a5aa540eae87275f","/loadgen.h":"e00fdc6dbc85a8c9a8485dbcbfe2944f81251c4e","/loadgen_integration_diagram.svg":"47f748307536f80cfc606947b440dd732afc2637","/logging.cc":"197efc96d178e5d33a750d07fa7b2966417506ea","/logging.h":"ddb961df7bcc145bcd7cce8c21f7cf075350dcbe","/pyproject.toml":"974adb632af4b76a1c72b914cc2cf9b3cbc66aa3","/query_dispatch_library.h":"13ad6d842200cb161d6927eb74a3fafd79c46c75","/query_sample.h":"e9187c8612bbdc972305b789feb6e15c26e96cfe","/query_sample_library.h":"8323a2225be1dff31f08ecc86b76eb3de06568bc","/requirements.txt":"a5ff7e77caa6e9e22ada90f0de0c865c987bf167","/results.cc":"a170f991de69f8a5e45616e871b39a30ffed5598","/results.h":"d82500c326c2de83db411f1146882aa4692b419c","/setup.py":"e3e707e1191478332c00f1b6ff806f0ef98e0f65","/system_under_test.h":"18d4809589dae33317d88d9beeb5491a6e1ccdec","/test_settings.h":"aaf3803e700f3431a5ada72559eef5cce996ea64","/test_settings_internal.cc":"42aa46b17ac3fb2748cd5cde60fa8742e916f3c8","/test_settings_internal.h":"73b11c02228f3afb4c924db7a86fd8a2b5b9e483","/utils.cc":"3df8fdabf6eaea4697cf25d1dcb89cae88e36efd","/utils.h":"40775e32d619ea6356826ae5ea4174c7911f6894","/version.cc":"cbec2a5f98f9786c8c3d8b06b3d12df0b6550fa0","/version.h":"9d574baa64424e9c708fcfedd3dbb0b518a65fcc","/version_generator.py":"4c9d98360b507d5673049ed70154fcfb2934f8a6"}, "time_ms": 0.005642, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/version.cc", "line_no": 67, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "test_datetime", "value": "2024-12-27T19:34:48Z", "time_ms": 0.014113, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1198, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "sut_name", "value": "Server_3DUNet", "time_ms": 0.014113, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1199, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "get_sut_name_duration_ns", "value": 217, "time_ms": 0.014113, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1200, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "qsl_name", "value": "LWIS_SampleLibrary", "time_ms": 0.014113, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1201, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "qsl_reported_total_count", "value": 43, "time_ms": 0.014113, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1202, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "qsl_reported_performance_count", "value": 43, "time_ms": 0.014113, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 1203, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_scenario", "value": "SingleStream", "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 268, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_test_mode", "value": "PerformanceOnly", "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 269, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_single_stream_expected_latency_ns", "value": 3.6e+08, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 274, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_single_stream_target_latency_percentile", "value": 0.9, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 276, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_min_duration_ms", "value": 600000, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 312, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_max_duration_ms", "value": 0, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 313, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_min_query_count", "value": 100, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 314, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_max_query_count", "value": 0, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 315, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_qsl_rng_seed", "value": 3066443479025735752, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 316, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_sample_index_rng_seed", "value": 10688027786191513374, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 317, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_schedule_rng_seed", "value": 14962580496156340209, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 319, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_accuracy_log_rng_seed", "value": 0, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 320, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_accuracy_log_probability", "value": 0, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 322, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_accuracy_log_sampling_target", "value": 0, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 324, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_print_timestamps", "value": false, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 326, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_performance_issue_unique", "value": false, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 327, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_performance_issue_same", "value": false, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 329, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_performance_issue_same_index", "value": 0, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 331, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "requested_performance_sample_count_override", "value": 0, "time_ms": 0.017691, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 333, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_scenario", "value": "SingleStream", "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 409, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_test_mode", "value": "PerformanceOnly", "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 410, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_samples_per_query", "value": 1, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 412, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_target_qps", "value": 2.77778, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 413, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_target_latency_ns", "value": 0, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 414, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_target_latency_percentile", "value": 0.9, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 415, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_max_async_queries", "value": 1, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 417, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_target_duration_ms", "value": 600000, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 418, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_min_duration_ms", "value": 600000, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 420, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_max_duration_ms", "value": 0, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 421, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_min_query_count", "value": 3354, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 422, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_max_query_count", "value": 0, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 423, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_min_sample_count", "value": 3354, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 424, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_qsl_rng_seed", "value": 3066443479025735752, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 425, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_sample_index_rng_seed", "value": 10688027786191513374, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 426, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_schedule_rng_seed", "value": 14962580496156340209, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 428, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_accuracy_log_rng_seed", "value": 0, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 429, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_accuracy_log_probability", "value": 0, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 431, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_accuracy_log_sampling_target", "value": 0, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 433, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_print_timestamps", "value": false, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 435, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_performance_issue_unique", "value": false, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 436, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_performance_issue_same", "value": false, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 438, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_performance_issue_same_index", "value": 0, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 440, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "effective_performance_sample_count", "value": 43, "time_ms": 0.017783, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/test_settings_internal.cc", "line_no": 442, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "generic_message", "value": "Starting performance mode", "time_ms": 0.021449, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 841, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "loaded_qsl_set", "value": [42,25,26,37,2,23,3,10,30,4,33,15,41,6,36,0,32,35,9,29,24,1,31,39,28,27,17,13,20,7,40,19,5,14,12,11,16,21,8,34,22,38,18], "time_ms": 0.025457, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 613, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "generated_query_count", "value": 3354, "time_ms": 371.163675, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 428, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "generated_samples_per_query", "value": 1, "time_ms": 371.163675, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 429, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "generated_query_duration", "value": 1207440000000, "time_ms": 371.163675, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 430, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "generic_message", "value": "Ending naturally: Minimum query count and test duration met.", "time_ms": 754751.401724, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/issue_query_controller.cc", "line_no": 482, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "logger_swap_request_slots_retry_count", "value": 0, "time_ms": 754867.625856, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 898, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "logger_swap_request_slots_retry_retry_count", "value": 0, "time_ms": 754867.625856, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 900, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "logger_swap_request_slots_retry_reencounter_count", "value": 0, "time_ms": 754867.625856, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 902, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "logger_start_reading_entries_retry_count", "value": 0, "time_ms": 754867.625856, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 904, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "logger_tls_total_log_cas_fail_count", "value": 0, "time_ms": 754867.625856, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 906, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "logger_tls_total_swap_buffers_slot_retry_count", "value": 0, "time_ms": 754867.625856, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/logging.cc", "line_no": 908, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "power_begin", "value": "12-28-2024 03:34:49.160", "time_ms": 754867.626061, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 564, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "power_end", "value": "12-28-2024 03:47:23.653", "time_ms": 754867.626061, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/loadgen.cc", "line_no": 566, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "result_validity", "value": "VALID", "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 644, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "result_min_duration_met", "value": true, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 649, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "result_min_queries_met", "value": true, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 650, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "early_stopping_met", "value": true, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 651, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "early_stopping_result", "value": " * Processed at least 64 queries (3354). * Would discard 294 highest latency queries. * Early stopping 90th percentile estimate: 437613279 * Early stopping 99th percentile estimate: 503468351", "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 669, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "result_query_count", "value": 3354, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 679, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "result_qps_with_loadgen_overhead", "value": 4.44471, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 702, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "result_qps_without_loadgen_overhead", "value": 4.44655, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 703, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "early_stopping_latency_ss", "value": 437613279, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 704, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "early_stopping_latency_ms", "value": 503468351, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 706, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "result_min_latency_ns", "value": 28690940, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 741, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "result_max_latency_ns", "value": 503889841, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 742, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "result_mean_latency_ns", "value": 224893578, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 743, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "result_50.00_percentile_latency_ns", "value": 175828106, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 745, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "result_90.00_percentile_latency_ns", "value": 437327789, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 745, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "result_95.00_percentile_latency_ns", "value": 502531619, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 745, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "result_97.00_percentile_latency_ns", "value": 503072001, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 745, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "result_99.00_percentile_latency_ns", "value": 503361736, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 745, "pid": 10088, "tid": 10088}} +:::MLLOG {"key": "result_99.90_percentile_latency_ns", "value": 503702990, "time_ms": 754867.844850, "namespace": "mlperf::logging", "event_type": "POINT_IN_TIME", "metadata": {"is_error": false, "is_warning": false, "file": "/home/cmuser/CM/repos/local/cache/dfbf240f980947f5/repo/closed/NVIDIA/build/inference/loadgen/results.cc", "line_no": 745, "pid": 10088, "tid": 10088}} diff --git a/open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/performance/run_1/mlperf_log_summary.txt b/open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/performance/run_1/mlperf_log_summary.txt index 3081d1adb..7c3728546 100644 --- a/open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/performance/run_1/mlperf_log_summary.txt +++ b/open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream/performance/run_1/mlperf_log_summary.txt @@ -4,7 +4,7 @@ MLPerf Results Summary SUT name : Server_3DUNet Scenario : SingleStream Mode : PerformanceOnly -90th percentile latency (ns) : 437159808 +90th percentile latency (ns) : 437327789 Result is : VALID Min duration satisfied : Yes Min queries satisfied : Yes @@ -12,24 +12,24 @@ Result is : VALID Early Stopping Result: * Processed at least 64 queries (3354). * Would discard 294 highest latency queries. - * Early stopping 90th percentile estimate: 437330110 - * Early stopping 99th percentile estimate: 503219208 + * Early stopping 90th percentile estimate: 437613279 + * Early stopping 99th percentile estimate: 503468351 ================================================ Additional Stats ================================================ -QPS w/ loadgen overhead : 4.45 +QPS w/ loadgen overhead : 4.44 QPS w/o loadgen overhead : 4.45 -Min latency (ns) : 28717857 -Max latency (ns) : 503573435 -Mean latency (ns) : 224819833 -50.00 percentile latency (ns) : 175759007 -90.00 percentile latency (ns) : 437159808 -95.00 percentile latency (ns) : 502458917 -97.00 percentile latency (ns) : 502834841 -99.00 percentile latency (ns) : 503129116 -99.90 percentile latency (ns) : 503459579 +Min latency (ns) : 28690940 +Max latency (ns) : 503889841 +Mean latency (ns) : 224893578 +50.00 percentile latency (ns) : 175828106 +90.00 percentile latency (ns) : 437327789 +95.00 percentile latency (ns) : 502531619 +97.00 percentile latency (ns) : 503072001 +99.00 percentile latency (ns) : 503361736 +99.90 percentile latency (ns) : 503702990 ================================================ Test Parameters Used