Skip to content

Commit

Permalink
plugins/amdgpu: Update README.md and criu-amdgpu-plugin.txt
Browse files Browse the repository at this point in the history
Signed-off-by: Yanning Yang <yangyanning@sjtu.edu.cn>
  • Loading branch information
wweewrwer committed Dec 10, 2024
1 parent 0abc1fa commit d533e0c
Show file tree
Hide file tree
Showing 2 changed files with 24 additions and 1 deletion.
1 change: 1 addition & 0 deletions Documentation/criu-amdgpu-plugin.txt
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@ Checkpoint / Restore inside a docker container
Pytorch
Tensorflow
Using CRIU Image Streamer
Parallel Restore

DESCRIPTION
-----------
Expand Down
24 changes: 23 additions & 1 deletion plugins/amdgpu/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,8 @@ Supporting ROCm with CRIU

_Felix Kuehling <Felix.Kuehling@amd.com>_<br>
_Rajneesh Bardwaj <Rajneesh.Bhardwaj@amd.com>_<br>
_David Yat Sin <David.YatSin@amd.com>_
_David Yat Sin <David.YatSin@amd.com>_<br>
_Yanning Yang <yangyanning@sjtu.edu.cn>_

# Introduction

Expand Down Expand Up @@ -224,6 +225,27 @@ to resume execution on the GPUs.
*This new plugin is enabled by the new hook `__RESUME_DEVICES_LATE` in our RFC
patch series.*

## Restoring BO content in parallel

Restoring the BO content is an important part in the restore of GPU state and
usually takes a significant amount of time. A possible location for this
procedure is the `cr_plugin_restore_file` hook. However, restoring in this hook
blocks the target process from performing other restore operations, which
hinders further optimization of the restore process.

Therefore, a new plugin hook that runs in the master restore process is
introduced, and it interacts with the `cr_plugin_restore_file` hook to complete
the restore of BO content. Specifically, the target process only needs to send
the relevant BOs to the master restore process, while this new hook handles all
the restore of buffer objects. Through this method, during the restore of the BO
content, the target process can perform other restore operations, thus
accelerating the restore procedure. It is an implementation of gCROP from the
ACM SoCC'24 paper: [On-demand and Parallel Checkpoint/Restore for GPU
Applications](https://dl.acm.org/doi/10.1145/3698038.3698510).

*This new plugin is enabled by the new hook `__POST_FORKING` in our patch
series.*

## Other CRIU changes

In addition to the new plugins, we need to make some changes to CRIU itself to
Expand Down

0 comments on commit d533e0c

Please sign in to comment.