Add rdma

[aricer123]

Description

Please include a summary of the changes and the related issue(s) if they exist.
Please also include relevant motivation and context.

Fixes #598

Adds flag for rdma for testing and passes to ./mfc sh run
Compiles on macbook and runs tests but needs to be tested on gpu with rdma, may have errors

[sbryngelson]

Adds flag for rdma for testing and passes to ./mfc sh run

This PR indeed does this but does not do anything differently within the ./mfc.sh run environment. It should ensure the RDMA_MPI = 'T' in the generated case.py file.

[henryleberre]

The changes in the toolchain folder can be undone. See #598 (comment).

To clarify, when you ./mfc.sh test -- -c phoenix -- --rdma this is what happens when we follow the execution of a single test:

• We generate a case.py file in the tests/<case slug>/ folder.
• We execute ./mfc.sh run tests/<case slug>/case.py -c phoenix -- --rdma. There are more arguments but you don't need to worry about these.
• When ./mfc.sh run executes, it basically runs the tests/<case slug>/case.py file and passes the --rdma flag.

So there is no need to have the --rdma file registered with ./mfc.sh test or ./mfc.sh run. The case file that is autogenerated should be the one that parses this argument.

[aricer123]

• We generate a case.py file in the tests/<case slug>/ folder.

Where in the project/program is the case.py file generated? From my understanding each case.py contains the configurations for its respective test/example and is manually written.

I understand the rest of how the test and run features work as well as how the arguments including the case file are passed.

[henryleberre]

• We generate a case.py file in the tests/<case slug>/ folder.

Where in the project/program is the case.py file generated? From my understanding each case.py contains the configurations for its respective test/example and is manually written.

I understand the rest of how the test and run features work as well as how the arguments including the case file are passed.

This is where we declare the parser of the case.py files used for testing:

MFC/toolchain/mfc/test/case.py

Line 182 in 0c345ea

parser.add_argument("dict", type=str, metavar="DICT", help=argparse.SUPPRESS)

. You need to add the --rdma flag and make it set rdma_mpi={'T' if rdma else 'F'} in the case dictionary printed by the case file.

[aricer123]

got it thanks, i missed that when i was going through the files