Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Don't do a loadgen release from dev branch, add python3.12,13 to loadgen test, exclude power-checker from auto format #1994

Merged
merged 134 commits into from
Jan 7, 2025
Merged

Don't do a loadgen release from dev branch, add python3.12,13 to loadgen test, exclude power-checker from auto format #1994

merged 134 commits into from
Jan 7, 2025

Conversation

arjunsuresh
Copy link
Contributor

@arjunsuresh arjunsuresh commented Dec 20, 2024 •
edited
Loading

Other fixes:

  1. Fix compliance runs with static mlperf.conf file
  2. Docs update

arjunsuresh and others added 30 commits October 31, 2024 14:55
@arjunsuresh
Update generate_final_report.py
d8f0d7e
@arjunsuresh
Merge branch 'master' into dev
390a8cb
@arjunsuresh
Fix sdxl (#1911)
6b1a0f8 
* Fix typo in fid_score.py, fail_safe for SDXL short runs

* [Automated Commit] Format Codebase

* Fix typo in fid_score.py, fail_safe for SDXL short runs

* Fix dlrmv2 reference implementation | Update run_local.sh
@arjunsuresh
Fixes for filtering invalid results
a4ba51f
@arjunsuresh
Merge branch 'master' into dev
7097ef5
@arjunsuresh
Merge 7097ef5 into d3c01ed
190ee41
@arjunsuresh
[Automated Commit] Format Codebase
451b310
@arjunsuresh
Update preprocess_submission.py
4c109ea
@arjunsuresh
Added an option to pass in sample_ids.txt for SDXL accuracy check
40c1fe0
@arjunsuresh
Merge 40c1fe0 into d3c01ed
2a61df9
@arjunsuresh
[Automated Commit] Format Codebase
89a2ffe
@arjunsuresh
Update accuracy_coco.py
69ffdc0
@arjunsuresh
Merge 69ffdc0 into d3c01ed
76b703b
@arjunsuresh
[Automated Commit] Format Codebase
d1d642e
@arjunsuresh
Fix typo
8d3b8ab
@arjunsuresh
Not use default for sample_ids.txt
b09b1ef
@arjunsuresh
Merge branch 'master' into dev
857494f
@arjunsuresh
Update requirements.txt (#1907)
df5049d 
Updating the pip packages
@arjunsuresh
Fix preprocess_sudbmission for a bug
a7e8c8a
@arjunsuresh
Fix conflict
213c239
@arjunsuresh
Update submission_checker.py | Removed TEST05
8915a90
@arjunsuresh
Merge branch 'master' into dev
36d5b74
@arjunsuresh
Fix to SDXL accuracy output
da9e6bb
@arjunsuresh
Merge branch 'master' into dev
db7fb38
@arjunsuresh
Added exists checks for rmtree in preprocess_submission script
13cd2e0
@arjunsuresh
Merge 13cd2e0 into 35c7e1f
0abd369
@arjunsuresh
[Automated Commit] Format Codebase
db5e737
@arjunsuresh
Delete .github/workflows/format.yml
dbecd2b
@arjunsuresh
Delete .github/scripts directory
011a0d1
@arjunsuresh
Update build_wheels.yml | Added src distribution
d04ae63
arjunsuresh and others added 27 commits January 2, 2025 22:23
@arjunsuresh
Merge branch 'master' into dev
1146e20
@arjunsuresh
Update index.md
4ba40e2
@arjunsuresh
Update index.md
a893166
@arjunsuresh
Update index.md
194aeda
@arjunsuresh
Update submission generation steps (WIP)
bab97ff
@anandhu-eng
add submission generation graphs for local sync and through github re…
318110c 
…po (#2016)

* add graphs for local sync and through github repo
@arjunsuresh
Update index.md
41721df
@arjunsuresh
Update index.md
a8cdcaf
@arjunsuresh
Update index.md
6eda9f1
@arjunsuresh
Update index.md
36db7cc
@arjunsuresh
Update index.md
6430b79
@arjunsuresh
Update index.md
8425da6
@arjunsuresh
Fixes to submission generation docs
6b24ac0
@arjunsuresh
Fixes to submission generation docs
1120df8
@arjunsuresh
Added link to the expected results folder structure
e3ea5ef
@anandhu-eng
add docs for llama3 + inference version upgrade (#2020)
2c67b24 
* add docs for llama3 + inference version upgrade

* add output path and hf token
@anandhu-eng
Update CM run commands for llama3_1-405b (#2019)
c0ed0a8 
* Update CM run commands for llama3_1-405b

* Update cm commands for llama3

* add information about hf tokens
@arjunsuresh
Fixes the submission README
17960a5
@arjunsuresh
Update README.md
51af492
@arjunsuresh
Create test-submission-generation.yml
cd25f8e
@arjunsuresh
Update test-submission-generation.yml
9bcdbee
@arjunsuresh
Clean invalid model results in preprocess_submission script
961efb7
@mlcommons-bot
[Automated Commit] Format Codebase
ab2fc44
@arjunsuresh
Fixes the submission README
d98eb37
@arjunsuresh
Update README.md
37e94c6
@arjunsuresh
Update README.md
27827dc
@arjunsuresh
Update test-submission-generation.yml
a56a251
pgmpablo157321
pgmpablo157321 approved these changes Jan 7, 2025
View reviewed changes
Copy link
Contributor

@pgmpablo157321 pgmpablo157321 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!
I also was able to run the demos and a debug benchmark and seems to be working correctly

@pgmpablo157321 pgmpablo157321 merged commit d6c3a8d into master Jan 7, 2025
27 checks passed
@github-actions github-actions bot locked and limited conversation to collaborators Jan 7, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@pgmpablo157321 pgmpablo157321 pgmpablo157321 approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
7 participants
@arjunsuresh @pgmpablo157321 @nvzhihanj @mrmhodak @mlcommons-bot @anandhu-eng @sahilavaran