Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Zero initialization as beta=0 during fusion #902

Merged
merged 4 commits into from
Mar 27, 2024

Conversation

KavithaTipturMadhu
Copy link
Contributor

@KavithaTipturMadhu KavithaTipturMadhu changed the title Zero initialization as beta=0 during fusion (NFC) Zero initialization as beta=0 during fusion Mar 21, 2024
Copy link
Collaborator

@adam-smnk adam-smnk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: the PR is very much "FC" ;)

lib/TPP/DefaultTppPasses.cpp Outdated Show resolved Hide resolved
benchmarks/mlir/pytorch/torch-dynamo-mlp-bf16-3x1024.mlir Outdated Show resolved Hide resolved
@adam-smnk
Copy link
Collaborator

Any impact on benchmarks?

@KavithaTipturMadhu
Copy link
Contributor Author

Any impact on benchmarks?

Will have impact on benchmarks and tests, will add some unit tests at least.

@KavithaTipturMadhu KavithaTipturMadhu added the benchmark Triggers benchmark jobs label Mar 21, 2024
lib/TPP/Dialect/Xsmm/XsmmUtils.cpp Outdated Show resolved Hide resolved
lib/TPP/Dialect/Xsmm/XsmmUtils.cpp Outdated Show resolved Hide resolved
@rengolin rengolin changed the title (NFC) Zero initialization as beta=0 during fusion Zero initialization as beta=0 during fusion Mar 26, 2024
Copy link
Contributor

@rengolin rengolin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is really good, thank you @KavithaTipturMadhu, and sorry for the delay. This week is being a bit tough.

I only have two nits and it should be good to merge.

lib/TPP/Dialect/Xsmm/XsmmUtils.cpp Outdated Show resolved Hide resolved
lib/TPP/Dialect/Xsmm/XsmmUtils.cpp Show resolved Hide resolved
@KavithaTipturMadhu KavithaTipturMadhu merged commit 42c6ac0 into plaidml:main Mar 27, 2024
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
benchmark Triggers benchmark jobs
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants