Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[SPARK-50692] Add RPAD pushdown support
### What changes were proposed in this pull request? This PR makes RPAD and LPAD functions translatable across connectors. Individual connectors can now support them via their dialects. ### Why are the changes needed? When trying to compare CHAR(...) and a literal, Spark injects a RPAD function to make the CHAR parameter the same length. This behaviour is per ANSI standard. The problem is that RPAD is not only an unsupported, but an untranslatable function. This prevents CHAR + literal comparison pushdown. Solution is to support RPAD pushdowns and implement it when needed. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? This PR only introduces the ability to support the RPAD pushdown. Individual connectors will have their own tests. ### Was this patch authored or co-authored using generative AI tooling? No Closes #49325 from andrej-db/SPARK-50692-RPAD. Authored-by: andrej-gobeljic_data <andrej.gobeljic@databricks.com> Signed-off-by: Wenchen Fan <wenchen@databricks.com>
- Loading branch information