Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: address & / | operator errors for PySpark / chore: use F.lit in maybe_evaluate for pyspark, like we do for duckdb #1872

Merged
merged 10 commits into from
Jan 27, 2025

Conversation

MarcoGorelli
Copy link
Member

What type of PR is this? (check all applicable)

  • πŸ’Ύ Refactor
  • ✨ Feature
  • πŸ› Bug Fix
  • πŸ”§ Optimization
  • πŸ“ Documentation
  • βœ… Test
  • 🐳 Other

Related issues

  • Related issue #<issue number>
  • Closes #<issue number>

Checklist

  • Code follows style guide (ruff)
  • Tests added
  • Documented the changes

If you have comments or can explain your changes, please do so below

@MarcoGorelli MarcoGorelli marked this pull request as ready for review January 27, 2025 07:59
@MarcoGorelli MarcoGorelli changed the title chore: use F.lit in maybe_evaluate for pyspark, like we do for duckdb fix: address & / | operator errors for PySpark / chore: use F.lit in maybe_evaluate for pyspark, like we do for duckdb Jan 27, 2025
@@ -55,7 +54,6 @@ def __init__(
self._returns_scalar = returns_scalar
self._backend_version = backend_version
self._version = version
self._kwargs = kwargs
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we were only using these _kwargs for std and var, and even then, #1870 would address those. I think we can get rid of them?

Copy link
Member

@FBruzzesi FBruzzesi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice one! Let's ship it and merge with #1870

NarwhalsKittyGIF

Comment on lines -629 to +632
self._native_series.dtype,
dtype_backend,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice catch!

narwhals/_spark_like/selectors.py Outdated Show resolved Hide resolved
@FBruzzesi FBruzzesi merged commit 267eb53 into narwhals-dev:main Jan 27, 2025
23 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants