Skip to content

Commit

Permalink
add suggestion to docs
Browse files Browse the repository at this point in the history
Signed-off-by: Filipe Oliveira <[email protected]>
  • Loading branch information
filipeo2-mck committed Oct 26, 2023
1 parent e28275c commit 7e9aa3d
Showing 1 changed file with 13 additions and 0 deletions.
13 changes: 13 additions & 0 deletions docs/source/pyspark_sql.rst
Original file line number Diff line number Diff line change
Expand Up @@ -343,3 +343,16 @@ We also provided a helper function to extract metadata from a schema as follows:
.. note::

This feature is available for ``pyspark.sql`` and ``pandas`` both.

Unique support
--------------

*new in 0.17.3*

.. warning::

The `unique` support in PySpark to define which columns must be tested for
unique values may cause a performance hit during validation, given it's distributed
nature.

Use with caution.

0 comments on commit 7e9aa3d

Please sign in to comment.