We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 8479e55 commit dcb9e25Copy full SHA for dcb9e25
docs/source/user-guide/common-operations/udf-and-udfa.rst
@@ -90,6 +90,11 @@ converting to Python objects to do the evaluation.
90
91
df.select(col("a"), is_null_arr(col("a")).alias("is_null")).show()
92
93
+In this example we passed the PyArrow ``DataType`` when we defined the function
94
+by calling ``udf()``. If you need additional control, such as specifying
95
+metadata or nullability of the input or output, you can instead specify a
96
+PyArrow ``Field``.
97
+
98
If you need to write a custom function but do not want to incur the performance
99
cost of converting to Python objects and back, a more advanced approach is to
100
write Rust based UDFs and to expose them to Python. There is an example in the
0 commit comments