In Arrow 3.0.0, the arrow.skip_nul option effectively defaults to FALSE for consistency with base::readLines and base::scan.
If the user keeps this default option value, then conversion of string data containing embedded nuls causes an error with a message like:
embedded nul in string: '\0'
If the user sets the option to TRUE, then no error occurs, but this warning is issued:
Stripping '\0' (nul) from character vector
Consider whether we should:
- Keep this all as it is
- Change the default option value to
TRUE
- Keep the default option value as it is, but catch the error and re-throw it with a more actionable message that tells the user how to set the option
Reporter: Ian Cook / @ianmcook
Assignee: Neal Richardson / @nealrichardson
Related issues:
PRs and other links:
Note: This issue was originally created as ARROW-11478. Please see the migration documentation for further details.
In Arrow 3.0.0, the
arrow.skip_nuloption effectively defaults toFALSEfor consistency withbase::readLinesandbase::scan.If the user keeps this default option value, then conversion of string data containing embedded nuls causes an error with a message like:
If the user sets the option to
TRUE, then no error occurs, but this warning is issued:Consider whether we should:
TRUEReporter: Ian Cook / @ianmcook
Assignee: Neal Richardson / @nealrichardson
Related issues:
PRs and other links:
Note: This issue was originally created as ARROW-11478. Please see the migration documentation for further details.