Skip to content

The file with non-standard newline character can't be read when sqllogictests testing #12328

Description

@goldmedal

Describe the bug

As the discussion in #12263 (comment), this behavior seems a bug. If the input file with non-standard newline (e.g. CR), we will get the object store error

DataFusion error: Object Store error: Generic LocalFileSystem error: Requested range was invalid

To Reproduce

Provide a file using CR as the newline character, then use this file in sqllogcitests.

Expected behavior

#12263 implement the custom terminator for the csv format. If the terminator is correct, the record should be read well. Otherwise, the error message should like

Arrow error: Csv error: incorrect number of fields for line 1, expected 2 got more than 2

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions