Queries fails due to corrupted parquet file

[Cybermb]

When using SQL queries to retrieve unique entries im getting following error:

Failed to fetch logs: Execution Error: Query Execution failed due to error in datafusion: External error: Parquet error: External: Generic LocalFileSystem error: Out of range of file /parseable/data/web-app/date=2025-09-02/hour=14/minute=53/aee2616ca150.data.000000000000000.parquet, expected: 8, actual: 0

I have tried to delete specified file but that did not help

How to fix this issue?

[parmesant]

Hey @Cybermb

I need a little more information regarding this (happy to continue on slack if you wish to)

Could you share the screenshot of the about page?

[Cybermb]

Sure thing,

[parmesant]

• Did you start off with the sample ingestion and resource creation flow or did you ingest data yourself?
• Would it be possible for you to share the .stream.json (/.stream/.stream.json)?
• What Query did you run and across what time range?

[parmesant]

The issue was two fold, the inability to query a dataset and the inability to ingest to the same dataset.

Inability to query-

• Corrupted parquet most probably due to uncontrolled process termination ( Validation of parquet integrity during ingestion #1430 )
• Fixed after manual intervention (deletion of the parquet and its related metadata)

Inability to ingest-

• While trying to fix the querying issue, a custom partition got added inadvertently
• Deletion of custom partition from the UI is a bug which will be fixed in an upcoming release
• The issue got fixed by sending an API request to the server to delete the same