Skip to content

"Category" bugs have been solved in recent versions of Polars (upgrade needed!) #1133

@thbar

Description

@thbar

I am unsure how involved the upgrade will be, but creating an issue to share what I found.

After finding data corruption when doing things like:

defmodule DataFrameAdapter do
  @dtypes [
    {:level, {:u, 8}},
    {:node, :category},
    {:text, :category},
    {:attributes, {:list, {:struct, [name: :category, value: :category]}}}
  ]

where unit tests showed that the "value" field in our attributes were sometimes corrupt, I did a bit of digging.

It appears that the whole family of similar bugs has been fixed here:

Our version of Polars (rust crate) is set here:

polars-arrow = "0.49"

I could not find release notes for the Rust crate (only for the Python library), but found out you can use tags here to compare, FWIW:

pola-rs/polars@rs-0.49.0...rs-0.52.0

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions