Skip to content

Add Dictionary Based Filtering to Filter2 API #1896

Description

@asfimport

Dictionary based predicate evaluation show very significant gains for certain cases like the following:

  • Sparse values in dictionary encoded columns
  • Data staged sorted by fields used in predicate evaluation

This would be good to introduce into the filter2 API.

Reporter: Daniel Weeks / @danielcweeks
Assignee: Daniel Weeks / @danielcweeks

Related issues:

PRs and other links:

Note: This issue was originally created as PARQUET-384. Please see the migration documentation for further details.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions