Skip to content

Conversation

@edoyango
Copy link
Collaborator

@edoyango edoyango commented Jan 8, 2026

This aligns the logic with the doc strings and resolves #231. Now a PipelineFilterException is raised when the number of values in the input sample is equal to or greater than the supplied percentage threshold. Before, the exception would be raised if the number of values is strictly less than the supplied threshold.

This aligns the logic with the doc strings. Now a PipelineFilterException
is raised when the number of values in the input is equal to or greater
than the supplied percentage threshold. Before, the exception would be
raised if the number of values is strictly less than the supplied
threshold.
@coveralls
Copy link

Pull Request Test Coverage Report for Build 20800831494

Details

  • 25 of 25 (100.0%) changed or added relevant lines in 6 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage remained the same at 64.983%

Totals Coverage Status
Change from base Build 20305027296: 0.0%
Covered Lines: 10480
Relevant Lines: 15767

💛 - Coveralls

Sample to check
Returns:
(bool):
If sample contains nan's
Copy link
Collaborator

@nikeethr nikeethr Jan 12, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

probably not to do with this PR specifically, but this description implies it's returning a bool.

But the implementation itself raises an exception... (or returns None), so I'm a bit confused on how this works at a high level.

If it could be modified to be made clearer, that would help I think.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree it is confusing - prior to any of my changes the implementation was raising an exception and never returned a logical. Perhaps there was a code change that wasn't reflected in the doc string?

In any case, happy to update the doc strings in a separate pull request.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yea that would be great, thanks.

@nikeethr
Copy link
Collaborator

The change itself seems fine, the difficulty I'm having is the flag (bool) according to docstring and whether True => exception or False => exception, and that's more my lack of understanding probably.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Directionality of filter test in packages/pipeline/src/pyearthtools/pipeline/operations/dask/filters.py

3 participants