[SPARK-8826] [SQL] Fix ClassCastException in GeneratedAggregate#7225
[SPARK-8826] [SQL] Fix ClassCastException in GeneratedAggregate#7225navis wants to merge 1 commit into
Conversation
|
Test build #36543 has finished for PR 7225 at commit
|
There was a problem hiding this comment.
Why this change? If you want to use mutable row in projection, you can use InterpretedMutableProjection.
There was a problem hiding this comment.
Yes, but InterpretedProjection and InterpretedMutableProjection has different semantic on returning object. It would be same thing if call setTarget() before each apply() call but I wanted keep it simple without incurring another problem.
|
Test build #36545 has finished for PR 7225 at commit
|
There was a problem hiding this comment.
Doesn't the use of GeneratedAggregate imply that codegen must be enabled?
There was a problem hiding this comment.
Basically, I'm wondering if this is a bug. If this problem only occurs when mis-using GeneratedAggregate, then I think we should resolve this by adding an assertion / precondition check to GeneratedAggregate to ensure that codgen is enabled.
|
I've closed the JIRA issue as "invalid" since GeneratedAggregate will never be used when codegen is disabled. As a result, do you mind closing this issue? Thanks! |
|
Bump; can you please close this pull request? Thanks! |
When codegen is disabled, ClassCastException is thrown in some cases.