-
Notifications
You must be signed in to change notification settings - Fork 3.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[fix](orc)fix orc reader missing column and filter missing column. #35583
Conversation
Thank you for your contribution to Apache Doris. Since 2024-03-18, the Document has been moved to doris-website. |
clang-tidy review says "All clean, LGTM! 👍" |
8f7f77c
to
08c701f
Compare
run buildall |
clang-tidy review says "All clean, LGTM! 👍" |
TPC-H: Total hot run time: 42277 ms
|
TPC-DS: Total hot run time: 172169 ms
|
ClickBench: Total hot run time: 30.35 s
|
TeamCity be ut coverage result: |
08c701f
to
d554f48
Compare
run buildall |
clang-tidy review says "All clean, LGTM! 👍" |
TeamCity be ut coverage result: |
TPC-H: Total hot run time: 41157 ms
|
LGTM |
PR approved by at least one committer and no changes requested. |
PR approved by anyone and no changes requested. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
TPC-H: Total hot run time: 43915 ms
|
TPC-DS: Total hot run time: 169637 ms
|
ClickBench: Total hot run time: 30.61 s
|
run buildall |
clang-tidy review says "All clean, LGTM! 👍" |
TPC-H: Total hot run time: 39993 ms
|
TeamCity be ut coverage result: |
TPC-DS: Total hot run time: 168760 ms
|
ClickBench: Total hot run time: 30.79 s
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
PR approved by at least one committer and no changes requested. |
## Proposed changes bp #35583 Issue Number: close #xxx <!--Describe your changes.-->
…35583) Fixed the problem that filtering with non-existent columns failed when reading orc tables example : ``` mysql> select * from sc_test; +------+------+-------+----------------------+----------+ | id | type | state | sensitive_query_flag | dt | +------+------+-------+----------------------+----------+ | 5 | 6 | bac | NULL | 20240226 | | 3 | 4 | bac | NULL | 20240227 | | 1 | 2 | bac | 1 | 20240228 | +------+------+-------+----------------------+----------+ 3 rows in set (0.03 sec) mysql> select * from sc_test where sensitive_query_flag is null; 0 rows in set (0.03 sec) ``` after : ``` mysql> select * from sc_test where sensitive_query_flag is null; +------+------+-------+----------------------+----------+ | id | type | state | sensitive_query_flag | dt | +------+------+-------+----------------------+----------+ | 3 | 4 | bac | NULL | 20240227 | | 5 | 6 | bac | NULL | 20240226 | +------+------+-------+----------------------+----------+ 2 rows in set (0.03 sec) ```
…pache#35583) Fixed the problem that filtering with non-existent columns failed when reading orc tables example : ``` mysql> select * from sc_test; +------+------+-------+----------------------+----------+ | id | type | state | sensitive_query_flag | dt | +------+------+-------+----------------------+----------+ | 5 | 6 | bac | NULL | 20240226 | | 3 | 4 | bac | NULL | 20240227 | | 1 | 2 | bac | 1 | 20240228 | +------+------+-------+----------------------+----------+ 3 rows in set (0.03 sec) mysql> select * from sc_test where sensitive_query_flag is null; 0 rows in set (0.03 sec) ``` after : ``` mysql> select * from sc_test where sensitive_query_flag is null; +------+------+-------+----------------------+----------+ | id | type | state | sensitive_query_flag | dt | +------+------+-------+----------------------+----------+ | 3 | 4 | bac | NULL | 20240227 | | 5 | 6 | bac | NULL | 20240226 | +------+------+-------+----------------------+----------+ 2 rows in set (0.03 sec) ```
Proposed changes
Fixed the problem that filtering with non-existent columns failed when reading orc tables
example :
after :
Issue Number: close #xxx