Skip to content

CBO: data-movement-aware greedy join reordering #6596

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
deniskuzZ wants to merge 1 commit into
base: master
Choose a base branch
from
+287 −34
Draft

CBO: data-movement-aware greedy join reordering #6596

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2578,6 +2578,14 @@
HIVE_OPTIMIZE_CONSTRAINTS_JOIN("hive.optimize.constraints.join", true, "Whether to use referential constraints\n" +
"to optimize (remove or transform) join operators"),

HIVE_CBO_JOIN_REORDER_SHUFFLE_COST("hive.cbo.join.reorder.shuffle.cost", true,
"Whether the multi-way join reordering should account for data movement: candidate join\n" +
"orders are generated preferring joins whose build side fits the broadcast (map-join) size\n" +
"threshold, and the order with the lowest estimated shuffle cost is selected. This sequences\n" +
"selective broadcast joins before large shuffle joins, reducing the data shuffled across the\n" +
"network. If the cost cannot be estimated (e.g. missing column statistics), the reordering\n" +
"falls back to the row-count based join order selection."),

Check warning on line 2587 in common/src/java/org/apache/hadoop/hive/conf/HiveConf.java

View check run for this annotation

SonarQubeCloud / SonarCloud Code Analysis

Replace this String concatenation with Text block. 


See more on https://sonarcloud.io/project/issues?id=apache_hive&issues=AZ9LmfcvCqHZiZtunU9H&open=AZ9LmfcvCqHZiZtunU9H&pullRequest=6596

HIVE_OPTIMIZE_SORT_PREDS_WITH_STATS("hive.optimize.filter.preds.sort", true, "Whether to sort conditions in filters\n" +
"based on estimated selectivity and compute cost"),

Expand Down
Loading
Loading