Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Master auto replay #13

Closed
wants to merge 591 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
591 commits
Select commit Hold shift + click to select a range
05adbfd
[feature](inverted index) match_phrase_prefix feature added (#27404)
zzzxl1993 Dec 5, 2023
7f1b558
[fix](stats) truncate min/max if too long (#27955)
Kikyou1997 Dec 5, 2023
fd1db4d
[agg](profile) fix incorrent profile (#28004)
jacktengg Dec 5, 2023
e431c2b
[Improvement](multi-catalog)make location easier to modified, decoupl…
wsjz Dec 5, 2023
aaa44fa
[deps](odbc) undefined the BOOL in include/sqltypes.h (#28014)
morningman Dec 5, 2023
36c54da
fix owned slice capacity (#28002)
kaijchen Dec 5, 2023
57fb1df
[fix](regression) backup restore cases adapt force_olap_table_replica…
w41ter Dec 6, 2023
7340440
[fix](hdfs) Fix hdfsExists that return staled root cause (#27991)
w41ter Dec 6, 2023
1be513b
[pipelineX](local shuffle) Fix local shuffle for colocate/bucket join…
Gabriel39 Dec 6, 2023
202cc84
[Test](auto-partition) Add auto partition p1 test (#28028)
zclllyybb Dec 6, 2023
4c90b45
[regression-test](variant) fix variant p2 cases (#28025)
eldenmoon Dec 6, 2023
cbf1f86
[Feature](job)support cancel task and fix log invalid (#27703)
CalvinKirs Dec 6, 2023
24fdb7a
[refactor](unusedcode) remove internalquery since it is useless (#28039)
yiguolei Dec 6, 2023
a0fee4c
[fix](nereids) runtime filter prune skip filter with invisible column…
englefly Dec 6, 2023
0a22d96
[refactor](queryqueue) using a priority queue in query queue in order…
yiguolei Dec 6, 2023
393c491
[FIX](map/struct)fix map/struct literal from fe (#28026)
amorynan Dec 6, 2023
e791e31
[test](Nereids): add regression test eliminate/infer rules (#27985)
jackwener Dec 6, 2023
605257c
[Enhancement](group commit) Add regression case for wal limit (#27949)
Yukang-Lian Dec 6, 2023
994c5c6
[chore](log) Add log to trace query cancel #28020
zhiqiang-hhhh Dec 6, 2023
fa5096f
[feature](analyze_cmd) add show-tablets-belong stmt for analyzing a b…
Yulei-Yang Dec 6, 2023
2881799
[pipelineX](improvement) enable local shuffle by default (#28046)
Gabriel39 Dec 6, 2023
bb67e39
[fix](invert index) fix reader is not close (#28033)
zzzxl1993 Dec 6, 2023
1aa1b2f
[opt](Nereids) add switch to control whether use pipeline in DML (#28…
morrySnow Dec 6, 2023
ddb6eb5
[feature](Nereids) add command for updating mv with partitions (#28060)
keanji-x Dec 6, 2023
17be32e
[fix](regression test) fix table name too long (#28049)
yujun777 Dec 6, 2023
e695cb1
[improvement](regression test) add fe debug point (#28047)
yujun777 Dec 6, 2023
ffd7023
[feature](nereids) Support to get partition related table from mv and…
seawinde Dec 6, 2023
ff56605
[pipelineX](bug) Fix hash partition shuffle (#28071)
Gabriel39 Dec 6, 2023
5168422
[Chore](case) remove dynamic partition on test_delete case #28075
BiteTheDDDDt Dec 6, 2023
990b8d4
[minor](s3client) use LOG(INFO) to print s3 client debug log if enabl…
morningman Dec 6, 2023
299fcc4
[Bug](agg-state) fix stream load failed on agg-state column (#28050)
BiteTheDDDDt Dec 6, 2023
3868926
[fix](ci) pass PULL_REQUEST_NUM while trigger new build (#28065)
hello-stephen Dec 6, 2023
ec08850
[Config](multi-catalog) Enable query hive views as default. (#27906)
dutyu Dec 6, 2023
3e8c75e
[minor](orc) opt the log info in orc reader (#27951)
morningman Dec 6, 2023
0282baa
[typo](docker) add logs console (#27570)
FreeOnePlus Dec 6, 2023
bd808ae
[cleanup](load) remove unused LoadChannel::get_tablets_channels (#27981)
kaijchen Dec 6, 2023
0ff5a1c
[fix](doc) spell error and aligned with code (#27609)
Nitin-Kashyap Dec 6, 2023
d4f9e12
[fix](load) fix memtable mem_tracker too large (#25205)
kaijchen Dec 6, 2023
d0697db
[fix](doris compose) fix up command (#27573)
yujun777 Dec 6, 2023
00c8bab
[feature](merge-on-write) enable merge-on-write by default (#27188)
bobhan1 Dec 6, 2023
4a4d137
[feature](workloadgroup) support nereids internal query and all dml q…
yiguolei Dec 6, 2023
2ca66ff
[typo](test) Use correct sql stmt in regression test (#27992)
ByteYue Dec 6, 2023
54d062d
[feature](stream load) (step one)Add arrow data type for stream load …
wuwenchi Dec 6, 2023
e3e78a7
[chore](StoragePolicy) Don't print stack when invoking the storage ma…
ByteYue Dec 7, 2023
42b3dd3
[regression test](broker load) add case for without filepath (#27658)
liugddx Dec 7, 2023
4cac07b
[improvement](statistics)Analyze empty table. #28077
Jibing-Li Dec 7, 2023
616ba28
[regression test](broker load) Test case missing files (#27580)
liugddx Dec 7, 2023
630de74
[fix](meta) fix bug for using full name in show_full_columns stmt (#2…
Yulei-Yang Dec 7, 2023
b672265
[test](Job)Delete the JOB show syntax (now we use TVF) and add tvf ca…
CalvinKirs Dec 7, 2023
00bcf0d
[doc](paimon) add more example for paimon catalog (#28087)
morningman Dec 7, 2023
6f89fae
[fix](profile) fix profile TotalTime is 0ns when pipeline (#28048)
nextdreamblue Dec 7, 2023
0f1da35
[community](slack)Update slack channel links (#28100)
luzhijing Dec 7, 2023
8df94f0
[fix](remote-scanner-pool) missing _remote_thread_pool_max_size value…
morningman Dec 7, 2023
3a7a8bb
[opt](resource-tag) root and admin user can use any resource tag by d…
morningman Dec 7, 2023
8c79b86
Revert "[feature](merge-on-write) enable merge-on-write by default (#…
yiguolei Dec 7, 2023
c5f00fa
[fix](move-memtable) temporary disable load stream profile (#28029)
kaijchen Dec 7, 2023
f2477a3
[Regression](bitmap index) fix bitmap index test case (#28109)
airborne12 Dec 7, 2023
1dabd0a
[Fix](inverted index) fix need read data optimize problem (#28104)
airborne12 Dec 7, 2023
3f3843f
[fix](load) fix loaded rows error (#28061)
sollhui Dec 7, 2023
cb9a6f6
[refactor](simd_json_reader) refactor simd json parse to adapt stream…
sollhui Dec 7, 2023
8526b9f
[imporvement](table property) support for alter table property disabl…
nextdreamblue Dec 7, 2023
495c01b
[fix](session-variable) enable_unicode_name_support need forward to m…
morningman Dec 7, 2023
1a46cf6
[fix](split_by_string) Fix split by string core on column string (#28…
zhiqiang-hhhh Dec 7, 2023
9c63dfd
[improve](move-memtable) support variant in move-memtable (#28084)
eldenmoon Dec 7, 2023
bc12a05
[fix](Nereids) explain graph insert-select NPE (#28007)
englefly Dec 7, 2023
84a651d
[improve](load) rewrite memtable memory limiter rules (#27759)
kaijchen Dec 7, 2023
a27c068
[improve](move-memtable) make StreamWait time configurable (#28086)
kaijchen Dec 7, 2023
1727476
[fix](Nereids)fix regression case:nereids_rules_p0/transposeJoin/tran…
englefly Dec 7, 2023
394b420
[Update](inverted index) use session variable for inverted index try …
airborne12 Dec 7, 2023
3dcbf16
[Fix](Outfile) The Struct type data exported from select outfile to t…
BePPPower Dec 7, 2023
3464278
[fix](meta) fix ConcurrentModificationException when dump image (#28072)
morningman Dec 7, 2023
942450a
[Fix](Variant) ColumnObject need to be finalized when doing ColumnObj…
eldenmoon Dec 7, 2023
cc9b4bc
[Fix](variant) fallback to none partial update for mow table (#28116)
eldenmoon Dec 7, 2023
65fc2e0
[fix](Nereids) forbid two TVF in one fragment since the limit of coor…
morrySnow Dec 7, 2023
f37215a
[fix](Nereids) insert into target table lock should include finalize …
morrySnow Dec 7, 2023
be81eb1
[feature](nereids) Support inner join query rewrite by materialized v…
seawinde Dec 7, 2023
104a822
[Refacotr](RuntimeFilter) refactor rf code to improve performance (#2…
HappenLee Dec 7, 2023
b1c5519
[doc](statistics)Update external catalog statistics doc (#28123)
Jibing-Li Dec 7, 2023
a2d6691
[chore](docs) Fix partition cache design principles #28110
xinyiZzz Dec 7, 2023
397a401
[fix](arrow-flight) Modify FE Arrow version to 14.0.1 #28093
xinyiZzz Dec 7, 2023
81a0f8c
[Feature](function) support generating const values from tvf numbers …
zclllyybb Dec 7, 2023
f9d4690
[improve](stack_trace) avoid print stack trace in csv and json reader…
sollhui Dec 7, 2023
cbb238a
[improve](env) Add disk usage in not ready msg (#28125)
w41ter Dec 7, 2023
66ed093
[test](Nereids): fix test push_down_top_n (#26937)
jackwener Dec 7, 2023
9461e86
[pipelineX](debug) add debug string (#28137)
Gabriel39 Dec 7, 2023
d8d8f15
[improvement](vectorization) Use requires instead of specialization f…
julic20s Dec 8, 2023
1d34587
[fix](regression-test) load_to_single_tablet assertEquals usage (#28128)
qidaye Dec 8, 2023
e75d91c
[regression-test](Variant) Add more cases related to schema changes (…
eldenmoon Dec 8, 2023
25b90eb
[Feature](function) support random int from specific range (#28076)
zclllyybb Dec 8, 2023
0947bf4
[opt](mysql serde) Avoid core dump when converting invalid block to m…
zhiqiang-hhhh Dec 8, 2023
cd10868
[Chore](docs)Fix job error docs (#28127)
CalvinKirs Dec 8, 2023
d534cdf
[compile](BE) let arm gcc know some function no return (#28157)
zclllyybb Dec 8, 2023
ebed055
[chore](clone) rename clone request field (#27591)
yujun777 Dec 8, 2023
59ec3da
open workload group in PR pipeline (#27744)
wangbo Dec 8, 2023
341822e
[regression-test](Variant) add compaction case for variant and fix bu…
eldenmoon Dec 8, 2023
61d556c
[fix](nereids)runtime filter translator failed on set operator (#28102)
englefly Dec 8, 2023
16230b5
[Enhance](multi-catalog) parse hive view ddl first to avoid NPE. (#28…
dutyu Dec 8, 2023
6da36e1
[feature](merge-cloud) Refactor write path code by abstract base clas…
platoneko Dec 8, 2023
bc40025
[opt](Nereids)Join cluster connectivity (#27833)
englefly Dec 8, 2023
226a0c3
[chore](memory) Warning in log when turning on THP (#28122)
xinyiZzz Dec 8, 2023
75b55f8
[enhance](session)check invalid value when set parallel instance vari…
zhangstar333 Dec 8, 2023
0931eb5
Revert "[Improvement](auditlog) add column catalog for audit log and …
zhiqiang-hhhh Dec 8, 2023
51f320a
[bug](function) fix array_apply function return wrong result (#28133)
zhangstar333 Dec 8, 2023
573b594
[improvement](Variant Type) Support displaying subcolumns expanded fo…
csun5285 Dec 8, 2023
5e7afa7
[fix](statistics)Avoid potential NPE #28147
Jibing-Li Dec 8, 2023
0640411
[Fix](point query) fix memleak by increasing `scanReplicaIds` when us…
eldenmoon Dec 8, 2023
18ef131
[fix](load) select more active memtables at once in memtable limiter …
kaijchen Dec 8, 2023
2b914ae
[opt](nereids)improve partition prune when Date function is used (#27…
englefly Dec 8, 2023
baf8554
[feature](jdbc) support call function to pass sql directly to jdbc ca…
morningman Dec 8, 2023
8eed760
[fix](planner) separate table's isPartitioned() method (#28163)
morningman Dec 8, 2023
abc802b
[bugfix](core) child block is shared between operator and node, it sh…
yiguolei Dec 8, 2023
055b388
[Fix](inverted index) fix compound directory flush buffer error (#28191)
airborne12 Dec 8, 2023
b6e72d5
[Improvement](hms catalog) support show_create_database for hms catal…
Yulei-Yang Dec 8, 2023
027b060
[Feature](materialized-view) support count(1) on materialized view (#…
BiteTheDDDDt Dec 8, 2023
99be9d6
[fix](memlimiter) refresh memtracker before flush active memtables (#…
kaijchen Dec 8, 2023
99b38dd
[improve](env) Ensure next majority is met before drop an alive follo…
w41ter Dec 8, 2023
0733698
[fix](meta) show partitions with Limit for external HMS tables (27835…
Nitin-Kashyap Dec 8, 2023
c6f8b1b
[fix](repository) the exist repo_file must contails same name with ne…
nextdreamblue Dec 8, 2023
bd81301
[fix](doc) spell errors fixes hardware-info-action (#28154)
Nitin-Kashyap Dec 8, 2023
287bd87
[typo](docs)add some faq for flink-connector-doris (#26309)
vinlee19 Dec 8, 2023
9d9b646
[improve](group_commit) optimize group commit select be logic #28190
sollhui Dec 8, 2023
42aa174
[chore](log) Log to trace before wait rpc timeout #28024
zhiqiang-hhhh Dec 9, 2023
363721e
[Bug](udf) java-udf function open failed cause BE core dump #28063
zhangstar333 Dec 9, 2023
16e232a
[minor](lower-table-names) use GlobalVariable.lowerCaseTableNames ins…
morningman Dec 9, 2023
4e86f9b
[improve](move-memtable) include and check offset when append data (#…
kaijchen Dec 9, 2023
61379b1
[fix](insert) fix group commit regression test (#28142)
hust-hhb Dec 9, 2023
5aa90a3
[pipelineX](local shuffle) Fix bucket hash shuffle (#28202)
Gabriel39 Dec 9, 2023
a3cd36c
[bug](cooldown) Fix incorrect remote rowset dir after restarting BE (…
platoneko Dec 9, 2023
485d7db
[fix](partial update) Fix missing rowsets during doing alignment when…
bobhan1 Dec 10, 2023
320ddf4
[pipelineX](improvement) Support multiple instances execution on sing…
Gabriel39 Dec 10, 2023
1e5ff40
[refactor](group commit) remove future block (#27720)
mymeiyi Dec 11, 2023
8f2202c
[minor](log) Add debug info in operators (#28211)
Gabriel39 Dec 11, 2023
f236261
[fix](regression) compaction cases adapt force_olap_table_replica_num…
Xiaoccer Dec 11, 2023
53802fe
[doc] document desc param is incorrect #26063 (#26064)
LuGuangming Dec 11, 2023
e158753
[Fix](status) fix unhandled status in exprs #28218
zclllyybb Dec 11, 2023
f2fd66a
[feature-wip](nereids) Make nereids more compatible with spark-sql sy…
dutyu Dec 11, 2023
7c163fd
[test](decimal) add some cases about overflow (#28198)
mrhhsg Dec 11, 2023
ac167f4
[fix](join) fix decimal overflow caused by left outer join (#28221)
jacktengg Dec 11, 2023
1bbc54d
[regression-test](variant) change p2 case to s3 load (#28193)
eldenmoon Dec 11, 2023
593cc92
[chore] Change default max segment size to 1GB (#28201)
gavinchou Dec 11, 2023
c2d6fbb
[feature](Nereids): add filter edge in hyperGraph (#28006)
keanji-x Dec 11, 2023
3c2e8b0
[fix](Nereids) rewrite cte children check wrong map for consumer (#28…
morrySnow Dec 11, 2023
ad483ef
[regression-test](case) forbid group commit case first #28244
shuke987 Dec 11, 2023
cff1de2
[fix](group commit) Fix group commit memory calculation (#28242)
mymeiyi Dec 11, 2023
3e1e8d2
[fix](jdbc catalog) Fixed data conversion problem when all data is nu…
zy-kkk Dec 11, 2023
8779354
[feature](pipelineX)use markFragments instead of markInstances in pip…
Mryange Dec 11, 2023
c1f666c
[doc] fix typo (#28245)
morningman Dec 11, 2023
9b8de01
[Regression test](inverted index) fix regression case for index_compo…
airborne12 Dec 11, 2023
d4f8938
[improve](group commit) Group commit support skip wal (#27957)
mymeiyi Dec 11, 2023
f30cc1f
[Bug](view) fix npe on create view with comment (#28189)
BiteTheDDDDt Dec 11, 2023
cd3d31b
[fix](statistics)Escape load stats sql (#28117)
Jibing-Li Dec 11, 2023
c4e4849
[Fix](table property) Fix table property `disable_auto_compaction` (#…
bobhan1 Dec 11, 2023
7fba3fc
[pipelineX](improvement) block local shuffle sink by mem usage (#28224)
Gabriel39 Dec 11, 2023
5ff110e
[exec](profile) only build expr debug string enable profile (#28261)
HappenLee Dec 12, 2023
8a7b0e5
[upgrade](thirdparty) upgrade librdkafka from 1.8.2 to 2.0.2 (#28210)
sollhui Dec 12, 2023
e49ed3d
[regression test](memtable) add case for aggregation memtable (#28056)
Ma1oneZhang Dec 12, 2023
a5a7ab3
[pipelineX](profile) Add debug string if enable profile (#28262)
Gabriel39 Dec 12, 2023
3f20247
[minor](import) modify some imports (#28206)
morningman Dec 12, 2023
cd8885f
[fix](Nereids): support Chinese characters set (#28256)
jackwener Dec 12, 2023
9861cfc
[Fix](Transactional-Hive) Fix transactional hive core dump when `Tran…
kaka11chen Dec 12, 2023
d9fb77a
[fix](mtmv)fix show task tvf finishTime is null (#28252)
zddr Dec 12, 2023
92e04c1
[feature](Nereids): support comparing outer join in materialized view…
keanji-x Dec 12, 2023
d25cbdd
[feature](Nereids): one side eager aggregation (#28143)
jackwener Dec 12, 2023
45b2dba
[improve](group commit) Group commit support max filter ratio when ro…
mymeiyi Dec 12, 2023
4e50b27
[fix](Nereids) pull up cte anchor should also pull up cte in apply (#…
morrySnow Dec 12, 2023
f401a9c
[fix](pipelineX) fix use-after-free in filter timer queue (#28236)
Mryange Dec 12, 2023
7ac12ac
[feature](Nereids): return edges that can be pulled up (#28280)
keanji-x Dec 12, 2023
6e5f846
[fix](Nereids): remove duplicated dependency (#28279)
jackwener Dec 12, 2023
b821c37
[Refact](inverted index) comment out block_column_predicate for inver…
airborne12 Dec 12, 2023
15f5acf
[feature](pipelineX) add local_shuffle in sort partition sort analyti…
Mryange Dec 12, 2023
0a5a579
[test](jdbc catalog) Use different table names to prevent case errors…
zy-kkk Dec 12, 2023
5c1d69d
[opt](session var) throw exception when setting query time out to zer…
zhiqiang-hhhh Dec 12, 2023
ace2b45
[fix](decimalv2) avoid crashing caused by decimalv2 arithmetic with c…
mrhhsg Dec 12, 2023
13b9350
[Bug](scan)fix some case query timeout of not schedule scanner (#28243)
zhangstar333 Dec 12, 2023
7f9cecb
[fix](fe) Key column varchar length change should't light schema chan…
SWJTU-ZhangLei Dec 12, 2023
7f60427
[improvement](truncate table) truncate skip empty partition (#28229)
yujun777 Dec 12, 2023
cdb452f
[typo](docs)update jdk download version to 8u391 #28216
FreeOnePlus Dec 12, 2023
15553e6
[Bug](fold-constant) fix result error with fold constant on BE (#28194)
zhangstar333 Dec 12, 2023
5e374c6
Fix FE web insecure cookie setting #26056 (#26057)
LuGuangming Dec 12, 2023
78cf401
[enhancement](err-msg) expose real error msg for invalid delete conf…
TangSiyang2001 Dec 12, 2023
9372959
Revert "[regression-test](case) forbid group commit case first #28244…
mymeiyi Dec 12, 2023
eda2818
[fix](group commit) Fix insert_group_commit_into_unique_sync_mode (#2…
mymeiyi Dec 12, 2023
bb4c192
[improvement](doris compose) show all cluster (#28288)
yujun777 Dec 12, 2023
805673d
[typo](doc)Add spark load faq (#28015)
caoliang-web Dec 13, 2023
b901800
[Fix] Support BE log sys_log_level modify to take effect dynamically …
LuGuangming Dec 13, 2023
a719d7a
[fix](memory) Fix LRU Cache of type `NUMBER` charge (#28175)
xinyiZzz Dec 13, 2023
78b0fec
[Fix](Outfile) Support export nested complex type data to orc file fo…
BePPPower Dec 13, 2023
764d893
Remove unused const variables NUMBER, ZERO in vnumbers_tvf.cpp (#28317)
JackDrogon Dec 13, 2023
862cb09
[fix](load) count MemTable::to_block memory in flush tracker (#28312)
kaijchen Dec 13, 2023
613b0bd
[fix](decimal) fix decimal overflow caused by null value (#28260)
jacktengg Dec 13, 2023
cd6d75e
[fix](memory) `TabletSchema` and `Schema` no longer track memory, onl…
xinyiZzz Dec 13, 2023
5f66335
[feature](pipelineX) add local_shuffle in set_operation / assert_num …
Mryange Dec 13, 2023
2005fee
[fix](user) Avoid throw unknown UserProperty after FE rollback versio…
xinyiZzz Dec 13, 2023
3e08bec
[opt](regression test) use select count from tablet api (#28327)
qidaye Dec 13, 2023
8ac52ae
[fix](nereids) wrong result when simplify int compare with decimal li…
starocean999 Dec 13, 2023
dee89d2
[refactor](Nereids) let create table compatible with legacy planner (…
starocean999 Dec 13, 2023
e6e8632
[improvement](merge-on-write) Optimize publish when there are missing…
liaoxin01 Dec 13, 2023
ac262fa
[fix](partial update) Fix session variable `enable_unique_key_partial…
bobhan1 Dec 13, 2023
62859f3
[fix](nereids)cast string to integer type use wrong datatype's valueO…
starocean999 Dec 13, 2023
ea83274
[fix](journal) ensure txns are matched with the master before replayi…
w41ter Dec 13, 2023
9b94faf
fix](memory_leak) fix memory leak on vrow_distribution #28336
zclllyybb Dec 13, 2023
4332738
[regression test](broker laod) add exception case for merge type (#2…
liugddx Dec 13, 2023
4f58214
[case]Load data with load_parallelism=any > 1 and stream load with co…
Zhiyu-h Dec 13, 2023
524bce3
[doc](auditlog) update description of field sql_digest (#28340)
zhiqiang-hhhh Dec 13, 2023
ec91dd1
[opt](vfilescanner) interrupt running parquet/orc readers when scanno…
AshinGau Dec 13, 2023
dbc2b08
[fix](Nereids) could not do partition prunning when predicates is NUL…
morrySnow Dec 13, 2023
0868526
[fix](sequence column) fix update fail on nereids planner (#28031)
zhannngchen Dec 13, 2023
099b1b7
[fix](statistics)Fix column stats trigger info bug (#28303)
Jibing-Li Dec 13, 2023
e4f7b25
[optimize](invert index) inverted indexes optimize the file cache (#2…
zzzxl1993 Dec 13, 2023
a271fee
[test](statistics)Add external empty table test case. (#28267)
Jibing-Li Dec 13, 2023
33e2443
[fix](regression) mow cases should use assertEquals not assertTrue (#…
mymeiyi Dec 13, 2023
e5be751
[bug](exchange) Fix core dump if prepare failed (#28363)
Gabriel39 Dec 13, 2023
1901f0f
[fix](function) bad performance caused by creating Status::RuntimeErr…
mrhhsg Dec 14, 2023
97df598
[Fix](inverted index) update clucene (#28356)
airborne12 Dec 14, 2023
48937fe
[Performance](json reader) optimize filling default values (#25542)
eldenmoon Dec 14, 2023
b443db6
[fix](doriswriter)Fix multiple concurrent import label duplication is…
caoliang-web Dec 14, 2023
c00dca7
[pipelineX](local shuffle) Support parallel execution despite of tabl…
Gabriel39 Dec 14, 2023
79f03d6
[docs](releasenote)2.0.3 release note (#28373)
luzhijing Dec 14, 2023
e5a57f8
[fix](Variant Type) Fixes the desc failure (#28343)
csun5285 Dec 14, 2023
bb23078
[feture](Nereids) support delete from without using (#28083)
morrySnow Dec 14, 2023
e53cfa0
[fix](join) incorrect result of right anti join with nullable (#28301)
mrhhsg Dec 14, 2023
ee24667
[fix](group commit) Fix some group commit problems (#28319)
mymeiyi Dec 14, 2023
9e62e3e
[doc](readme)Update README.md (#28391)
luzhijing Dec 14, 2023
634292e
[Enhancement](build support) make run_clang_format compatible with py…
airborne12 Dec 14, 2023
e1f7b6c
[typo](doc) update spark connector doc for version 1.3.0 (#28239)
gnehil Dec 14, 2023
6c9c1ef
[test](regression) add flink sync db case (#19328)
JNSimba Dec 14, 2023
9fe2fce
[minor](refactor) remove unused code (#28383)
Gabriel39 Dec 14, 2023
38e79e3
[fix](mtmv)fix start time can not be earlier than the current time (#…
zddr Dec 14, 2023
c08ab9e
[feature](HiveCatalog) Support for getting hive meta data from relati…
BePPPower Dec 14, 2023
01c94a5
[fix](autoinc) Fix broker load when target table has autoinc column (…
bobhan1 Dec 14, 2023
23941ef
[improve](pipelineX) improve partition node dependency logical (#28399)
zhangstar333 Dec 14, 2023
429a3ed
[fix](Nereids) simplify range produce true when reference is nullable…
morrySnow Dec 14, 2023
82a9138
[enhancement](compaction) Add support for limiting low priority compa…
Xiaoccer Dec 14, 2023
a540b7e
[fix](Nereids) multi_distinct_sum should inherit NullableAggregateFun…
morrySnow Dec 14, 2023
4300fdc
[feature](merge-on-write) enable merge-on-write by default again (#28…
bobhan1 Dec 14, 2023
310d1ab
[feature](pipelineX)add parent-child relationship between the sink a…
Mryange Dec 14, 2023
8ca7bd8
[enhancement](bitmap)support bitmap type for non-key column in duplic…
bobhan1 Dec 14, 2023
415c6d8
[fix](partial update) Fix some bugs about partial update (#28358)
bobhan1 Dec 14, 2023
eebedbc
[optimize](cooldown)Reduce unnecessary sort operations for vector (#2…
xingyingone Dec 14, 2023
eb99e42
[Fix](parquet_reader) Fix dict filtering doesn't work with plain dict…
kaka11chen Dec 15, 2023
4d9b6c2
[Fix](vcompound pred) Corrected evaluation for compound predicates wi…
airborne12 Dec 15, 2023
1877389
[fix](Nereids) set card to olap table break card block rule (#28417)
morrySnow Dec 15, 2023
ce60064
[regression-test](variant) fix unstable query result m… (#28390)
eldenmoon Dec 15, 2023
8661b5e
[Bug](function) fix npe on select http_stream directly (#28423)
BiteTheDDDDt Dec 15, 2023
c4242ab
[Chore](Job)Add the configuration of the maximum number of persistenc…
CalvinKirs Dec 15, 2023
4c51558
[feature](nereids) Support basic aggregate rewrite and function rollu…
seawinde Dec 15, 2023
6f3fb81
[fix](doc) spell errors fixes multi-tenant.md (#28436)
Nitin-Kashyap Dec 15, 2023
e6b135c
[improvement](fe) Add reason log when `Env` is not ready (#28286)
SWJTU-ZhangLei Dec 15, 2023
2018ab2
[chore](build) Add MVN_OPT env variable to enrich building FE with ex…
gavinchou Dec 15, 2023
8eb8b3f
[Chore](Workflow)Fix auto-reply not work
CalvinKirs Dec 15, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
The diff you're trying to view is too large. We only load the first 3000 changed files.
1 change: 1 addition & 0 deletions .asf.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -116,6 +116,7 @@ github:
- gitccl
- shuke987
- wm1581066
- KassieZ

notifications:
pullrequests_status: [email protected]
Expand Down
1 change: 0 additions & 1 deletion .github/actions/create-or-update-comment
Submodule create-or-update-comment deleted from 23ff15
36 changes: 27 additions & 9 deletions .github/workflows/auto-pr-reply.yml
Original file line number Diff line number Diff line change
@@ -1,18 +1,36 @@
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.

name: Auto Reply to PR

on:
pull_request:
types: [opened]

jobs:
comment:
pr_commented:
# This job only runs for pull request comments
name: PR comment
if: ${{ github.event.issue.pull_request }}
runs-on: ubuntu-latest
steps:
- name: Comment on PR
uses: ./.github/actions/create-or-update-comment
with:
issue-number: ${{ github.event.pull_request.number }}
body: |
Thank you for your contribution to Apache Doris.
- run: |
echo Thank you for your contribution to Apache Doris.

echo Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)

Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
env:
NUMBER: ${{ github.event.issue.number }}
29 changes: 15 additions & 14 deletions .github/workflows/comment-to-trigger-teamcity.yml
Original file line number Diff line number Diff line change
Expand Up @@ -50,6 +50,7 @@ jobs:
"${COMMENT_BODY}" == *'run tpch'* ]]; then
echo "comment_trigger=true" | tee -a "$GITHUB_OUTPUT"
else
echo "comment_trigger=false" | tee -a "$GITHUB_OUTPUT"
echo "find no keyword in comment body, skip this action."
exit
fi
Expand All @@ -63,17 +64,17 @@ jobs:
echo "COMMENT_BODY='${COMMENT_BODY}'" | tee -a "$GITHUB_OUTPUT"

reg="run (buildall|compile|p0|p1|feut|beut|external|clickbench|pipelinex_p0|arm|tpch)( [1-9]*[0-9]+)*"
COMMENT_TRIGGER_TYPE="$(echo "${COMMENT_BODY}" | xargs | grep -E "${reg}" | awk -F' ' '{print $2}' | sed -n 1p)"
COMMENT_REPEAT_TIMES="$(echo "${COMMENT_BODY}" | xargs | grep -E "${reg}" | awk -F' ' '{print $3}' | sed -n 1p)"
COMMENT_TRIGGER_TYPE="$(echo -e "${COMMENT_BODY}" | xargs | grep -E "${reg}" | awk -F' ' '{print $2}' | sed -n 1p | sed 's/\r//g')"
COMMENT_REPEAT_TIMES="$(echo -e "${COMMENT_BODY}" | xargs | grep -E "${reg}" | awk -F' ' '{print $3}' | sed -n 1p | sed 's/\r//g')"
echo "COMMENT_TRIGGER_TYPE=${COMMENT_TRIGGER_TYPE}" | tee -a "$GITHUB_OUTPUT"
echo "COMMENT_REPEAT_TIMES=${COMMENT_REPEAT_TIMES}" | tee -a "$GITHUB_OUTPUT"

- name: "Checkout master"
if: ${{ steps.parse.outputs.comment_trigger }}
if: ${{ fromJSON(steps.parse.outputs.comment_trigger) }}
uses: actions/checkout@v4

- name: "Check if pr need run build"
if: ${{ steps.parse.outputs.comment_trigger }}
if: ${{ fromJSON(steps.parse.outputs.comment_trigger) }}
id: changes
run: |
source regression-test/pipeline/common/github-utils.sh
Expand Down Expand Up @@ -130,7 +131,7 @@ jobs:
# uses: mxschmitt/action-tmate@v3

- name: "Trigger or Skip feut"
if: ${{ steps.parse.outputs.comment_trigger && contains(fromJSON('["feut", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
if: ${{ fromJSON(steps.parse.outputs.comment_trigger) && contains(fromJSON('["feut", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
run: |
source ./regression-test/pipeline/common/teamcity-utils.sh
set -x
Expand All @@ -143,7 +144,7 @@ jobs:


- name: "Trigger or Skip beut"
if: ${{ steps.parse.outputs.comment_trigger && contains(fromJSON('["beut", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
if: ${{ fromJSON(steps.parse.outputs.comment_trigger) && contains(fromJSON('["beut", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
run: |
source ./regression-test/pipeline/common/teamcity-utils.sh
set -x
Expand All @@ -155,7 +156,7 @@ jobs:
"${{ steps.parse.outputs.COMMENT_REPEAT_TIMES }}"

- name: "Trigger or Skip compile"
if: ${{ steps.parse.outputs.comment_trigger && contains(fromJSON('["compile", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
if: ${{ fromJSON(steps.parse.outputs.comment_trigger) && contains(fromJSON('["compile", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
run: |
source ./regression-test/pipeline/common/teamcity-utils.sh
set -x
Expand All @@ -167,7 +168,7 @@ jobs:
"${{ steps.parse.outputs.COMMENT_REPEAT_TIMES }}"

- name: "Trigger or Skip p0"
if: ${{ steps.parse.outputs.comment_trigger && contains(fromJSON('["p0", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
if: ${{ fromJSON(steps.parse.outputs.comment_trigger) && contains(fromJSON('["p0", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
run: |
source ./regression-test/pipeline/common/teamcity-utils.sh
if [[ ${{ steps.parse.outputs.COMMENT_TRIGGER_TYPE }} == "buildall" ]]; then
Expand All @@ -182,7 +183,7 @@ jobs:
"${{ steps.parse.outputs.COMMENT_REPEAT_TIMES }}"

- name: "Trigger or Skip p1"
if: ${{ steps.parse.outputs.comment_trigger && contains(fromJSON('["p1", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
if: ${{ fromJSON(steps.parse.outputs.comment_trigger) && contains(fromJSON('["p1", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
run: |
source ./regression-test/pipeline/common/teamcity-utils.sh
COMMIT_ID_FROM_TRIGGER=${{ steps.parse.outputs.COMMIT_ID_FROM_TRIGGER }}
Expand All @@ -198,7 +199,7 @@ jobs:
"${{ steps.parse.outputs.COMMENT_REPEAT_TIMES }}"

- name: "Trigger or Skip external"
if: ${{ steps.parse.outputs.comment_trigger && contains(fromJSON('["external", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
if: ${{ fromJSON(steps.parse.outputs.comment_trigger) && contains(fromJSON('["external", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
run: |
source ./regression-test/pipeline/common/teamcity-utils.sh
if [[ ${{ steps.parse.outputs.COMMENT_TRIGGER_TYPE }} == "buildall" ]]; then
Expand All @@ -213,7 +214,7 @@ jobs:
"${{ steps.parse.outputs.COMMENT_REPEAT_TIMES }}"

- name: "Trigger or Skip pipelinex_p0"
if: ${{ steps.parse.outputs.comment_trigger && contains(fromJSON('["pipelinex_p0", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
if: ${{ fromJSON(steps.parse.outputs.comment_trigger) && contains(fromJSON('["pipelinex_p0", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
run: |
source ./regression-test/pipeline/common/teamcity-utils.sh
if [[ ${{ steps.parse.outputs.COMMENT_TRIGGER_TYPE }} == "buildall" ]]; then
Expand All @@ -228,7 +229,7 @@ jobs:
"${{ steps.parse.outputs.COMMENT_REPEAT_TIMES }}"

- name: "Trigger or Skip arm"
if: ${{ steps.parse.outputs.comment_trigger && contains(fromJSON('["arm", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
if: ${{ fromJSON(steps.parse.outputs.comment_trigger) && contains(fromJSON('["arm", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
run: |
source ./regression-test/pipeline/common/teamcity-utils.sh
set -x
Expand All @@ -240,7 +241,7 @@ jobs:
"${{ steps.parse.outputs.COMMENT_REPEAT_TIMES }}"

- name: "Trigger or Skip clickbench"
if: ${{ steps.parse.outputs.comment_trigger && contains(fromJSON('["clickbench", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
if: ${{ fromJSON(steps.parse.outputs.comment_trigger) && contains(fromJSON('["clickbench", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
run: |
source ./regression-test/pipeline/common/teamcity-utils.sh
set -x
Expand All @@ -252,7 +253,7 @@ jobs:
"${{ steps.parse.outputs.COMMENT_REPEAT_TIMES }}"

- name: "Trigger or Skip tpch"
if: ${{ steps.parse.outputs.comment_trigger && contains(fromJSON('["tpch", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
if: ${{ fromJSON(steps.parse.outputs.comment_trigger) && contains(fromJSON('["tpch", "buildall"]'), steps.parse.outputs.COMMENT_TRIGGER_TYPE) }}
run: |
source ./regression-test/pipeline/common/teamcity-utils.sh
if [[ ${{ steps.parse.outputs.COMMENT_TRIGGER_TYPE }} == "buildall" ]]; then
Expand Down
3 changes: 0 additions & 3 deletions .gitmodules
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,3 @@
path = be/src/clucene
url = https://github.com/apache/doris-thirdparty.git
branch = clucene
[submodule ".github/actions/create-or-update-comment"]
path = .github/actions/create-or-update-comment
url = https://github.com/peter-evans/create-or-update-comment
10 changes: 4 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ under the License.
[![GitHub release](https://img.shields.io/github/release/apache/doris.svg)](https://github.com/apache/doris/releases)
[![Jenkins Vec](https://img.shields.io/jenkins/tests?compact_message&jobUrl=https://ci-builds.apache.org/job/Doris/job/doris_daily_enable_vectorized&label=VectorizedEngine)](https://ci-builds.apache.org/job/Doris/job/doris_daily_enable_vectorized)
[![Total Lines](https://tokei.rs/b1/github/apache/doris?category=lines)](https://github.com/apache/doris)
[![Join the Doris Community at Slack](https://img.shields.io/badge/chat-slack-brightgreen)](https://join.slack.com/t/apachedoriscommunity/shared_invite/zt-1x7x8fger-F7NoshFQn~djlvGdnEtxUQ)
[![Join the Doris Community at Slack](https://img.shields.io/badge/chat-slack-brightgreen)](https://join.slack.com/t/apachedoriscommunity/shared_invite/zt-28il1o2wk-DD6LsLOz3v4aD92Mu0S0aQ)
[![Join the chat at https://gitter.im/apache-doris/Lobby](https://badges.gitter.im/apache-doris/Lobby.svg)](https://gitter.im/apache-doris/Lobby?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge)
[![EN doc](https://img.shields.io/badge/Docs-English-blue.svg)](https://doris.apache.org/docs/dev/summary/basic-summary/)
[![CN doc](https://img.shields.io/badge/文档-中文版-blue.svg)]([https://doris.apache.org/zh-CN/docs/dev/get-starting/what-is-apache-doris](https://doris.apache.org/zh-CN/docs/dev/get-starting/what-is-apache-doris))
Expand All @@ -35,11 +35,9 @@ Apache Doris is an easy-to-use, high-performance and real-time analytical databa

All this makes Apache Doris an ideal tool for scenarios including report analysis, ad-hoc query, unified data warehouse, and data lake query acceleration. On Apache Doris, users can build various applications, such as user behavior analysis, AB test platform, log retrieval analysis, user portrait analysis, and order analysis.

🎉 Version 2.0.2 version released now. The 2.0.2 version has achieved over 10x performance improvements on standard Benchmark, comprehensive enhancement in log analysis and lakehouse scenarios, more efficient and stable data update and write efficiency, support for more comprehensive multi-tenant and resource isolation mechanisms, and take a new step in the direction of resource elasticity and storage computing separation. It has also been added a series of usability features for enterprise users. We welcome all users who have requirements for the new features of the 2.0 version to deploy and upgrade. Check out the 🔗[Release Notes](https://github.com/apache/doris/issues/25011) here.
🎉 Version 2.0.3 released now. Check out the 🔗[Release Notes](https://doris.apache.org/docs/dev/releasenotes/release-2.0.3) here. The 2.0 version has achieved over 10x performance improvements on standard Benchmark, comprehensive enhancement in log analysis and lakehouse scenarios, more efficient and stable data update and write efficiency, support for more comprehensive multi-tenant and resource isolation mechanisms, and take a new step in the direction of resource elasticity and storage computing separation. It has also been added a series of usability features for enterprise users. We welcome all users who have requirements for the new features of the 2.0 version to deploy and upgrade.

🎉 Version 1.2.7 released now! It is fully evolved release and all users are encouraged to upgrade to this release. Check out the 🔗[Release Notes](https://doris.apache.org/docs/dev/releasenotes/release-1.2.7) here.

🎉 Version 1.1.5 released now. It is a stability improvement and bugfix release based on version 1.1. Check out the 🔗[Release Notes](https://doris.apache.org/docs/dev/releasenotes/release-1.1.5) here.
🎉 Version 1.2.7 released now! It is fully evolved release and all users are encouraged to upgrade to this release. Check out the 🔗[Release Notes](https://doris.apache.org/docs/releasenotes/release-1.2.7) here.

👀 Have a look at the 🔗[Official Website](https://doris.apache.org/) for a comprehensive list of Apache Doris's core features, blogs and user cases.

Expand Down Expand Up @@ -217,7 +215,7 @@ Contact us through the following mailing list.

* Apache Doris Official Website - [Site](https://doris.apache.org)
* Developer Mailing list - <[email protected]>. Mail to <[email protected]>, follow the reply to subscribe the mail list.
* Slack channel - [Join the Slack](https://join.slack.com/t/apachedoriscommunity/shared_invite/zt-1x7x8fger-F7NoshFQn~djlvGdnEtxUQ)
* Slack channel - [Join the Slack](https://join.slack.com/t/apachedoriscommunity/shared_invite/zt-28il1o2wk-DD6LsLOz3v4aD92Mu0S0aQ)
* Twitter - [Follow @doris_apache](https://twitter.com/doris_apache)


Expand Down
14 changes: 2 additions & 12 deletions be/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -184,12 +184,8 @@ set(ZLIB_ROOT "$ENV{DORIS_THIRDPARTY}/installed")
set(Roaring_ROOT "$ENV{DORIS_THIRDPARTY}/installed")
set(USE_STAT64 0)

if (USE_BTHREAD_SCANNER)
set(USE_BTHREAD ON)
else()
set(USE_BTHREAD OFF)
endif()

# disable clucene bthread supported.
set(USE_BTHREAD OFF)

add_subdirectory(${SRC_DIR}/clucene EXCLUDE_FROM_ALL)

Expand Down Expand Up @@ -343,12 +339,6 @@ if (USE_UNWIND)
endif()
endif()

# Use Bthread to separate computation and IO
# Adding the option `USE_BTHREAD_SCANNER=ON sh build.sh` when comliling can enable this feature
if (USE_BTHREAD_SCANNER)
set(CXX_COMMON_FLAGS "${CXX_COMMON_FLAGS} -DUSE_BTHREAD_SCANNER")
endif()

if (ENABLE_STACKTRACE)
add_compile_options(-DENABLE_STACKTRACE)
endif()
Expand Down
5 changes: 5 additions & 0 deletions be/cmake/thirdparty.cmake
Original file line number Diff line number Diff line change
Expand Up @@ -161,3 +161,8 @@ if (OS_MACOSX)
add_thirdparty(iberty)
add_thirdparty(intl)
endif()

# Only used on x86 or x86_64
if ("${CMAKE_BUILD_TARGET_ARCH}" STREQUAL "x86" OR "${CMAKE_BUILD_TARGET_ARCH}" STREQUAL "x86_64")
add_thirdparty(deflate)
endif()
Loading
Loading