Commit Graph

16864 Commits

Author SHA1 Message Date
yihaoDeng 9ca1151b67 refactor checkpoint 2023-11-06 19:47:47 +08:00
Haojun Liao 1f09d3a46b fix(stream): fix error. 2023-11-06 19:46:47 +08:00
Haojun Liao d9474016fc fix(stream): exec scan-history in timer. 2023-11-06 18:55:53 +08:00
yihaoDeng aee1b700a6 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-06 18:08:03 +08:00
yihaoDeng ba52769867 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-06 17:56:09 +08:00
liuyao 4ce81f25da session window max delay 2023-11-06 17:45:18 +08:00
kailixu 2f4c732cfb Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-06 17:32:04 +08:00
Benguang Zhao 8f1e3197b2 enh: print lastApplyTerm of snap sender in format of int64 2023-11-06 17:31:31 +08:00
Haojun Liao 6b1889284b fix(stream): record the start failure tasks. 2023-11-06 15:45:44 +08:00
wangjiaming0909 04a1f2ef4d feat: cache scan for select last(c), ts/c 2023-11-06 15:26:12 +08:00
slzhou 6136b1d018 fix: fix tbname or error 2023-11-06 13:49:01 +08:00
liuyao 1f523abff5 release row buff pos 2023-11-06 13:40:53 +08:00
yihaoDeng feeead50c5 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-06 13:26:38 +08:00
Haojun Liao 69863febe6 fix(stream):reset the starting flag for the followers. 2023-11-06 13:17:13 +08:00
slzhou 1153e5ddc2 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tbname-prune-vgroup 2023-11-06 13:15:25 +08:00
slzhou 5495e1ceac fix: use the right target name 2023-11-06 12:33:09 +08:00
Haojun Liao d41fd27189 fix(stream): restart tasks in stream threads, instead of write thread. 2023-11-06 11:57:21 +08:00
slzhou 88c8463e18 fix: process logic or conditions 2023-11-06 11:06:22 +08:00
Haojun Liao 0e44950a37 enh(stream): execute scan history by using time slice 1s. 2023-11-06 09:21:33 +08:00
Haojun Liao 1f756f58f6 fix(stream): add need update node into update node list. 2023-11-06 09:21:33 +08:00
Haojun Liao 680eb5674e refactor: do some internal refactor. 2023-11-06 09:15:49 +08:00
dapan1121 0c4040b48e
Merge pull request #23541 from taosdata/fix/TS-4219.3.0
fix: insert syntax error caused coredump
2023-11-06 08:48:46 +08:00
kailixu 7e8c123fca chore: rsma code optimization 2023-11-06 08:46:04 +08:00
dapan1121 faf7001828
Merge pull request #23532 from taosdata/szhou/continue-coing
enhance: insert into super table performance improvement
2023-11-06 08:43:33 +08:00
Haojun Liao d440da0d8c enh(stream): execute scan history by using time slice 1s. 2023-11-05 01:26:53 +08:00
Haojun Liao c71f6713a7 fix(stream): add need update node into update node list. 2023-11-05 01:24:23 +08:00
Haojun Liao e13f003b90 refactor: do some internal refactor. 2023-11-05 01:23:23 +08:00
kailixu 411151d671 fix: buffer overflow/buffer use after free/memory leak 2023-11-04 08:44:26 +08:00
yihaoDeng f038f88c07 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-03 18:29:18 +08:00
liuyao 7c38344642 adj builtin function 2023-11-03 17:53:36 +08:00
wangmm0220 5a6c3f2b04 fix:add windows support 2023-11-03 17:45:37 +08:00
dapan1121 6c4f94661b fix: insert syntax error caused core 2023-11-03 17:43:08 +08:00
Haojun Liao 3415ba5195
Merge pull request #23528 from taosdata/fix/liaohj
enh(tsdb): on-demand open stt file reader.
2023-11-03 17:29:55 +08:00
slzhou 9a33f0d59a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/3.0/fix/TD-27089 2023-11-03 16:51:53 +08:00
shenglian zhou 893f7cc080 enhance: prepare for or processing 2023-11-03 16:35:43 +08:00
wangjiaming0909 741f8b0083 fix: cast error msg 2023-11-03 16:31:28 +08:00
kailixu 77eadc59dc Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 16:26:07 +08:00
slzhou e1ea15c8f2 enhance: improve performance 2023-11-03 16:13:35 +08:00
liuyao e8945cedd8 fix issue 2023-11-03 16:03:23 +08:00
kailixu a48968e5e8 enh: rsma checkpoint 2023-11-03 14:33:45 +08:00
Shungang Li c6f5e2a9bd enh: add dynamic configuration 2023-11-03 14:28:02 +08:00
shenglian zhou 81af550763 Merge branch 'szhou/tbname-prune-vgroup' of github.com:taosdata/TDengine into szhou/tbname-prune-vgroup 2023-11-03 14:12:15 +08:00
shenglian zhou bab886b229 enhance: refact code 2023-11-03 14:12:04 +08:00
Haojun Liao 34403534ed Merge branch '3.0' into fix/3_liaohj 2023-11-03 14:06:58 +08:00
slzhou 75d542c758 fix: performance improvement 2023-11-03 14:03:25 +08:00
liuyao b1d1e2c778 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-03 14:02:59 +08:00
Benguang Zhao 2cf6b3c1e4 fix: release duplicate msgs in syncSnapBufferRecv 2023-11-03 14:01:39 +08:00
Haojun Liao 53b2158c54 refactor: do some internal refactor. 2023-11-03 13:51:17 +08:00
dapan1121 0af6f2fb0e
Merge pull request #23530 from taosdata/fix/TD-27080
fix: return error response while fetching in quick response mode
2023-11-03 13:43:03 +08:00
wade zhang 717ddf5107
Merge pull request #23501 from taosdata/FIX/TD-26596-3.0
fix: set ack of response properly in syncSnapSendRsp
2023-11-03 11:57:24 +08:00
wangmm0220 0a1f1085fc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-03 11:33:50 +08:00
wangmm0220 3ac11eba0e fix:modify upload checkpoint interface 2023-11-03 11:33:18 +08:00
dapan1121 bb48b457ca fix: return error response while fetching in quick response mode 2023-11-03 11:28:16 +08:00
yihaoDeng d82d51cf8f Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-03 10:40:00 +08:00
slzhou 52608cf84d fix: performace improvement 2023-11-03 10:38:43 +08:00
dapan1121 92240d7f95
Merge pull request #23505 from taosdata/fix/3.0/TS-4052
fix: nano seconds database error
2023-11-03 10:27:40 +08:00
shenglian zhou 55e8607206 fix: calc const optimization only when not tag scan 2023-11-03 10:17:23 +08:00
Benguang Zhao 456c8d23f3 fix: set cursor properly in syncSnapBufferRecv 2023-11-03 10:09:07 +08:00
yihaoDeng 24e961976f Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-03 09:31:57 +08:00
Haojun Liao 9d77351bb2 refactor: do some internal refactor. 2023-11-03 09:30:50 +08:00
yihaoDeng 069dd8de84 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-03 09:28:30 +08:00
liuyao 31ad73f6d1 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-03 09:12:17 +08:00
Haojun Liao ff5d69352f
Merge pull request #23493 from taosdata/fix/3_liaohj
fix(stream): add unsupport trans.
2023-11-03 09:07:33 +08:00
Haojun Liao 70388bafd2
Merge pull request #23523 from taosdata/fix/liaohj
fix(stream): fix deadlock in transfer state.
2023-11-03 09:07:23 +08:00
liuyao ba09b3de28 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-03 08:56:42 +08:00
kailixu d9ed63473c Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 08:37:41 +08:00
yihaoDeng 6ce878948f Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-02 20:44:36 +08:00
yihaoDeng 0a73832fd2 add checkpoint delta 2023-11-02 20:39:55 +08:00
kailixu 6c944bb192 enh: skip rsma_task during load stream tasks 2023-11-02 20:32:54 +08:00
wangmm0220 159873692c feat:checkpoint bakeup using rsync 2023-11-02 20:13:29 +08:00
Haojun Liao b3d57e4a2d fix(stream): not transfer state if state is not appropriate. 2023-11-02 19:31:35 +08:00
Haojun Liao 7a32b3a209 fix(stream): not transfer state if state is not appropriate. 2023-11-02 19:12:36 +08:00
Benguang Zhao ce4fb52926 enh: resend end msg on timeout in snapshotReSend 2023-11-02 18:56:00 +08:00
Benguang Zhao 995a1e1f8e enh: send rsp on duplicate msgs in syncSnapBufferRecv 2023-11-02 18:41:25 +08:00
Benguang Zhao 3221aef1a3 refact: improve code with syncSnapSendMsg 2023-11-02 18:41:25 +08:00
Benguang Zhao 7852b2cecf fix: set ack of response properly in syncSnapSendRsp 2023-11-02 18:41:25 +08:00
Haojun Liao 706f1e4744 fix(stream): fix deadlock in transfer state. 2023-11-02 18:18:04 +08:00
Haojun Liao 39175dc03b fix(stream): fix deadlock in transfer state. 2023-11-02 18:07:36 +08:00
liuyao 52083cd694 event window and partition by 2023-11-02 15:52:55 +08:00
kailixu 2d597659bc enh: rsma checkpoint 2023-11-02 15:20:54 +08:00
liuyao 330b04a8bc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-02 14:36:13 +08:00
dapan1121 be6a6976db fix: adjust view not exist log level 2023-11-02 14:34:19 +08:00
Haojun Liao f5fa3edeba
Merge pull request #23503 from taosdata/fix/liaohj
fix(stream): fix dead lock.
2023-11-02 13:52:50 +08:00
kailixu 76536e1c82 enh: rsma logic 2023-11-02 11:03:18 +08:00
Haojun Liao c48c801e19 fix(stream): return error code. 2023-11-02 11:02:40 +08:00
Haojun Liao 95efa07e92 fix(stream): add full unsupported event filtering. 2023-11-02 11:02:39 +08:00
Haojun Liao 05b3d51803 fix(stream): add qualified status in assert 2023-11-02 11:02:39 +08:00
Haojun Liao 420825c62f fix(stream): return error code. 2023-11-02 10:22:03 +08:00
yihaoDeng 7e7a39f077 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-02 10:15:34 +08:00
yihaoDeng b911492270 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-02 09:46:36 +08:00
kailixu 9649e87cab fix: rsma checkpoint 2023-11-02 09:44:43 +08:00
Haojun Liao 351a31302f fix(stream): add full unsupported event filtering. 2023-11-02 09:43:48 +08:00
wangjiaming0909 b71a013b8d fix: nano seconds database error 2023-11-02 09:36:46 +08:00
Haojun Liao e14d42c01e fix(stream): add qualified status in assert 2023-11-02 08:46:18 +08:00
Haojun Liao dc8a90c864 fix(stream): fix memory leak. 2023-11-02 08:13:11 +08:00
Haojun Liao 79e971385f fix(stream): fix memory leak. 2023-11-02 08:11:51 +08:00
Haojun Liao df7633650e fix(stream): fix memory leak. 2023-11-01 20:35:45 +08:00
Haojun Liao e1b3e00b3d fix(stream): fix memory leak. 2023-11-01 20:10:20 +08:00
kailixu 3803f952f9 chore: rsma checkpoint verify 2023-11-01 20:05:00 +08:00
Haojun Liao 6dc468c55f fix(stream): fix dead-lock 2023-11-01 19:38:13 +08:00
Haojun Liao fa7ebf63ea refactor: do some internal refactor. 2023-11-01 19:38:13 +08:00
Haojun Liao 9156e8449d fix(stream): fix deference null ptr. 2023-11-01 19:38:13 +08:00
Haojun Liao 7cf90dde5c refactor: do some internal refactor. 2023-11-01 19:38:13 +08:00
Haojun Liao 00f029e44f refactor: add some logs. 2023-11-01 19:38:12 +08:00
Haojun Liao 385e699cc2 fix(stream): do some internal refactor. 2023-11-01 19:38:12 +08:00
Haojun Liao bd12ae88e1 fix(stream):fix the bug when event in waiting list not fulfilled. 2023-11-01 19:38:12 +08:00
Haojun Liao 9a9c1d689d fix(stream): add lock log. 2023-11-01 19:38:12 +08:00
Haojun Liao e7609d8e56 fix(stream): fix dead-lock 2023-11-01 19:09:21 +08:00
Haojun Liao ae25f09c45 refactor: do some internal refactor. 2023-11-01 18:03:44 +08:00
Haojun Liao 899d13b4ae fix(stream): fix deference null ptr. 2023-11-01 17:25:59 +08:00
Haojun Liao 246ed4e022 refactor: do some internal refactor. 2023-11-01 17:19:21 +08:00
liuyao 505c44d9aa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-01 16:50:46 +08:00
kailixu c32e60d199 chore: more code for rsma checkpoint 2023-11-01 16:27:41 +08:00
Haojun Liao 12bc4f32cf refactor: add some logs. 2023-11-01 16:12:15 +08:00
yihaoDeng 4c8edb5545 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-01 16:07:49 +08:00
kailixu 59be62c96e chore: set stream input checkpoint 2023-11-01 15:34:17 +08:00
Haojun Liao a22c84617f
Merge pull request #23491 from taosdata/fix/ly_test
session window max delay
2023-11-01 15:31:46 +08:00
slzhou 4a2c52783b Merge branch '3.0' of github.com:taosdata/TDengine into szhou/insert-stb-tbname 2023-11-01 14:10:02 +08:00
Haojun Liao 778c29b808 fix(stream): do some internal refactor. 2023-11-01 14:07:18 +08:00
Haojun Liao e4aeea176b fix(stream):fix the bug when event in waiting list not fulfilled. 2023-11-01 13:59:51 +08:00
slzhou bd64b9102d fix: fix address sanitizer error 2023-11-01 13:25:54 +08:00
Haojun Liao 5ff89bc098 fix(stream): add lock log. 2023-11-01 13:19:53 +08:00
Haojun Liao 0cf0ff3bbf
Merge pull request #23455 from taosdata/fix/liaohj
refactor: do some internal refactor.
2023-11-01 12:01:54 +08:00
Haojun Liao 3f561fb8e4 fix(stream): remove invalid assert. 2023-11-01 11:43:02 +08:00
Haojun Liao 3e6c89d8eb fix(stream): add unsupport trans. 2023-11-01 11:43:02 +08:00
dapan1121 6305353290 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-11-01 10:38:50 +08:00
kailixu 1530fe0c49 Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-01 09:52:16 +08:00
liuyao e8aa1555ca session window max delay 2023-11-01 09:48:53 +08:00
kailixu ad1e6accd4 chore: build checkpoint for rsma 2023-11-01 09:45:58 +08:00
Haojun Liao 7359f98eca
Merge pull request #23428 from taosdata/fix/3_liaohj
other: merge refactor into 3.0
2023-11-01 09:44:31 +08:00
slzhou efb0c61cac fix: fix compilation error 2023-11-01 08:43:29 +08:00
shenglian zhou 42a7553fe0 enhance: refactor getStbRowValues 2023-11-01 08:35:38 +08:00
shenglian zhou 7636f09bfb enhance: refactor getStbRowValues 2023-11-01 08:32:31 +08:00
Haojun Liao 0fb4cfd94f fix(stream): remove invalid assert. 2023-11-01 00:33:17 +08:00
Haojun Liao 639d5cde47 fix(stream): add unsupport trans. 2023-10-31 23:14:02 +08:00
yihaoDeng bb8252df16 fix mem leak 2023-10-31 20:59:24 +08:00
dapan1121 701a148ad1 feat: init merge operator 2023-10-31 19:59:36 +08:00
Haojun Liao 294c59150c fix(stream): add jump out loop by checking task status. 2023-10-31 19:31:28 +08:00
Haojun Liao 4694859325 fix(stream): add jump out loop by checking task status. 2023-10-31 19:31:00 +08:00
dapan1121 91df56fcf0 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-31 18:44:54 +08:00
dapan1121 c9c8c01df9 fix: change error code to retry table meta 2023-10-31 18:39:39 +08:00
dapan1121 d40cc27abc
Merge pull request #23464 from taosdata/enh/TD-26638-3.0
enh: use placeholder '-' for interval of 1st retention level
2023-10-31 18:36:43 +08:00
slzhou 041ef1ef83 enhance: colvals of table data cxt is not used in insert stb syntax 2023-10-31 17:05:37 +08:00
Haojun Liao a1aa2380ae other: merge 3.0 2023-10-31 16:42:51 +08:00
Haojun Liao 0b18192b23 fix(stream): fix error in finishing event handling. 2023-10-31 16:40:16 +08:00
Haojun Liao 762cfef498 fix(stream): adjust the stop condition for stream tasks. 2023-10-31 16:40:16 +08:00
Haojun Liao 4c0242a58d fix(stream): fix error in finishing event handling. 2023-10-31 16:39:14 +08:00
kailixu 012d86d9a8 Merge branch '3.0' into enh/TD-23769-3.0x 2023-10-31 16:15:51 +08:00
dapan1121 c4e1faae36
Merge pull request #23432 from taosdata/szhou/bi-mode-tag-scan
enhance: bi mode tag scan
2023-10-31 15:44:53 +08:00
liuyao 696294c208 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-31 15:41:04 +08:00
liuyao b9e05ab1ec update data 2023-10-31 15:40:42 +08:00
wade zhang 76c9b9afc5
Merge pull request #23377 from taosdata/FIX/TD-26596-3.0
feat: support pipelining of snap replication
2023-10-31 15:19:07 +08:00
slzhou c8767f7614 enhance: tbname token optimization 2023-10-31 14:44:06 +08:00
slzhou 1686c70a60 fix: not use ctb meta from hash of stmt node 2023-10-31 13:14:21 +08:00
Haojun Liao 0ca85a4c03
Merge pull request #23424 from taosdata/refact/streamsm
refactor: do some internal refactor.
2023-10-31 12:48:22 +08:00
Haojun Liao e01c7f3cfd fix(stream): adjust the stop condition for stream tasks. 2023-10-31 11:51:47 +08:00
dapan1121 aabd2bd739 fix: create view table meta issue 2023-10-31 11:23:33 +08:00
Hongze Cheng 16bccef75a
Merge pull request #23407 from taosdata/feat/TS-4180
feat: alloc disk acorrding to avail disk space
2023-10-30 22:15:39 -05:00
shenglian zhou 45ae3727a7 fix: performace improvement 2023-10-31 10:48:10 +08:00
Haojun Liao 88469568b8 fix(stream): handle failure during checkpoint 2023-10-31 10:45:14 +08:00
Haojun Liao 635243f01a refactor: do some internal refactor. 2023-10-31 10:45:12 +08:00
Haojun Liao 0c982093cd fix(stream): enable the set of fill-history task to be un-init. 2023-10-31 10:45:12 +08:00
Haojun Liao 86dfc52a6e fix(stream): add event check when handling the end of event. 2023-10-31 10:45:12 +08:00
Haojun Liao 72f3e4446d fix(stream): handle failure during checkpoint 2023-10-31 10:38:17 +08:00
dapan1121 7d5708f224 fix: case issue and authentication issue 2023-10-31 09:15:40 +08:00
slzhou e800c993dd fix: set scan tags when bi mode 2023-10-31 07:37:56 +08:00
dapan1121 b2fea84a3a fix: case issue and bugs 2023-10-30 19:14:31 +08:00
yihaoDeng 7fad855247 fix mem leak 2023-10-30 18:16:12 +08:00
dapan1121 658ea7c429
Merge pull request #23426 from taosdata/fix/TD-26930/xsren/superTime
fix: interval more than 1000 years
2023-10-30 17:55:53 +08:00
liuyao 5b74bf87b1 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-30 17:55:14 +08:00
yihaoDeng ee6b620597 fix mem leak 2023-10-30 17:29:32 +08:00
kailixu da4fac4204 test: update test case for retentions 2023-10-30 17:04:09 +08:00
dapan1121 1517fe0ff0 fix: ut case issue 2023-10-30 16:44:10 +08:00
slzhou e9a7f6e322 fix: invalid schema error 2023-10-30 15:54:10 +08:00
Haojun Liao fdf3f210ac refactor: do some internal refactor. 2023-10-30 14:39:24 +08:00
kailixu 5e99b69512 Merge branch '3.0' into enh/TD-26638-3.0 2023-10-30 14:09:41 +08:00
dapan1121 0a97f18d72
Merge pull request #23344 from taosdata/feat/3.0/TS-4052
feat: support to_timestamp/to_char
2023-10-30 14:04:33 +08:00
kailixu c77153cb81 enh: use placeholder '-' for interval of 1st retention level 2023-10-30 14:02:31 +08:00
Haojun Liao b0700d6095 Merge branch '3.0' into fix/3_liaohj 2023-10-30 11:57:54 +08:00
Haojun Liao 93232a0e14 fix(stream): enable the set of fill-history task to be un-init. 2023-10-30 11:48:51 +08:00
liuyao 1a37f19c82 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-30 11:43:23 +08:00
dapan1121 6f0b634f95 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-30 10:24:16 +08:00
Haojun Liao 19c5882cbe fix(stream): add event check when handling the end of event. 2023-10-30 10:22:24 +08:00
Benguang Zhao 70e261f662 enh: terminate snap replication on timeout 2023-10-30 10:14:26 +08:00
slzhou 4b6f927e6a fix: add test case for bi tag scan 2023-10-30 10:11:57 +08:00
dapan1121 1b7a6bccdf
Merge pull request #23430 from taosdata/enh/TD-26641-3.0
enh: only float/double allowed for sum/avg of rsma
2023-10-30 10:08:55 +08:00
dapan1121 8650c5d4b0
Merge pull request #23392 from taosdata/feat/3.0/TS-4044
feat: support all utf8 characters as alias
2023-10-30 10:04:37 +08:00
facetosea 55f6d2b7a9 use TSDB_MAX_KEEP 2023-10-30 09:42:06 +08:00
Haojun Liao 980f6fc46e fix(stream): pause the task when they are still in uninit status. 2023-10-30 09:32:40 +08:00
Haojun Liao 1bbad532a7 fix(stream): add more check. 2023-10-30 09:32:40 +08:00
Haojun Liao 076b533ba3 fix(stream): fix race condition when state transferring. 2023-10-30 09:32:40 +08:00
Haojun Liao 85befa10b9 fix(stream): avoid clear the restart flag . 2023-10-30 09:32:39 +08:00
Haojun Liao f708ddb792 fix(stream): pause the task when they are still in uninit status. 2023-10-30 09:09:21 +08:00
dapan1121 972e10a238 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-30 08:45:29 +08:00
Haojun Liao 790d869494 fix(stream): add more check. 2023-10-29 22:57:33 +08:00
Haojun Liao 3c07c3ec2f fix(stream): fix race condition when state transferring. 2023-10-29 02:27:27 +08:00
Haojun Liao c7285c0ede fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:41:57 +08:00
Haojun Liao 4c267b538f fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:05:41 +08:00
dapan1121 9801d5d7b7 fix: desciribe view and memory issues 2023-10-27 19:28:22 +08:00
kailixu eae1b4eb03 chore: relationship between interval/keep 2023-10-27 19:15:23 +08:00
Benguang Zhao c3f9cae36b refact: improve code of syncNodeOnSnapshot 2023-10-27 18:55:30 +08:00
Benguang Zhao 4163a3be7c feat: resend snap replication of data on timeout 2023-10-27 17:58:26 +08:00
liuyao ad6d38439b refect 2023-10-27 17:47:25 +08:00
wangjiaming0909 cf158ab428 feat: support all utf8 characters as alias 2023-10-27 15:23:26 +08:00
slzhou 15aedb8d8c fix: fix bugs of pWhere is null 2023-10-27 15:16:40 +08:00
xsren b422c29d4e fix interval limit on us/ns db 2023-10-27 15:16:03 +08:00
kailixu ac72466429 chore: naming optimization 2023-10-27 15:11:35 +08:00
Haojun Liao 62cc33715c fix(stream): fix deadlock. 2023-10-27 15:05:36 +08:00
Haojun Liao 0c2079a963 fix(stream): fix deadlock. 2023-10-27 15:03:21 +08:00
shenglian zhou 1bda5a7223 enhance: use tbname cond to set vgroup list of table node 2023-10-27 14:47:56 +08:00
kailixu 4ea44c429d chore: code optimization 2023-10-27 14:41:17 +08:00
yihaoDeng ebdf6d1cc6 fix mem leak 2023-10-27 14:18:56 +08:00
Haojun Liao afe7fdf672 fix(stream): avoid clear the restart flag . 2023-10-27 14:12:06 +08:00
kailixu 2ad3b98344 chore: test case for rollup 2023-10-27 13:49:39 +08:00
Haojun Liao dcca6b0868 other: merge 3.0. 2023-10-27 11:41:28 +08:00
dapan1121 099f72e84a fix: memory issues 2023-10-27 11:36:17 +08:00
xsren 4186028083 fix: interval more than 1000 years 2023-10-27 11:09:18 +08:00
Haojun Liao 29b3a7a5e9 refactor: do some internal refactor. 2023-10-27 09:59:53 +08:00
Haojun Liao 9c9d02b181 fix(stream): disable follower nodes exec reset. 2023-10-27 09:59:52 +08:00
Haojun Liao 52d8e05c0c fix(stream): resolve the nodeUpdate msg compatible issue. 2023-10-27 09:59:52 +08:00
Haojun Liao 454624516c fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-27 09:59:51 +08:00
Haojun Liao 9c9cd08e2e fix(stream): not clear role flag. 2023-10-27 09:59:44 +08:00
Haojun Liao 33dc51cc86 fix(stream): add some logs. 2023-10-27 09:59:44 +08:00
Haojun Liao 1ccbb77981 fix(stream): fix dead lock when shutdown all tasks. 2023-10-27 09:59:37 +08:00
Haojun Liao 9a1a8feec2 fix(stream): do send check info if downstream is not leader. 2023-10-27 09:58:53 +08:00
Haojun Liao 2493c21ed3 fix(stream): fix the invalid write in sma 2023-10-27 09:58:52 +08:00
Haojun Liao e8520997b0 fix(stream): disable continue check for downstream tasks. 2023-10-27 09:58:52 +08:00
Haojun Liao 3bcffcf1da other: merge stream refactor from main. 2023-10-27 09:56:02 +08:00
Haojun Liao b0ef072556 fix(stream): clear flag for checkpoint. 2023-10-27 09:55:07 +08:00
Haojun Liao f682ad0479 refactor: do some internal refactor. 2023-10-27 09:55:06 +08:00
Haojun Liao efede8669f refactor: do some internal refactor. 2023-10-27 09:55:06 +08:00
Haojun Liao 9ebf806789 fix(stream): clear the flag. 2023-10-27 09:55:05 +08:00
Haojun Liao 48ff521968 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-27 09:55:02 +08:00
Haojun Liao 0d4892f25b fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:55:00 +08:00
Haojun Liao a31613ae95 refactor: add ref in log. 2023-10-27 09:54:59 +08:00
Haojun Liao 226b6596d6 fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:58 +08:00
Haojun Liao 091238e7be fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:58 +08:00
Haojun Liao e1f6043eed fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:57 +08:00
Haojun Liao e359da7b19 fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:57 +08:00
Haojun Liao 8729bdac1e fix(stream): fix bugs caused by refactor. 2023-10-27 09:54:57 +08:00
Haojun Liao 1eac7f44c0 fix(stream): fix error in stream. 2023-10-27 09:54:56 +08:00
Haojun Liao 579dd8e6b2 refactor(stream): do some internal refactor. 2023-10-27 09:54:56 +08:00
Haojun Liao 6f3c0d17cc refactor(stream): add state machine to manage the state of stream tasks. 2023-10-27 09:54:49 +08:00
Haojun Liao 596eb073b7 refactor(stream): do some internal refactor. 2023-10-27 09:54:48 +08:00
Haojun Liao 91e3fd66e6 enh(stream): sm for stream tasks. 2023-10-27 09:54:44 +08:00
Haojun Liao 2409a17517 refactor(stream): do some internal refactor. 2023-10-27 09:54:44 +08:00
wangjiaming0909 70850697a4 feat: support to_timestamp/to_char fix comments 2023-10-27 09:54:16 +08:00
Haojun Liao c9bdb56d79 refactor: do some internal refactor. 2023-10-27 09:54:09 +08:00
Haojun Liao 164159f293 enh(stream): add parameter to limit the stream sink task. 2023-10-27 09:54:07 +08:00
Haojun Liao 62c58ecd8b fix(stream):add more check for test cases. 2023-10-27 09:54:06 +08:00
Haojun Liao a4f6042966 fix(stream): fix error in creating update node trans. 2023-10-27 09:52:14 +08:00
Haojun Liao ffa798c4fa enh(stream): add some logs. 2023-10-27 09:52:14 +08:00
Haojun Liao f549ce3578 refactor: do some internal refactor. 2023-10-27 09:49:16 +08:00
Hongze Cheng dc03d8cd1a disable tfs unit test 2023-10-26 20:07:38 +08:00
yihaoDeng 7e1e68d8f5 fix stream case error 2023-10-26 18:27:09 +08:00
slzhou 779c37b425 enhance: change to invalid operation for stmt error 2023-10-26 14:23:21 +08:00
yihaoDeng 87db93e72e fix stream case error 2023-10-26 11:36:29 +08:00
kailixu 4097b53bfa enh: only float/double allowed for sum/avg of rsma 2023-10-26 11:21:56 +08:00
kailixu a83b3053f4 enh: check interval and keep for retentions 2023-10-25 22:52:03 +08:00
kailixu 64765579e9 enh: check interval and keep for retentions 2023-10-25 22:42:01 +08:00
Haojun Liao b974561a79
Merge pull request #23343 from taosdata/refact/streamsm
refactor(stream):  add fsm for managing task status.
2023-10-25 22:31:56 +08:00
liuyao d0e4a5d0f7 opt max delay 2023-10-25 20:29:25 +08:00
Benguang Zhao fe553352b8 enh: cache snap blocks sent in snapshotSend for resending 2023-10-25 20:26:11 +08:00
Hongze Cheng 25aade1333 feat: alloc disk acorrding to avail disk space 2023-10-25 19:44:21 +08:00
yihaoDeng db0f6258fe fix stream case error 2023-10-25 19:38:22 +08:00
liuyao f51c985914 stream event window 2023-10-25 17:50:16 +08:00
slzhou 5ca39f961c fix: add error test case and fix address sanitizer 2023-10-25 16:30:13 +08:00
Benguang Zhao ec5b1f2ec1 enh: logging buf info for snapshot reader and sender 2023-10-25 15:04:14 +08:00
Benguang Zhao 7d9d1c6877 enh: terminate snap replication on timeout 2023-10-25 14:50:53 +08:00
Haojun Liao f36b24ed24 fix(stream): disable follower nodes exec reset. 2023-10-25 14:16:36 +08:00
shenglian zhou 6edf954cd3 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/bi-mode-tag-scan 2023-10-25 13:54:58 +08:00
shenglian zhou 8b2d57504c enhance: bi mode default tag scan 2023-10-25 13:54:45 +08:00
slzhou efe480ae14 Merge branch 'szhou/continue-coing' into szhou/insert-stb-tbname 2023-10-25 13:30:49 +08:00
slzhou 04a9f5945f Merge branch '3.0' of github.com:taosdata/TDengine into szhou/insert-stb-tbname 2023-10-25 13:30:38 +08:00
slzhou 29db21a3ad fix: reinit ctb meta and col vals before each stb row 2023-10-25 11:22:15 +08:00
slzhou c17300557d fix: memory sanitizer error of simple insert stb 2023-10-25 10:56:28 +08:00
yihaoDeng 92017fe149 http handle empty packet 2023-10-25 10:52:08 +08:00
dapan1121 6dcc555bbc fix: view privilege issue 2023-10-25 10:47:01 +08:00
Haojun Liao 985371e841 fix(stream): resolve the nodeUpdate msg compatible issue. 2023-10-25 10:01:20 +08:00
slzhou f0a44b31fc fix: insert into super table syntax is not supported for stmt 2023-10-25 09:56:21 +08:00
Haojun Liao 03165d5327 fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-25 09:55:02 +08:00
shenglian zhou 3de5b841a5 fix: large file by batches 2023-10-25 09:35:37 +08:00
shenglian zhou c9d1553633 enhance: refactor stb rows data context 2023-10-25 09:06:45 +08:00
shenglian zhou a28b3a6e3f fix: refactor 2023-10-25 08:50:08 +08:00
shenglian zhou 0c33a3e60e fix: child table meta optimization 2023-10-25 08:27:02 +08:00
Haojun Liao 26aaa4a83c other: merge main. 2023-10-25 00:39:14 +08:00
Haojun Liao 5b42204dba fix(stream): not clear role flag. 2023-10-25 00:32:46 +08:00
Haojun Liao 13d979a2ee fix(stream): add some logs. 2023-10-25 00:03:46 +08:00
Benguang Zhao 4e3a8b893d enh: restore wal log from snapshot after finish 2023-10-24 20:03:48 +08:00
Benguang Zhao 374217ceff fixup: adjust a logging msg in syncNodeStartSnapshot 2023-10-24 19:29:09 +08:00
Benguang Zhao 95188ab8c3 enh: adjust some logging msgs for sync log replication mgr 2023-10-24 19:11:27 +08:00
Haojun Liao 8cde39eebd fix(stream): fix dead lock when shutdown all tasks. 2023-10-24 19:11:24 +08:00
Benguang Zhao 4d61e87c0f enh: add signature info in logging msgs of snap replication 2023-10-24 17:28:46 +08:00
shenglian zhou 27302f995b fix: add memory free 2023-10-24 16:23:03 +08:00
yihaoDeng d43b3b4a32 refactor stream backend 2023-10-24 16:17:54 +08:00
dapan1121 9bf8be1ab4
Merge pull request #23354 from taosdata/fix/3.0/TD-26779
fix: union all cast func resType check error
2023-10-24 16:11:50 +08:00
shenglian zhou ae1bac251a enhance: finished skeleton 2023-10-24 16:08:08 +08:00
yihaoDeng b3c54a0f06 refactor stream backend 2023-10-24 16:04:43 +08:00
Haojun Liao 6ffb5ee476 fix(stream): do send check info if downstream is not leader. 2023-10-24 15:49:50 +08:00
Benguang Zhao 811f1bbbea enh: tidy up logging msg in syncNodeOnSnapshotRsp 2023-10-24 15:47:47 +08:00
Haojun Liao f1498f8929 fix(stream): fix the invalid write in sma 2023-10-24 15:24:34 +08:00
Benguang Zhao 1c60e67a83 enh: send the END snap msg at last 2023-10-24 14:16:46 +08:00
yihaoDeng 95b0d4f083 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-10-24 13:40:47 +08:00
Haojun Liao 0f9328330b fix(stream): disable continue check for downstream tasks. 2023-10-24 11:56:36 +08:00
yihaoDeng d46cf878eb refactor stream backend 2023-10-24 11:53:52 +08:00
dapan1121 dbbceae061 fix: union all view issue 2023-10-24 11:29:04 +08:00
Benguang Zhao f444cd7a6d enh: log signature of snap sender/receiver while started or stopped 2023-10-24 11:11:11 +08:00
Haojun Liao 7a8b046a35 fix(sma): fix bugs in sma and do some internal refactor. 2023-10-24 09:40:38 +08:00
shenglian zhou 65cfc13703 fix: memory sanitizer error 2023-10-23 19:40:27 +08:00
wangjiaming0909 f299a28109 feat: support to_timestamp/to_char 2023-10-23 19:36:03 +08:00
Benguang Zhao e34da43e38 feat: support pipelining of snap replication 2023-10-23 19:32:44 +08:00
slzhou 0cfbcd7a13 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/continue-coing 2023-10-23 16:34:21 +08:00
shenglian zhou e713b7c22f enhance: insert stb skeleton development 2023-10-23 16:27:00 +08:00
yihaoDeng 09192acf96 fix mem leak 2023-10-23 10:20:57 +08:00
dapan1121 ab98f7623c Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-23 08:44:46 +08:00
shenglian zhou 5156c0d00c enhance: get tbname from one row for stb syntax 2023-10-22 15:14:50 +08:00
shenglian zhou 6488672dd6 enhance: parse target column 2023-10-22 11:21:36 +08:00
Haojun Liao 059e94e428 fix(stream): clear flag for checkpoint. 2023-10-22 01:25:00 +08:00
Haojun Liao 4826b34a2b refactor: do some internal refactor. 2023-10-21 16:32:44 +08:00
Haojun Liao 06cd67e26e refactor: do some internal refactor. 2023-10-21 16:20:03 +08:00
shenglian zhou 438a775c78 fix: parse insert stb columns when meta is ready or ready after get meta 2023-10-21 14:02:03 +08:00
Haojun Liao 21e98e358e fix(stream): clear the flag. 2023-10-21 02:41:03 +08:00
Haojun Liao d1095e2c4c Merge remote-tracking branch 'origin/refact/streamsm' into refact/streamsm 2023-10-21 01:42:59 +08:00
Haojun Liao 49014d4b68 fix(stream): update the nodeEp even during checkpoint trans. 2023-10-21 01:42:43 +08:00
yihaoDeng aaf7e070ee Merge branch 'refact/streamsm' of https://github.com/taosdata/TDengine into refact/streamsm 2023-10-20 20:49:17 +08:00
yihaoDeng e95735eea4 fix mem leak 2023-10-20 20:49:01 +08:00
dapan1121 0f4766e38e feat: add view cases 2023-10-20 18:22:30 +08:00
slzhou 3fe5c447e7 enhance: begin parse cols 2023-10-20 17:16:45 +08:00
Haojun Liao c68c0eda79 fix(stream): fix bugs caused by refactor sm. 2023-10-20 16:27:39 +08:00
Haojun Liao 4feebffb05 refactor: add ref in log. 2023-10-20 15:59:43 +08:00
Haojun Liao c4268ca395 fix(stream): fix bugs caused by refactor. 2023-10-20 15:54:30 +08:00
yihaoDeng 1c3c58062d Merge branch 'enh/new3.0' into enh/refactorBackend 2023-10-20 15:40:47 +08:00
yihaoDeng 1a4cfd11a5 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-10-20 15:28:10 +08:00
dapan1121 1ff5ccf186
Merge pull request #23222 from taosdata/feat/TS-4072
feat: support interval syntax of quoted duration and default unit
2023-10-20 15:16:07 +08:00
dapan1121 d7a5b529f9
Merge pull request #23312 from taosdata/szhou/fix/td-26778
fix: remove subquery user alias name distinct check
2023-10-20 15:15:01 +08:00
slzhou ce6be3d3e7 fix: refactor checkAuth for target table 2023-10-20 14:51:44 +08:00
Haojun Liao 3b8c85f632 fix(stream): fix bugs caused by refactor sm. 2023-10-20 14:19:57 +08:00
Haojun Liao d75948160d Merge branch 'main' into refact/streamsm 2023-10-20 11:10:19 +08:00
wangjiaming0909 720982374c fix: union all cast func resType check error 2023-10-20 10:36:52 +08:00
Haojun Liao 270a847809 fix(stream): fix bugs caused by refactor sm. 2023-10-20 10:23:48 +08:00
Haojun Liao 9f9fae3b99
Merge pull request #23329 from taosdata/opt/addStatusSend
Opt/add status send
2023-10-20 09:52:12 +08:00
wade zhang 628667f22c
Merge pull request #23231 from taosdata/FEAT/TS-3816-3.0
feat: support restoring vnodes on replaced disks as needed
2023-10-20 09:02:25 +08:00
dapan1121 42f440b0fb Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-20 08:46:32 +08:00
dapan1121 969b002936 enh: support view privilege 2023-10-20 08:41:49 +08:00
Haojun Liao 4d5d078fbe fix(stream): fix bugs caused by refactor. 2023-10-19 18:00:54 +08:00
Haojun Liao d5059826a8 fix(stream): fix bugs caused by refactor. 2023-10-19 17:59:04 +08:00
Haojun Liao c1cebae6ba fix(stream): fix error in stream. 2023-10-19 16:20:27 +08:00
slzhou 332268fd4b set super table name for stb syntax and rename setRefreshMate to setRefreshMeta 2023-10-19 15:55:24 +08:00
wangjiaming0909 04c60486e9 feat: support interval syntax of quoted duration and default unit 2023-10-19 15:46:19 +08:00
Haojun Liao 614bdd9fb9
Merge pull request #23220 from taosdata/feat/TD-26644
opt bloom filter
2023-10-19 15:34:43 +08:00