Commit Graph

4185 Commits

Author SHA1 Message Date
Haojun Liao fc16d26da2
Merge pull request #24488 from taosdata/fix/3_liaohj
fix(stream): fix some errors and do some internal refactor.
2024-01-17 14:25:32 +08:00
54liuyao 3bbfb26e09 stream count window 2024-01-17 14:22:19 +08:00
kailixu bf0205b54d Merge branch '3.0' into feat/TD-27463-3.0 2024-01-17 11:29:47 +08:00
wade zhang e908679a32
Merge pull request #24484 from taosdata/fix/fixInvalidReadOnQuery
fix invalid read write
2024-01-17 10:23:46 +08:00
Haojun Liao 3d98fc6a67 other: merge 3.0 2024-01-16 18:29:33 +08:00
Haojun Liao 8ede6d87ce refactor: do some internal refactor. 2024-01-16 15:40:40 +08:00
jiajingbin d59ede5196 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28032 2024-01-16 15:05:13 +08:00
Haojun Liao 80793c94c2 fix(stream): reset the tasks status before start all tasks, and do some other internal refactor. 2024-01-16 14:32:45 +08:00
Yihao Deng 6f8f47a375 fix invalid read write 2024-01-16 05:50:20 +00:00
Haojun Liao dfe959eb28
Merge pull request #24468 from taosdata/fix/3_liaohj
fix(stream): fix deadlock in pause.
2024-01-16 12:58:27 +08:00
Haojun Liao 63494de7f9 refactor: do some internal refactor. 2024-01-16 10:28:07 +08:00
dapan1121 2fef37a5cc
Merge pull request #24315 from taosdata/fix/xsren/TD-28068/columnNodeRef2
fix: columanRefNode illegal type conversion
2024-01-16 10:08:34 +08:00
dapan1121 53094f62d8
Merge pull request #24359 from taosdata/FIX/TD-27003
Fix : use last row scan when select last_row, last
2024-01-16 08:50:23 +08:00
shenglian zhou 9c9d9dc24b fix: add input ignore group 2024-01-16 08:13:47 +08:00
wangmm0220 2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
Haojun Liao 43081b540b fix(stream): reset restart counter to be 0 if all tasks are ready. 2024-01-15 16:16:28 +08:00
fullhonest cb2ab749b5 Fix TD-27003: use last row scan when select last_row, last 2024-01-15 15:22:29 +08:00
Haojun Liao 143e6a13af fix(stream): fix deadlock in pause. 2024-01-15 14:37:24 +08:00
shenglian zhou 8ae3aa24be fix: set ignore input group id 2024-01-15 11:58:29 +08:00
Haojun Liao e012bc4bde refactor: do some internal refactor. 2024-01-15 11:28:36 +08:00
Haojun Liao c710718f9e
Merge pull request #24457 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-15 10:58:45 +08:00
kailixu 414e15a810 chore: merge 3.0 2024-01-15 10:42:45 +08:00
dapan1121 737140a09b
Merge pull request #24430 from taosdata/feat/TD-28267
add PARTITION_FIRST hint to use partition node before agg
2024-01-15 09:12:34 +08:00
Haojun Liao 00e2bdec23 refactor: do some internal refactor. 2024-01-12 19:08:46 +08:00
dapan1121 dec6e3fffe enh: support asof join 2024-01-12 18:29:27 +08:00
wangjiaming0909 bc1eacf626 add PARTITION_BEFORE_GROUP hint to use partition node before agg 2024-01-12 17:41:34 +08:00
54liuyao 52d8811bdc code coverage 2024-01-12 13:49:32 +08:00
Haojun Liao b36cc97236 fix(stream): close the inputQ of the related stream task when the fill-history task recv the trans-state msg from upstream. 2024-01-12 10:44:49 +08:00
kailixu ddefc5f46a chore: merge 3.0 2024-01-11 20:05:23 +08:00
dapan1121 8d1f5ff479 enh: add asof 2024-01-11 19:25:12 +08:00
Haojun Liao 58694c67dd refactor: do some internal refactor. 2024-01-11 11:50:52 +08:00
factosea c8fb8486ef fix: SColumnRefNode disable 2024-01-10 19:07:21 +08:00
dapan1121 e784a5c210 Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2024-01-10 18:57:19 +08:00
Haojun Liao 9d0d0d9ddc Merge branch '3.0' into fix/3_liaohj 2024-01-10 09:57:46 +08:00
factosea d243308541 fix: colref 2024-01-10 09:04:40 +08:00
Haojun Liao af9dc441b2 fix(stream): reset the saved value for fill-history task. 2024-01-08 18:40:06 +08:00
Yihao Deng 1eee7b44e0 fix crash found on 3.1 2024-01-08 07:31:35 +00:00
Haojun Liao 02f6c971fd fix(stream): check for not ready task when rsp returned. 2024-01-06 19:43:39 +08:00
Haojun Liao 0c4b91dc72 enh(stream): start task async. 2024-01-05 17:55:39 +08:00
Haojun Liao 1912de9b49 enh(stream): scan wal by using timer to trigger it. 2024-01-05 14:49:33 +08:00
Haojun Liao fa9df2a495 refactor: do some internal refactor. 2024-01-04 18:48:19 +08:00
dm chen 39f2e75a9e
Merge branch '3.0' into feat/TD-26529-3.0 2024-01-04 15:46:23 +08:00
Hongze Cheng 13834802ef
Merge pull request #24269 from taosdata/FIX/TD-28101-3.0
enh: send rsp msg on rejecting snap replication due to smaller term
2024-01-04 10:15:09 +08:00
dapan1121 670317ccd7
Merge pull request #24053 from taosdata/enh/3.0/TD-26813
enh: support group by tag/tbname to list empty groups
2024-01-04 09:08:03 +08:00
factosea b6b2a41d83 fix: columnrefnode 2024-01-03 18:30:57 +08:00
Haojun Liao 185fa75376 enh(stream): add task into timer to be idle during exec when the corresponding output queue is full. 2024-01-03 17:59:42 +08:00
dapan1121 8d9c093b99 Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2024-01-03 16:26:17 +08:00
factosea 34e62d7fc0 fix: columanRefNode illegal type conversion 2024-01-02 20:22:15 +08:00
wangmm0220 8add4dc177 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-02 18:37:29 +08:00
Haojun Liao 2387d5bade refactor: do some internal refactor. 2024-01-02 17:10:12 +08:00
Benguang Zhao 2526df745e enh: adjust threshold of snap replication timeout 2023-12-28 17:15:09 +08:00
dapan1121 194b1f03ae enh: support inner join 2023-12-26 19:28:19 +08:00
Haojun Liao 62cfcefbb0 refactor: remove stream-scan-history event for stream task. 2023-12-26 00:34:04 +08:00
Bob Liu baee536cb0 adjust 2023-12-25 11:54:23 +08:00
dapan1121 e570fcef99 Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2023-12-25 09:22:01 +08:00
Haojun Liao 0877e0bfad other: merge 3.0 2023-12-25 09:13:31 +08:00
Bob Liu c9b69316c1 calcNeedCountEmpty 2023-12-24 01:19:16 +08:00
wangmm0220 eac86f72b3 fix:partical func parameters for middle interval[checkStreamSTable1.sim] 2023-12-22 18:30:22 +08:00
Bob Liu e3098accc4 support count empty table 2023-12-22 18:14:26 +08:00
Haojun Liao b175a4b7b3 refactor(stream): async stop tasks, and do some internal refactor. 2023-12-22 17:56:16 +08:00
Haojun Liao 7ce545bcd4 refactor: refactor the lock type. 2023-12-22 16:14:49 +08:00
Haojun Liao e91afa7df2 fix(stream): fix deadlock. 2023-12-22 14:51:04 +08:00
kailixu 3005ab1953 chore: more code 2023-12-21 19:45:09 +08:00
Haojun Liao 84583580e2 fix(stream): transfer the checkpoint trans id. 2023-12-21 19:12:49 +08:00
Haojun Liao 2acc8423c5 fix(stream): send msg to mnode before closing all tasks. 2023-12-21 16:00:50 +08:00
Alex Duan 1fa6cb8f69 coverage: isRowEntryCompleted had been called 5200w hits 2023-12-21 15:10:21 +08:00
wangmm0220 de8ce3f7ec fix:send stream retrieve msg to source task 2023-12-20 16:01:17 +08:00
Haojun Liao d25a323a4c fix(stream): record the launch failure. 2023-12-20 13:55:12 +08:00
Haojun Liao 17e9e84aa9 Merge branch '3.0' into fix/3_liaohj 2023-12-19 16:43:08 +08:00
dapan1121 bc38885856 Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2023-12-19 11:22:41 +08:00
dapan1121 279b2aa10a enh: add join ut 2023-12-19 11:17:39 +08:00
Haojun Liao ec3183b6a8 other: merge 3.0 2023-12-18 23:16:37 +08:00
Haojun Liao bba5a4f08b other: merge main into 3.0 2023-12-18 18:26:42 +08:00
Haojun Liao ea6e78cbaa fix(stream): add async call restart, instead of sync wait. 2023-12-18 16:33:44 +08:00
Haojun Liao 79672f8e5f
Merge pull request #24107 from taosdata/fix/3_liaohj
fix(stream): add check for null ptr and leader .
2023-12-18 16:24:07 +08:00
WANG MINGMING 6f23b63d9e
Merge branch '3.0' into feat/ly_multi_marks 2023-12-18 16:22:56 +08:00
kailixu 9fa90fc953 Merge branch '3.0' into feat/TD-27463-3.0 2023-12-18 14:20:10 +08:00
kailixu b54f816c2a feat: support uniq grant 2023-12-18 14:18:52 +08:00
Haojun Liao f2bba670d8 fix(stream): remove unused attribution. 2023-12-18 11:26:49 +08:00
Haojun Liao 1a9701d401
Merge pull request #23946 from taosdata/fix/snodeBackendCrash
Fix/snode backend crash
2023-12-16 13:13:28 +08:00
slzhou 8a6317b76a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fix-tms-duration 2023-12-15 22:09:43 +08:00
yihaoDeng 7ab7a64eb3 Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 18:16:14 +08:00
shenglian zhou cc4a6c6d55 fix: add new duration block event 2023-12-15 15:04:47 +08:00
dm chen 81767dfa32
Merge branch '3.0' into feat/TS-4229 2023-12-14 17:02:51 +08:00
dapan1121 6d24c08651 fix: compile errors 2023-12-14 14:13:01 +08:00
Haojun Liao 05ca8f1784
Merge pull request #24056 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-12-14 13:52:04 +08:00
Haojun Liao 239b2d4f00 refactor: do some internal refactor. 2023-12-14 09:51:27 +08:00
Haojun Liao 81f96603b0 refactor: do some internal refactor. 2023-12-14 09:33:51 +08:00
dapan1121 7171d38415 Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2023-12-14 09:02:00 +08:00
wade zhang 484614da47
Merge pull request #24040 from taosdata/ENH/TD-27833-3.0
enh: clean wal logs based on size if one follower is offline.
2023-12-13 18:19:57 +08:00
Benguang Zhao c74c4fe208 enh: clean WAL logs based on size if one follower is offline. 2023-12-13 10:10:02 +08:00
dapan1121 13ab89bd1b Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2023-12-13 08:25:25 +08:00
dmchen daa2c2238a fix/TS-4251 2023-12-12 12:17:49 +08:00
slzhou 2743228217 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4229 2023-12-11 14:15:17 +08:00
Haojun Liao 39ea7d7567
Merge pull request #23980 from taosdata/fix/3_liaohj
fix(tsdb): opt read stt file
2023-12-09 21:28:52 +08:00
wangmm0220 d1c2a03dc7 fix:conflicts from 3.0 2023-12-08 15:58:52 +08:00
wade zhang 638e4c1f00
Merge pull request #23568 from taosdata/FEAT/TD-27125-3.0
feat: support tsdb snap replication of raw data mode
2023-12-08 14:36:16 +08:00
Haojun Liao 4ffaff4d50 other: merge 3.0 2023-12-08 10:14:42 +08:00
Haojun Liao 7c17d6f313 fix(tsdb): opt read performance by check clean stt block if only row number required. 2023-12-07 23:12:54 +08:00
Benguang Zhao 1a9b08fa08 refact: relocate func syncSnapInfoDataRealloc 2023-12-07 15:28:14 +08:00
Hongze Cheng 04e84ba152 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4229 2023-12-06 16:43:00 +08:00
dmchen dc9408ed5f fix/TS-4251 2023-12-06 07:48:40 +00:00
shenglian zhou ac531c6d7f enhance: add fileset delimited front end 2023-12-06 10:45:12 +08:00
shenglian zhou a2e7c78d27 refactor: rename variables 2023-12-06 09:39:38 +08:00
dapan1121 ee03cbc404 Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2023-12-06 08:38:30 +08:00
yihaoDeng a82856dff7 fix mem leak 2023-12-05 20:28:12 +08:00
wangmm0220 fc9dfc77d0 fix:add plan for multi agg operator in stream 2023-12-05 20:07:20 +08:00
yihaoDeng 87c78919a9 add stream backend copy 2023-12-05 17:09:03 +08:00
slzhou e690076331 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms-duration 2023-12-05 09:53:29 +08:00
54liuyao 38900d672e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-12-04 09:12:53 +08:00
Haojun Liao 48af3a9559
Merge pull request #23909 from taosdata/fix/TD-27455
fix:[TD-27644]heartbeat closed before snode close leading to snode is…
2023-12-04 09:10:00 +08:00
dapan1121 4700ebafd1 Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2023-12-04 08:31:41 +08:00
dapan1121 f5aaa92a7e enh: merge join 2023-12-01 18:33:50 +08:00
wangmm0220 f06117dbc9 fix:[TD-27644]heartbeat closed before snode close leading to snode is hanged 2023-12-01 17:32:29 +08:00
shenglian zhou bff88e0639 fix: set duration order api 2023-12-01 16:27:36 +08:00
Haojun Liao d7a19a9179 fix(stream): fix invalid decode hbmsg and memory leaks caused by invalid hb msg. 2023-12-01 14:45:18 +08:00
slzhou 4d755562af fix: resolve conflicts 2023-12-01 13:02:14 +08:00
Haojun Liao eac3cbf564 fix(stream): merge 3.0 2023-12-01 11:12:57 +08:00
Haojun Liao e753d631af fix(stream): make sure open operator only once for scan-history task. 2023-12-01 10:21:07 +08:00
Haojun Liao 8515a2f9b6 fix(stream): fix status check for stream-scan-history status when drop stream task msg is missing. 2023-12-01 10:19:18 +08:00
Haojun Liao eb2f5ad074 fix(stream): fix error. 2023-12-01 10:18:22 +08:00
Haojun Liao 2b03d64850 fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-12-01 10:18:15 +08:00
Haojun Liao fee9d751d4 fix(stream): fix the race condition in dispatching data. 2023-12-01 10:17:14 +08:00
dapan1121 3b4a8f6ead Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2023-12-01 08:33:04 +08:00
dapan1121 a09b9ac240 enh: push down conditions 2023-11-30 20:09:49 +08:00
Haojun Liao 30d78c6be1 fix(stream): make sure open operator only once for scan-history task. 2023-11-30 16:10:09 +08:00
54liuyao 271311a770 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-11-30 14:33:48 +08:00
dapan1121 215dbeaa3d
Merge pull request #23882 from taosdata/revert/TD-27277
revert nodes func
2023-11-30 14:10:44 +08:00
Bob Liu d5989b0f74 revert nodes func 2023-11-30 11:56:33 +08:00
yihaoDeng 5c32680cd8 Merge branch '3.0' into enh/refactorBackend 2023-11-30 10:31:27 +08:00
dapan1121 0d04dc296e
Merge pull request #23843 from taosdata/fix3.0/TS-4272
fix crash when insert big csv
2023-11-30 10:01:09 +08:00
Haojun Liao 130614c938
Merge pull request #23831 from taosdata/fix/3_liaohj
enh(stream/tsdb): do multiple optimization and fix some bugs.
2023-11-30 09:20:15 +08:00
dapan1121 abdf6d337a enh: push down conditions 2023-11-29 20:06:30 +08:00
Bob Liu 084a0b1a65 Merge branch '3.0' into fix3.0/TS-4272 2023-11-29 15:46:20 +08:00
dapan1121 72e04d4f6c
Merge pull request #23670 from taosdata/style/3.0/TD-27277
rewrite nodesNodeName
2023-11-29 13:29:19 +08:00
54liuyao ae386c6e34 opt expired data 2023-11-29 11:16:56 +08:00
Bob Liu 5c5efa34eb fix crash when insert big csv 2023-11-29 01:53:13 +08:00
slzhou 4fb0f83f07 fix: core dump without resetTableListIndex 2023-11-28 14:50:50 +08:00
dapan1121 75881e0f7c Merge remote-tracking branch 'origin/3.0' into feat/TD-27337 2023-11-28 14:37:15 +08:00
dapan1121 84cc80be1c fix: add window_offset translate 2023-11-28 14:35:11 +08:00
yihaoDeng 08eeee0794 Merge branch '3.0' into enh/refactorBackend 2023-11-28 11:52:49 +08:00
shenglian zhou df4f7d6956 Revert "Revert "enhance: duration notification""
This reverts commit 3331e25aaf.
2023-11-28 10:31:18 +08:00
shenglian zhou 3331e25aaf Revert "enhance: duration notification"
This reverts commit 9dd306e1ef.
2023-11-28 08:29:05 +08:00
yihaoDeng a4d475b582 fix rsma 2023-11-27 20:27:53 +08:00
dapan1121 19752b020f feat: support more join type 2023-11-27 20:01:00 +08:00
wangmm0220 06e2fbfb1c fix:conflicts from 3.0 2023-11-27 17:53:53 +08:00
wangmm0220 70c5d36103 opti:extract common logic from snode & vnode to tqCommon 2023-11-27 17:49:09 +08:00
yihaoDeng e9bec34c44 Merge branch '3.0' into enh/refactorBackend 2023-11-27 10:01:12 +08:00
Haojun Liao f28cf740b0 fix(stream): fix status check for stream-scan-history status when drop stream task msg is missing. 2023-11-24 14:44:00 +08:00
wangmm0220 d249892b2a fix:conflicts from 3.0 2023-11-23 20:29:46 +08:00
yihaoDeng 6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
Haojun Liao de4cc2009d fix(stream): fix error. 2023-11-23 16:04:06 +08:00
Haojun Liao 0a90c33b4d fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-11-23 15:49:07 +08:00
slzhou c53bd04894 feat: after select compacts 2023-11-23 15:26:21 +08:00
yihaoDeng 6a0501967d Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-23 14:06:04 +08:00
Haojun Liao 8ad071e69a other: merge main. 2023-11-23 10:25:51 +08:00
Haojun Liao 7b1f586d4f
Merge pull request #23762 from taosdata/fix/3_liaohj
fix(stream): fix error in generating token in bucket.
2023-11-23 09:32:14 +08:00
wangmm0220 15d75a0497 fix:spelling errors 2023-11-23 09:17:54 +08:00
Haojun Liao 4ea49fe285 fix(stream): fix the race condition in dispatching data. 2023-11-22 23:49:16 +08:00
Haojun Liao b35c971278 fix(stream):remove unused function. 2023-11-22 17:29:19 +08:00
wangmm0220 9a09e318ca opti:common message process logic in vnode and snode 2023-11-22 16:53:33 +08:00
Haojun Liao 91e7000433 Merge branch 'enh/refactorBackend' of github.com:taosdata/tdengine into enh/refactorBackend 2023-11-22 15:29:31 +08:00
Haojun Liao c96f7cf182 fix(stream): scheduler the checkpoint generating. 2023-11-22 15:17:21 +08:00
shenglian zhou 9dd306e1ef enhance: duration notification 2023-11-22 13:56:16 +08:00
yihaoDeng 0eba15b4a4 Merge branch '3.0' into enh/refactorBackend 2023-11-22 10:57:41 +08:00
yihaoDeng 0c0d9cdd2c Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-22 10:42:30 +08:00
Haojun Liao b712f5e7dc refactor: do some internal refactor. 2023-11-22 08:41:17 +08:00
Haojun Liao 785d91c17b
Merge pull request #23661 from taosdata/feat/TD-26060
fix: errors in snode in conditions like fill history/checkpoint/restart
2023-11-21 19:02:38 +08:00
yihaoDeng a92602b667 fix mem leak 2023-11-21 15:23:28 +08:00
Benguang Zhao 42fa8e818b enh: adjust timeout threshold of snapshot replication 2023-11-20 20:28:34 +08:00
Bob Liu 6e1e4702a5 adjust 2023-11-20 11:13:09 +08:00
Bob Liu e453962271 rewrite nodes function 2023-11-19 16:31:47 +08:00
Haojun Liao 1b4f187ded
Merge pull request #23743 from taosdata/fix/pause_stream
fix(stream): remove invalid assert
2023-11-17 23:48:47 +08:00
Haojun Liao 709502ba9e fix(stream): record the check downstream failure. 2023-11-17 22:05:36 +08:00
yihaoDeng 20de2f3cb5 Merge branch '3.0' into enh/refactorBackend 2023-11-17 17:15:14 +08:00
wangmm0220 a5de1b032b fix:snode upport stream task 2023-11-16 21:19:58 +08:00
slzhou 88819ea608 fix: tranform SCompactRsp to a datablock 2023-11-16 14:40:54 +08:00
slzhou 9ad86d7753 commit: add create show stmt support 2023-11-16 11:41:02 +08:00
yihaoDeng 77261068e0 fix stream backend convert 2023-11-16 11:06:55 +08:00
Haojun Liao f45c3277c3
Merge pull request #23710 from taosdata/fix/3_liaohj
fix(stream): check the status before pause
2023-11-15 22:06:56 +08:00
dapan1121 dc71252096 Merge remote-tracking branch 'origin/3.0' into merge/32m 2023-11-15 19:43:19 +08:00
wangmm0220 a16189d2a9 fix:confilct from 3.0 2023-11-15 19:14:27 +08:00
Haojun Liao 6529e56020 fix(stream): check the status before pause 2023-11-15 18:06:16 +08:00
Haojun Liao 115246c877 fix(stream): check the status before pause 2023-11-15 16:46:09 +08:00
Haojun Liao 9d2256ec9c refactor: do some internal refactor. 2023-11-15 16:03:23 +08:00
Haojun Liao 1b1ad3068d fix(stream): check node status before start pause trans. 2023-11-15 16:02:56 +08:00
Haojun Liao 2ca663ce66
Merge pull request #23593 from taosdata/feat/TD-21898
stream event window
2023-11-15 14:18:07 +08:00
yihaoDeng f4d6cf7c74 Merge branch '3.0' into enh/refactorBackend 2023-11-14 18:12:48 +08:00
Haojun Liao 436c7871a3
Merge pull request #23673 from taosdata/fix/3_liaohj
fix(stream): fix deadlock and do some internal refactor.
2023-11-14 11:26:54 +08:00
Haojun Liao e46a13c788
Merge pull request #23669 from taosdata/enh/stream_delay
opt max delay
2023-11-14 09:31:17 +08:00
Haojun Liao f99e22b91f fix(stream): fix deadlock. 2023-11-13 23:56:42 +08:00
Bob Liu 82ad690eb4 rewrite nodesNodeName 2023-11-13 20:20:45 +08:00
wangmm0220 56381dea90 fix:conflict from 3.0 2023-11-13 18:42:59 +08:00
wangmm0220 1cbe568be7 fix:add logic when snode restart 2023-11-13 18:39:42 +08:00
Haojun Liao aad8a2eb87 fix(stream): fix deadlock. 2023-11-13 18:20:30 +08:00
liuyao 37c102a115 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-13 16:06:17 +08:00
yihaoDeng de7f2a2d1a Merge branch '3.0' into enh/refactorBackend 2023-11-13 11:11:28 +08:00
dapan1121 fd16b31b4e
Merge pull request #23622 from taosdata/feat/TD-24802
enh: optimize cache last and other functions performance
2023-11-12 17:21:20 +08:00
Haojun Liao 9ee9174608 other: merge 3.0 2023-11-11 15:48:31 +08:00
Haojun Liao 5fcef5bd89 refactor:add some logs. 2023-11-11 15:40:32 +08:00
Haojun Liao 97772e9aab fix(stream): the checkpoint version can only be updated when generating checkpoint. 2023-11-11 15:40:05 +08:00
Haojun Liao 0b36081158 refactor:add some logs. 2023-11-10 14:36:18 +08:00
wangmm0220 8a05bad899 fix:snode error 2023-11-10 14:14:22 +08:00
dapan1121 350fac01a0 Merge remote-tracking branch 'origin/3.0' into feat/TD-24802 2023-11-10 11:48:55 +08:00
liuyao 6d2d5823dc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-10 09:24:05 +08:00
yihaoDeng 3e2314b09b Merge branch '3.0' into enh/refactorBackend 2023-11-10 09:22:16 +08:00
yihaoDeng 5f9b922a04 support s3 2023-11-09 20:15:08 +08:00
dapan1121 4f67629ea1
Merge pull request #23621 from taosdata/fix/TS-4122
correct colid in blockinfo
2023-11-09 18:09:09 +08:00
yihaoDeng 757425bff8 Merge branch '3.0' into enh/refactorBackend 2023-11-09 17:58:49 +08:00
Haojun Liao 13c6d1b23a fix(stream): the checkpoint version can only be updated when generating checkpoint. 2023-11-09 17:11:37 +08:00
wangjiaming0909 a6600ab23a correct colid in blockinfo 2023-11-09 15:41:01 +08:00
dapan1121 38196f37b9 Merge remote-tracking branch 'origin/3.0' into feat/TD-24802 2023-11-08 18:48:13 +08:00
dapan1121 49ebb7145e enh: support split cache last and other functions 2023-11-08 18:42:41 +08:00
yihaoDeng 3abf0ae4b2 Merge branch 'feat/TD-26060' into enh/refactorBackend 2023-11-08 17:31:16 +08:00
Haojun Liao 470f244032 Merge remote-tracking branch 'origin/enh/refactorBackend' into enh/refactorBackend
# Conflicts:
#	include/libs/stream/tstream.h
2023-11-08 15:21:21 +08:00
Haojun Liao 99dbbe61d7 refactor(stream): do some internal refactor. 2023-11-08 15:20:47 +08:00
facetosea ab12d110c0 delete unused variable 2023-11-08 14:28:37 +08:00
liuyao 340fb3e727 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-08 14:16:59 +08:00
yihaoDeng 7b0891981e merge 3.0 2023-11-08 14:14:01 +08:00
xinsheng Ren 96a3c373e0
Merge branch '3.0' into feat/TD-26529-3.0 2023-11-08 09:28:27 +08:00
facetosea 0a16b75831 monitor client 2023-11-08 09:18:22 +08:00
kailixu b9f389a49f Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-08 08:36:35 +08:00
kailixu 6b738884a4 chore: rsma checkpoint 2023-11-07 19:59:05 +08:00
Haojun Liao e558d8e497 fix: fix syntax error. 2023-11-07 18:53:21 +08:00
Haojun Liao 1301b92844 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:41:15 +08:00
Haojun Liao 8c2f6bab0e fix(stream): exec scan-history in timer. 2023-11-07 16:40:03 +08:00
Haojun Liao 7370daa6e0 fix(stream): record the start failure tasks. 2023-11-07 16:39:56 +08:00
Haojun Liao e38e526dda fix(stream):reset the starting flag for the followers. 2023-11-07 16:39:12 +08:00
Haojun Liao 207b53f3f6 fix(stream): fix errors in scan-history, introduced by refactor 2023-11-07 16:19:09 +08:00
liuyao 467c27c758 recover flush mark 2023-11-07 15:45:38 +08:00
dapan1121 c2ec373557 Merge remote-tracking branch 'origin/3.0' into feat/TD-24802 2023-11-07 10:09:10 +08:00
dapan1121 0ed4d1507f feat: support non_sort mode 2023-11-07 09:23:06 +08:00
Haojun Liao 4d8548e938 refactor: do some internal refactor. 2023-11-06 23:42:16 +08:00
Haojun Liao d9474016fc fix(stream): exec scan-history in timer. 2023-11-06 18:55:53 +08:00
Haojun Liao 6b1889284b fix(stream): record the start failure tasks. 2023-11-06 15:45:44 +08:00
Haojun Liao 69863febe6 fix(stream):reset the starting flag for the followers. 2023-11-06 13:17:13 +08:00
Haojun Liao d41fd27189 fix(stream): restart tasks in stream threads, instead of write thread. 2023-11-06 11:57:21 +08:00
Haojun Liao 0e44950a37 enh(stream): execute scan history by using time slice 1s. 2023-11-06 09:21:33 +08:00
Haojun Liao d440da0d8c enh(stream): execute scan history by using time slice 1s. 2023-11-05 01:26:53 +08:00
kailixu 77eadc59dc Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 16:26:07 +08:00
Haojun Liao 34403534ed Merge branch '3.0' into fix/3_liaohj 2023-11-03 14:06:58 +08:00
Haojun Liao 53b2158c54 refactor: do some internal refactor. 2023-11-03 13:51:17 +08:00
dm chen 0371064acc
Merge branch '3.0' into feat/TD-26529-3.0 2023-11-03 10:20:54 +08:00
yihaoDeng 24e961976f Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-03 09:31:57 +08:00
Haojun Liao 9d77351bb2 refactor: do some internal refactor. 2023-11-03 09:30:50 +08:00
liuyao 31ad73f6d1 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-03 09:12:17 +08:00
Haojun Liao ff5d69352f
Merge pull request #23493 from taosdata/fix/3_liaohj
fix(stream): add unsupport trans.
2023-11-03 09:07:33 +08:00
kailixu d9ed63473c Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-03 08:37:41 +08:00
yihaoDeng 6ce878948f Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-02 20:44:36 +08:00
liuyao 330b04a8bc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-02 14:36:13 +08:00
Haojun Liao 7cf90dde5c refactor: do some internal refactor. 2023-11-01 19:38:13 +08:00
Haojun Liao 00f029e44f refactor: add some logs. 2023-11-01 19:38:12 +08:00
Haojun Liao 246ed4e022 refactor: do some internal refactor. 2023-11-01 17:19:21 +08:00
liuyao 505c44d9aa Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-11-01 16:50:46 +08:00
Haojun Liao 12bc4f32cf refactor: add some logs. 2023-11-01 16:12:15 +08:00
yihaoDeng 4c8edb5545 Merge branch 'enh/new3.0' into enh/refactorBackend 2023-11-01 16:07:49 +08:00
slzhou 4a2c52783b Merge branch '3.0' of github.com:taosdata/TDengine into szhou/insert-stb-tbname 2023-11-01 14:10:02 +08:00
dapan1121 6305353290 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-11-01 10:38:50 +08:00
kailixu 1530fe0c49 Merge branch '3.0' into enh/TD-23769-3.0x 2023-11-01 09:52:16 +08:00
kailixu ad1e6accd4 chore: build checkpoint for rsma 2023-11-01 09:45:58 +08:00
yihaoDeng bb8252df16 fix mem leak 2023-10-31 20:59:24 +08:00
dapan1121 91df56fcf0 Merge remote-tracking branch 'origin/3.0' into feat/TD-25204 2023-10-31 18:44:54 +08:00
Haojun Liao a1aa2380ae other: merge 3.0 2023-10-31 16:42:51 +08:00
Haojun Liao 0b18192b23 fix(stream): fix error in finishing event handling. 2023-10-31 16:40:16 +08:00
Haojun Liao 4c0242a58d fix(stream): fix error in finishing event handling. 2023-10-31 16:39:14 +08:00
liuyao 696294c208 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-31 15:41:04 +08:00
wade zhang 76c9b9afc5
Merge pull request #23377 from taosdata/FIX/TD-26596-3.0
feat: support pipelining of snap replication
2023-10-31 15:19:07 +08:00
Haojun Liao 86dfc52a6e fix(stream): add event check when handling the end of event. 2023-10-31 10:45:12 +08:00
liuyao 5b74bf87b1 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898 2023-10-30 17:55:14 +08:00
dapan1121 0a97f18d72
Merge pull request #23344 from taosdata/feat/3.0/TS-4052
feat: support to_timestamp/to_char
2023-10-30 14:04:33 +08:00
Haojun Liao 19c5882cbe fix(stream): add event check when handling the end of event. 2023-10-30 10:22:24 +08:00
Benguang Zhao 70e261f662 enh: terminate snap replication on timeout 2023-10-30 10:14:26 +08:00
Haojun Liao c7285c0ede fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:41:57 +08:00
Haojun Liao 4c267b538f fix(stream): add expired epset node list for stream tasks in hb to mnode. 2023-10-27 23:05:41 +08:00
dapan1121 9801d5d7b7 fix: desciribe view and memory issues 2023-10-27 19:28:22 +08:00
Haojun Liao dcca6b0868 other: merge 3.0. 2023-10-27 11:41:28 +08:00
dapan1121 099f72e84a fix: memory issues 2023-10-27 11:36:17 +08:00
Haojun Liao 454624516c fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-27 09:59:51 +08:00
Haojun Liao 1ccbb77981 fix(stream): fix dead lock when shutdown all tasks. 2023-10-27 09:59:37 +08:00
Haojun Liao b0ef072556 fix(stream): clear flag for checkpoint. 2023-10-27 09:55:07 +08:00
Haojun Liao 091238e7be fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:58 +08:00
Haojun Liao e1f6043eed fix(stream): fix bugs caused by refactor sm. 2023-10-27 09:54:57 +08:00
Haojun Liao 1eac7f44c0 fix(stream): fix error in stream. 2023-10-27 09:54:56 +08:00
Haojun Liao 579dd8e6b2 refactor(stream): do some internal refactor. 2023-10-27 09:54:56 +08:00
Haojun Liao 6f3c0d17cc refactor(stream): add state machine to manage the state of stream tasks. 2023-10-27 09:54:49 +08:00
Haojun Liao 596eb073b7 refactor(stream): do some internal refactor. 2023-10-27 09:54:48 +08:00
Haojun Liao 2409a17517 refactor(stream): do some internal refactor. 2023-10-27 09:54:44 +08:00
Haojun Liao 164159f293 enh(stream): add parameter to limit the stream sink task. 2023-10-27 09:54:07 +08:00
liuyao d0e4a5d0f7 opt max delay 2023-10-25 20:29:25 +08:00
yihaoDeng db0f6258fe fix stream case error 2023-10-25 19:38:22 +08:00
liuyao f51c985914 stream event window 2023-10-25 17:50:16 +08:00
Benguang Zhao 7d9d1c6877 enh: terminate snap replication on timeout 2023-10-25 14:50:53 +08:00
slzhou c17300557d fix: memory sanitizer error of simple insert stb 2023-10-25 10:56:28 +08:00
Haojun Liao 03165d5327 fix(stream): handle the repeatly issued nodeUpdate msg from dnode. 2023-10-25 09:55:02 +08:00
dmchen 8e007f199b format 2023-10-24 11:31:50 +00:00
Haojun Liao 8cde39eebd fix(stream): fix dead lock when shutdown all tasks. 2023-10-24 19:11:24 +08:00
shenglian zhou ae1bac251a enhance: finished skeleton 2023-10-24 16:08:08 +08:00
dmchen 7c83d190a4 ts format 2023-10-24 05:29:45 +00:00
dapan1121 dbbceae061 fix: union all view issue 2023-10-24 11:29:04 +08:00
wangjiaming0909 f299a28109 feat: support to_timestamp/to_char 2023-10-23 19:36:03 +08:00