Commit Graph

8548 Commits

Author SHA1 Message Date
Hongze Cheng e8a8748dc9 more fix 2024-01-25 15:48:45 +08:00
Hongze Cheng 7d27c3902a feat: avoid meta rwlock starvation 2024-01-25 15:45:09 +08:00
54liuyao 7105b0ffe3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-25 10:12:13 +08:00
Hongze Cheng 82f3b3a931
Merge pull request #24589 from taosdata/fix/ttlnoretry-3.0
fix: no retry for ttl drop table
2024-01-24 14:03:18 +08:00
Haojun Liao 8a7e38ad15 fix(stream): fix checkpoint failure check. 2024-01-24 13:10:53 +08:00
Shungang Li 5bd14b4866 enh: errcode for message has been processed in preprocess 2024-01-23 13:53:51 +08:00
Benguang Zhao 192bb179e7 enh: trigger vnodeCommit at exit even if no data changed 2024-01-23 10:15:00 +08:00
54liuyao 0975e37845 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-23 10:07:50 +08:00
Haojun Liao ecd51e366f
Merge pull request #24512 from taosdata/opti/TD-28118
opti:[TD-28118] raw block data for tmq
2024-01-22 11:47:13 +08:00
Haojun Liao d973f66cea fix(stream): do checkpoint after fill-history task completed. 2024-01-19 16:18:02 +08:00
54liuyao 5a7d72d6ef Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-19 10:39:11 +08:00
wangmm0220 7246fedfef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2024-01-18 19:08:35 +08:00
factosea b83bb8c150 fix: last_row error 2024-01-18 17:20:31 +08:00
Haojun Liao 76e6c453e7 enh(stream): send msg to mnode when the transferring state completed. 2024-01-18 15:43:36 +08:00
Haojun Liao 719d1d1b90 refactor: do some internal refactor. 2024-01-18 14:34:18 +08:00
Haojun Liao f8d0c52483 fix(stream): remove this unused drop history task msg and corresponding functions. 2024-01-18 14:32:48 +08:00
wangmm0220 d5d1dd9127 opti:[TD-28118] raw block data for tmq 2024-01-17 20:08:26 +08:00
Haojun Liao d1dbd03341 fix(tsdb): fix invalid set. 2024-01-17 17:29:00 +08:00
Haojun Liao d44dc5bbb2 fix(tsdb): fix race condition. 2024-01-17 15:20:17 +08:00
Haojun Liao 56eac88349 Merge branch '3.0' into fix/3_liaohj 2024-01-17 15:14:52 +08:00
Haojun Liao 1ea671e373 enh(stream): remove time controller. 2024-01-17 14:55:15 +08:00
Haojun Liao fc16d26da2
Merge pull request #24488 from taosdata/fix/3_liaohj
fix(stream): fix some errors and do some internal refactor.
2024-01-17 14:25:32 +08:00
54liuyao 3bbfb26e09 stream count window 2024-01-17 14:22:19 +08:00
dapan1121 66c9c076e8
Merge pull request #24469 from taosdata/fix/xsren/TD-28204/whereOptimizeConditional
Fix/xsren/td 28204/where optimize conditional
2024-01-17 10:20:51 +08:00
Haojun Liao a56e589048
Merge pull request #24490 from taosdata/fix/TD-28338
fix:[TD-28338]empty varchar value return NULL in tmq
2024-01-17 10:09:40 +08:00
yihaoDeng 0d4cc6b8e2 fix:[TD-28338]empty varchar value return NULL in tmq 2024-01-16 18:46:37 +08:00
Haojun Liao 3d98fc6a67 other: merge 3.0 2024-01-16 18:29:33 +08:00
jiajingbin d59ede5196 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28032 2024-01-16 15:05:13 +08:00
Haojun Liao 9a4b7a6d82 fix(stream): remove invalid lock, and fix a typo. 2024-01-16 14:52:27 +08:00
Haojun Liao 80793c94c2 fix(stream): reset the tasks status before start all tasks, and do some other internal refactor. 2024-01-16 14:32:45 +08:00
xinsheng Ren ae5f540692
Merge branch '3.0' into fix/xsren/TD-28204/whereOptimizeConditional 2024-01-16 14:28:37 +08:00
Haojun Liao dfe959eb28
Merge pull request #24468 from taosdata/fix/3_liaohj
fix(stream): fix deadlock in pause.
2024-01-16 12:58:27 +08:00
Haojun Liao 63494de7f9 refactor: do some internal refactor. 2024-01-16 10:28:07 +08:00
dapan1121 53094f62d8
Merge pull request #24359 from taosdata/FIX/TD-27003
Fix : use last row scan when select last_row, last
2024-01-16 08:50:23 +08:00
fullhonest fafb5b1f03 Fix TD-28018: last row num error where partition by null column 2024-01-15 18:29:41 +08:00
wangmm0220 2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
factosea 2c0dd3db03 fix: memory leak 2024-01-15 16:41:52 +08:00
Haojun Liao 43081b540b fix(stream): reset restart counter to be 0 if all tasks are ready. 2024-01-15 16:16:28 +08:00
fullhonest cb2ab749b5 Fix TD-27003: use last row scan when select last_row, last 2024-01-15 15:22:29 +08:00
Haojun Liao 143e6a13af fix(stream): fix deadlock in pause. 2024-01-15 14:37:24 +08:00
Haojun Liao e012bc4bde refactor: do some internal refactor. 2024-01-15 11:28:36 +08:00
Haojun Liao c710718f9e
Merge pull request #24457 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-15 10:58:45 +08:00
Haojun Liao 00e2bdec23 refactor: do some internal refactor. 2024-01-12 19:08:46 +08:00
wangmm0220 00e0da15a3 fix:[TD-28032]groupid = 0 & modify test case in sim 2024-01-12 17:37:22 +08:00
Haojun Liao ee24bb9b03
Merge pull request #24444 from taosdata/fix/3_liaohj
fix(stream): close the inputQ of the related stream task.
2024-01-12 13:41:30 +08:00
Haojun Liao cf941f7488 fix(stream): check status when resume to run. 2024-01-12 11:12:23 +08:00
Haojun Liao b36cc97236 fix(stream): close the inputQ of the related stream task when the fill-history task recv the trans-state msg from upstream. 2024-01-12 10:44:49 +08:00
Hongze Cheng 8399f5253f
Merge pull request #24439 from taosdata/fix/TD-28285-30
fix(tsdb/cache): clear fs state before next open
2024-01-12 10:38:43 +08:00
dapan1121 3b928237d7
Merge pull request #24419 from wangjiaming0909/draft/fix/TD-28182
fix: table merge scan return disordered rows
2024-01-12 10:16:21 +08:00
Haojun Liao ea0ea09b0f
Merge pull request #24409 from taosdata/opt/optMsgOnMnode
opt msg on mnd
2024-01-12 09:36:37 +08:00
Minglei Jin aa410a6deb fix(tsdb/cache): clear fs state before next open 2024-01-12 09:32:40 +08:00
wangjiaming0909 686108050b fix: table merge scan return disordered rows 2024-01-11 09:57:35 +08:00
Haojun Liao f6c0649108 fix(stream): fix syntax error. 2024-01-11 09:53:19 +08:00
Haojun Liao bff0ad89a4 other: merge 3.0 2024-01-11 09:51:12 +08:00
Haojun Liao 1c562bd535 refactor: enable the restart of stream tasks. 2024-01-11 09:41:40 +08:00
wangmm0220 216830f8b4 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 20:33:13 +08:00
wangmm0220 df69a89da2 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 18:46:10 +08:00
Yihao Deng b5e5167b8f split sync/status channel 2024-01-10 09:57:08 +00:00
wangmm0220 02c7bdd4f0 fix:[TD-28032]fsdfasd 2024-01-10 14:57:16 +08:00
Haojun Liao b0202bb853 fix(tsdb): open reader during resume task for main reader after suspending reader. 2024-01-10 13:44:21 +08:00
Haojun Liao e8aea42498 fix(tsdb): open reader during resume task for main reader after suspending reader. 2024-01-10 13:42:36 +08:00
Haojun Liao 1b6d55616f fix(stream): fix syntax error. 2024-01-10 11:28:06 +08:00
Haojun Liao eac0d14868 fix(stream): add check when merging rows from files and buffer. 2024-01-10 11:02:44 +08:00
Haojun Liao 9d0d0d9ddc Merge branch '3.0' into fix/3_liaohj 2024-01-10 09:57:46 +08:00
Haojun Liao 2b3ad002f5
Merge pull request #24401 from taosdata/fix/TD-28142-3.0
opti:[TD-28142]memory size if block num is too large
2024-01-10 09:40:07 +08:00
Haojun Liao dc0c5539a0 fix(stream): remove invalid timer controllers. 2024-01-10 08:48:49 +08:00
Hongze Cheng 7fa06df958
Merge pull request #24395 from taosdata/fix/TD-28208
fix(tsdb/cache): destory brin block with fs loading
2024-01-09 16:31:41 +08:00
wangmm0220 6444af84e4 opti:[TD-28142]memory size if block num is too large 2024-01-09 16:28:58 +08:00
Minglei Jin d93b4f88b3 fix(tsdb/cache): destory brin block with fs loading 2024-01-09 15:23:15 +08:00
Haojun Liao f9d5c0d403 fix(stream): fix error in tq timer. 2024-01-09 09:13:53 +08:00
Haojun Liao af9dc441b2 fix(stream): reset the saved value for fill-history task. 2024-01-08 18:40:06 +08:00
Hongze Cheng 5e45ecd3fd fix: possible race condition 2024-01-08 16:46:07 +08:00
Haojun Liao 3bcd038b7d refactor: not reload info from disk when trying to restart stream tasks. 2024-01-08 14:04:36 +08:00
Haojun Liao 275e2d6f94 refactor: do some internal refactor. 2024-01-08 11:34:47 +08:00
Haojun Liao bb9edde79e fix(stream): add some logs. 2024-01-08 11:33:54 +08:00
Haojun Liao a024fe960c fix(stream): fix deadlock. 2024-01-07 14:53:17 +08:00
Haojun Liao 29219ba9f4 fix(stream): add task number check. 2024-01-07 01:32:50 +08:00
Haojun Liao 02f6c971fd fix(stream): check for not ready task when rsp returned. 2024-01-06 19:43:39 +08:00
Haojun Liao cfda97beef refactor: disable commit temp 2024-01-06 15:27:48 +08:00
Haojun Liao 23341e1bdf refactor: opt perf by avoid save tasks during restoring 2024-01-05 22:58:43 +08:00
Haojun Liao 445605ed22 refactor: do some internal refactor. 2024-01-05 22:35:56 +08:00
Haojun Liao 522e688387 fix(stream): check if in restart procedure in call back. 2024-01-05 22:16:58 +08:00
Haojun Liao 2386f842fb enh(stream): remove sleep to opt perf. 2024-01-05 18:46:15 +08:00
Haojun Liao 0c4b91dc72 enh(stream): start task async. 2024-01-05 17:55:39 +08:00
Haojun Liao 1912de9b49 enh(stream): scan wal by using timer to trigger it. 2024-01-05 14:49:33 +08:00
Haojun Liao 33f698e926 fix(stream): remove invalid assert and add check for task status before launching related fill-history task. 2024-01-04 19:09:45 +08:00
Hongze Cheng df74b2d755
Merge pull request #24284 from taosdata/fix/TD-27988
fix: remove useless code
2024-01-04 19:03:45 +08:00
Haojun Liao 6d37e596ec refactor: do some internal refactor. 2024-01-04 18:47:49 +08:00
Haojun Liao c494252002 fix(stream): record the related fill-history task failure. 2024-01-04 17:44:05 +08:00
Hongze Cheng 13834802ef
Merge pull request #24269 from taosdata/FIX/TD-28101-3.0
enh: send rsp msg on rejecting snap replication due to smaller term
2024-01-04 10:15:09 +08:00
dapan1121 670317ccd7
Merge pull request #24053 from taosdata/enh/3.0/TD-26813
enh: support group by tag/tbname to list empty groups
2024-01-04 09:08:03 +08:00
Haojun Liao 1e3aad8883 refactor: do some internal refactor. 2024-01-03 23:57:33 +08:00
wangmm0220 b200e6807f fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 19:44:30 +08:00
wangmm0220 317f0c6a39 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 18:48:54 +08:00
Haojun Liao 4399867e14 fix(stream): fix the not running bug. 2024-01-03 18:28:23 +08:00
Haojun Liao 4138692cea fix(stream): scan wal data files. 2024-01-03 18:16:18 +08:00
Haojun Liao 185fa75376 enh(stream): add task into timer to be idle during exec when the corresponding output queue is full. 2024-01-03 17:59:42 +08:00
dapan1121 f0fbffa772
Merge pull request #24301 from taosdata/fix/3.0/TD-28104
fix: last table scan reported invalid param when col was dropped which
2024-01-03 15:47:33 +08:00
Haojun Liao a2e85c44c2
Merge pull request #24228 from taosdata/fix/3_liaohj
refactor: remove stream-scan-history event for stream task.
2024-01-03 14:43:20 +08:00
Haojun Liao 453d3e8a30 fix(stream): fix dead lock on windows. 2024-01-03 10:50:38 +08:00