Commit Graph

8470 Commits

Author SHA1 Message Date
Haojun Liao 02f6c971fd fix(stream): check for not ready task when rsp returned. 2024-01-06 19:43:39 +08:00
Haojun Liao cfda97beef refactor: disable commit temp 2024-01-06 15:27:48 +08:00
Haojun Liao 23341e1bdf refactor: opt perf by avoid save tasks during restoring 2024-01-05 22:58:43 +08:00
Haojun Liao 445605ed22 refactor: do some internal refactor. 2024-01-05 22:35:56 +08:00
Haojun Liao 522e688387 fix(stream): check if in restart procedure in call back. 2024-01-05 22:16:58 +08:00
Haojun Liao 2386f842fb enh(stream): remove sleep to opt perf. 2024-01-05 18:46:15 +08:00
Haojun Liao 0c4b91dc72 enh(stream): start task async. 2024-01-05 17:55:39 +08:00
Haojun Liao 1912de9b49 enh(stream): scan wal by using timer to trigger it. 2024-01-05 14:49:33 +08:00
Haojun Liao 33f698e926 fix(stream): remove invalid assert and add check for task status before launching related fill-history task. 2024-01-04 19:09:45 +08:00
Hongze Cheng df74b2d755
Merge pull request #24284 from taosdata/fix/TD-27988
fix: remove useless code
2024-01-04 19:03:45 +08:00
Haojun Liao 6d37e596ec refactor: do some internal refactor. 2024-01-04 18:47:49 +08:00
Haojun Liao c494252002 fix(stream): record the related fill-history task failure. 2024-01-04 17:44:05 +08:00
Hongze Cheng 13834802ef
Merge pull request #24269 from taosdata/FIX/TD-28101-3.0
enh: send rsp msg on rejecting snap replication due to smaller term
2024-01-04 10:15:09 +08:00
dapan1121 670317ccd7
Merge pull request #24053 from taosdata/enh/3.0/TD-26813
enh: support group by tag/tbname to list empty groups
2024-01-04 09:08:03 +08:00
Haojun Liao 1e3aad8883 refactor: do some internal refactor. 2024-01-03 23:57:33 +08:00
wangmm0220 b200e6807f fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 19:44:30 +08:00
wangmm0220 317f0c6a39 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 18:48:54 +08:00
Haojun Liao 4399867e14 fix(stream): fix the not running bug. 2024-01-03 18:28:23 +08:00
Haojun Liao 4138692cea fix(stream): scan wal data files. 2024-01-03 18:16:18 +08:00
Haojun Liao 185fa75376 enh(stream): add task into timer to be idle during exec when the corresponding output queue is full. 2024-01-03 17:59:42 +08:00
dapan1121 f0fbffa772
Merge pull request #24301 from taosdata/fix/3.0/TD-28104
fix: last table scan reported invalid param when col was dropped which
2024-01-03 15:47:33 +08:00
Haojun Liao a2e85c44c2
Merge pull request #24228 from taosdata/fix/3_liaohj
refactor: remove stream-scan-history event for stream task.
2024-01-03 14:43:20 +08:00
Haojun Liao 453d3e8a30 fix(stream): fix dead lock on windows. 2024-01-03 10:50:38 +08:00
wangmm0220 ab262550d1 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 10:37:05 +08:00
wangmm0220 9ba2f71487 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 10:16:43 +08:00
Haojun Liao 6c7683dba6
Merge pull request #24310 from taosdata/fix/crash_stream
fix(tsdb): check if stt blocks are clean before building data blocks.
2024-01-02 21:30:28 +08:00
wangmm0220 8add4dc177 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-02 18:37:29 +08:00
Haojun Liao 5bbf12c2c9 fix(tsdb): check if stt blocks are clean before building composed data blocks. 2024-01-02 18:35:17 +08:00
Haojun Liao 29afc2ad6a fix(stream):add jump condition for loop. 2024-01-02 15:48:08 +08:00
Haojun Liao e7a0044502 Merge branch '3.0' into fix/3_liaohj 2024-01-02 13:02:55 +08:00
Haojun Liao 4368bfb20a fix(stream): fix dead lock. 2024-01-02 11:40:29 +08:00
Haojun Liao b3d8f4e9d6 fix(stream): fix a typo. 2024-01-02 10:39:01 +08:00
Haojun Liao d217412691 fix(stream): avoid race condition in starting threads. 2024-01-02 10:33:25 +08:00
wangjiaming0909 be0d35a5af fix: last table scan reported invalid param when col was dropped which
should report invalid col
2024-01-02 10:20:04 +08:00
Haojun Liao 8ac02adc0b refactor: do some internal refactor. 2023-12-29 17:42:23 +08:00
Hongze Cheng 7cb12db8ce remove more useless code 2023-12-29 15:20:27 +08:00
Benguang Zhao 68cb86602e fix: reuse cid with fs eid updated in tsdbFSetRAWWriteFileDataBegin 2023-12-29 11:49:57 +08:00
Benguang Zhao baa7f9c895 enh: adjust error msg as warn for not ready to propose etc 2023-12-28 17:29:49 +08:00
Haojun Liao 1659164926 fix(stream): remove invalid checkpoint id check. 2023-12-27 23:00:18 +08:00
Haojun Liao 7eb0e42bb9 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-27 22:57:58 +08:00
Hongze Cheng 90645cbc77
Merge pull request #24220 from taosdata/fix/TD-27988
fix: remove useless code
2023-12-27 21:23:26 +08:00
Hongze Cheng 2ada7d455e
Merge pull request #24236 from taosdata/fix/TD-28061
fix(tsdb/cache): erase entry from lru if deleted
2023-12-27 18:13:16 +08:00
Haojun Liao 5592e11235 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-26 19:02:52 +08:00
54liuyao ccf861dec8 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/3_liaohj 2023-12-26 18:36:18 +08:00
Minglei Jin 2ba586513f fix(tsdb/cache): erase entry from lru if deleted 2023-12-26 16:41:33 +08:00
Yihao Deng 40aa5f697f fix tag index double free 2023-12-26 07:21:02 +00:00
Yihao Deng dc01625ea1 fix tag index double free 2023-12-26 06:52:33 +00:00
Haojun Liao 62cfcefbb0 refactor: remove stream-scan-history event for stream task. 2023-12-26 00:34:04 +08:00
Hongze Cheng a7c8563c06 fix: remove useless code 2023-12-25 16:13:30 +08:00
Haojun Liao e5087f6e23 fix(tsdb): fix invalid delete check. 2023-12-25 10:40:36 +08:00
Haojun Liao 00fac852e8 fix(tsdb): fix invalid delete check. 2023-12-25 09:55:24 +08:00
Haojun Liao 0877e0bfad other: merge 3.0 2023-12-25 09:13:31 +08:00
Haojun Liao 30498a4028 refactor: do some internal refactor. 2023-12-24 02:24:46 +08:00
Haojun Liao 25f798e42f fix(stream): record the start failure tasks 2023-12-23 23:29:30 +08:00
Bob Liu e3098accc4 support count empty table 2023-12-22 18:14:26 +08:00
Haojun Liao b175a4b7b3 refactor(stream): async stop tasks, and do some internal refactor. 2023-12-22 17:56:16 +08:00
Haojun Liao 7ce545bcd4 refactor: refactor the lock type. 2023-12-22 16:14:49 +08:00
Haojun Liao e91afa7df2 fix(stream): fix deadlock. 2023-12-22 14:51:04 +08:00
Haojun Liao 90898a16e0 refactor: do some internal refactor. 2023-12-22 13:57:15 +08:00
Hongze Cheng 02bb9e90d2
Merge pull request #24189 from taosdata/fix/TD-27974
fix(tsdb/cache): prepend ts col to load stt
2023-12-22 13:53:15 +08:00
Minglei Jin 16ad59fb18 fix(tsdb/cache): prepend ts col to load stt 2023-12-22 12:14:27 +08:00
Hongze Cheng 46211258b3
Merge pull request #24173 from taosdata/fix/TD-27974
fix(tsdb/cache): plus 1 to nCols to load stt data
2023-12-22 09:43:20 +08:00
Haojun Liao c9475060de fix(stream): fix race condition. 2023-12-22 09:34:49 +08:00
Minglei Jin 9d3eb02f3c fix(tsdb/cache): plus 1 to nCols to load stt data 2023-12-21 17:53:44 +08:00
Haojun Liao 2acc8423c5 fix(stream): send msg to mnode before closing all tasks. 2023-12-21 16:00:50 +08:00
Alex Duan 9d4a75b0be coverage: vnodeSrv.c tmsg.c trow.c 2023-12-21 14:22:22 +08:00
Haojun Liao 71f6d9f06f fix(stream): handle the case that recvs drop msg twice. 2023-12-21 11:52:45 +08:00
Haojun Liao 1a8583887f fix(stream): remove clear backendcache. 2023-12-20 15:35:43 +08:00
Haojun Liao d25a323a4c fix(stream): record the launch failure. 2023-12-20 13:55:12 +08:00
Haojun Liao 81d8b2434f refactor: do some internal refactor. 2023-12-20 10:25:31 +08:00
Haojun Liao 541967e99e refactor: do some internal refactor. 2023-12-20 10:24:03 +08:00
Haojun Liao 2de0f6e971 test(stream): lock the update procedure. 2023-12-19 18:56:15 +08:00
Haojun Liao 92045f5485 fix(stream): add snode check, and handle the task status reset from checkpoint when it is in the snode. 2023-12-19 18:34:30 +08:00
Haojun Liao 17e9e84aa9 Merge branch '3.0' into fix/3_liaohj 2023-12-19 16:43:08 +08:00
Haojun Liao fee198f9ad refactor: do some internal refactor. 2023-12-19 16:21:11 +08:00
Haojun Liao ec3183b6a8 other: merge 3.0 2023-12-18 23:16:37 +08:00
Haojun Liao 579366ec00
Merge pull request #24121 from taosdata/fix/liaohj
other: merge main into 3.0
2023-12-18 23:11:36 +08:00
Haojun Liao e734569de0 fix(stream): fix dead lock. 2023-12-18 18:42:57 +08:00
Haojun Liao bba5a4f08b other: merge main into 3.0 2023-12-18 18:26:42 +08:00
Minglei Jin 64378be7f4 fix(tsdb/cache): fix buffer-overflow with column adding 2023-12-18 18:06:40 +08:00
Haojun Liao ea6e78cbaa fix(stream): add async call restart, instead of sync wait. 2023-12-18 16:33:44 +08:00
wade zhang 4cac96d2df
Merge pull request #24111 from taosdata/fix/TD-27845
fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange
2023-12-18 16:27:18 +08:00
Haojun Liao 79672f8e5f
Merge pull request #24107 from taosdata/fix/3_liaohj
fix(stream): add check for null ptr and leader .
2023-12-18 16:24:07 +08:00
Minglei Jin 5dd9ce8ceb fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange 2023-12-18 15:02:34 +08:00
Haojun Liao b4a1907fb7 fix(stream): add check for null ptr and leader . 2023-12-18 11:52:59 +08:00
Haojun Liao ef0cab18cb
Merge pull request #24098 from taosdata/fix/3_liaohj
fix(stream): send checkpoint complete msg to mnode when dropping it.
2023-12-17 11:03:04 +08:00
Haojun Liao 4f852704f5 fix(stream): send checkpoint complete msg to mnode when dropping it. 2023-12-17 02:06:01 +08:00
Haojun Liao 0526e619ad
Merge pull request #24095 from taosdata/fix/3_liaohj
fix(tsdb): add desc check for clean file block.
2023-12-16 18:10:15 +08:00
Haojun Liao 4cc0f5be59 fix(tsdb): add desc check for clean file block. 2023-12-16 15:37:17 +08:00
Haojun Liao 1a9701d401
Merge pull request #23946 from taosdata/fix/snodeBackendCrash
Fix/snode backend crash
2023-12-16 13:13:28 +08:00
Haojun Liao f9a5485d52 fix(stream): refactor the stream trans conflict detection strategy. 2023-12-16 01:46:29 +08:00
slzhou 8a6317b76a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fix-tms-duration 2023-12-15 22:09:43 +08:00
Haojun Liao a847bf468a
Merge pull request #24088 from taosdata/fix/3_liaohj
fix(query): add rows info if blocks exist.
2023-12-15 18:24:45 +08:00
yihaoDeng bb5f0d9112 Merge branch 'fix/snodeBackendCrash' of https://github.com/taosdata/TDengine into fix/snodeBackendCrash 2023-12-15 18:16:38 +08:00
yihaoDeng 7ab7a64eb3 Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 18:16:14 +08:00
Hongze Cheng 4ae13f411e
Merge pull request #24010 from taosdata/feat/TS-4229
feat: compact monitor and kill
2023-12-15 16:20:13 +08:00
Haojun Liao e2fa4cba8c refactor: do some internal refactor. 2023-12-15 15:28:01 +08:00
shenglian zhou cc4a6c6d55 fix: add new duration block event 2023-12-15 15:04:47 +08:00
Haojun Liao 556eaa22ac
Merge pull request #24074 from taosdata/mark/3.0
fix:core dump if tqOpen error in vnodeOpen
2023-12-15 13:55:10 +08:00
wangmm0220 812f0f97a7 fix:rollback size to old logic 2023-12-15 10:09:18 +08:00