Commit Graph

2637 Commits

Author SHA1 Message Date
Haojun Liao a41a04dc37 fix(stream): remove the related history task correctly. 2024-06-11 18:35:59 +08:00
Haojun Liao 00eb621825 fix(stream): do scan checkpoint-report in write queue. 2024-06-11 14:09:50 +08:00
Haojun Liao 20bade24c3
Merge branch '3.0' into fix/3_liaohj 2024-06-10 01:34:55 +08:00
Haojun Liao cbf8b363fc fix(stream): update checkpoint info by using trans. 2024-06-10 00:46:01 +08:00
Haojun Liao 895ee30cf3
Merge branch '3.0' into enh/opt_prj 2024-06-09 23:51:38 +08:00
Haojun Liao cbd9f86a34
Merge pull request #26065 from taosdata/fix/3_liaohj
fix(stream): always load the data for fill-history scan.
2024-06-07 14:01:50 +08:00
Haojun Liao c4447d6873 fix(stream): flush executor state for those with only one task for a stream. 2024-06-07 12:44:38 +08:00
Haojun Liao 1e47cb7eba other: update the test case. 2024-06-07 11:15:23 +08:00
Haojun Liao 385e1a8b0d refactor: do some internal refactor. 2024-06-06 23:55:54 +08:00
Haojun Liao 88e77d6bc6 fix(stream): remove expired stream in buf. 2024-06-06 23:54:48 +08:00
Haojun Liao 420cbc36e5 other: fix syntax error. 2024-06-06 17:40:17 +08:00
Haojun Liao 52e090634e fix(stream): transfer state before send checkpoint-trigger msg to downstream tasks. 2024-06-06 17:21:23 +08:00
Haojun Liao 29d34200b5 other: fix coverity issues. 2024-06-05 13:39:46 +08:00
Haojun Liao c529ecc7d2
Merge pull request #25734 from taosdata/fix/3_liaohj
fix(stream): update the checkpoint info for followers, and some internal refactor.
2024-06-05 13:38:51 +08:00
Haojun Liao bf9a5135fb fix(stream): disable timer for checkpoint-ready msg in rsma. 2024-06-05 00:13:57 +08:00
Haojun Liao 4fc21cc8b0 refactor: do some internal refactor. 2024-06-04 10:08:18 +08:00
Haojun Liao 407f79cfa6 fix(stream): fix dead-lock. 2024-06-03 19:14:45 +08:00
Haojun Liao 3b3ed1c30c fix(stream): add monitor for checkpoint-ready msg recv status. 2024-06-03 16:45:37 +08:00
54liuyao ca7e1344e1 adj stream count state buff 2024-06-03 15:22:12 +08:00
Haojun Liao 31317c4895 fix(stream): set the checkpoint ready info for only one task in stream. 2024-06-01 23:20:43 +08:00
Haojun Liao 2a8270f9c8 fix(stream): track the checkpoint-ready msg on the upstream tasks. 2024-06-01 18:26:45 +08:00
Haojun Liao 76b43dc072 fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request. 2024-05-31 14:32:55 +08:00
Haojun Liao ee4e4c0e6d refactor: do some internal refactor. 2024-05-31 09:17:20 +08:00
Haojun Liao 0946f25e5f fix(stream): fix syntax error. 2024-05-29 22:36:22 +08:00
Haojun Liao becc4cb368 enh(stream): limit the concurrent started checkpoint tasks. 2024-05-29 19:29:26 +08:00
Haojun Liao 46ca55ac74 fix(stream): avoid deadlock. 2024-05-29 15:20:35 +08:00
Haojun Liao 27ac6ca16e fix(stream): desc the ref for checkpoint-trigger timer. 2024-05-29 14:12:14 +08:00
Haojun Liao 09efbad117 fix(stream): drop related fill history task. 2024-05-29 11:16:26 +08:00
Haojun Liao a9abe78eab other: comment invalid sleep for test purpose 2024-05-29 09:16:37 +08:00
Haojun Liao 225dfb1a93 enh(stream): check checkpoint-trigger msg every 100ms. 2024-05-29 00:30:42 +08:00
Haojun Liao d1d868f239 refactor: do some internal refactor and set the pActiveInfo for rsma. 2024-05-29 00:08:29 +08:00
Haojun Liao 8d54d45054 fix(stream): fix error found by CI. 2024-05-28 17:30:14 +08:00
Haojun Liao cc318d7e2d enh(stream): sink task does not initialize the backend. 2024-05-28 11:34:04 +08:00
Haojun Liao bd514fe4d3 other: merge rows. 2024-05-28 11:13:09 +08:00
Haojun Liao be107b204c enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes. 2024-05-28 09:54:22 +08:00
Haojun Liao 03a5230bd7
Merge pull request #25923 from taosdata/fix/TD-30028
fix(stream): fix memory leak if write failed.
2024-05-25 00:40:14 +08:00
Haojun Liao 01fb950cbc refactor: add some logs. 2024-05-24 11:44:17 +08:00
Haojun Liao 89fb56e77d other: merge 3.0 2024-05-24 11:41:51 +08:00
Haojun Liao 28032dfd39 fix(stream): fix memory leak if write failed. 2024-05-24 11:39:02 +08:00
Haojun Liao 499ca6c23b
Merge pull request #25910 from taosdata/fix/TD-30028
fix(stream): check if outputQ is full before execute the scan history task. if it is full, idle for 5 sec.
2024-05-24 10:25:17 +08:00
Haojun Liao 8c0a74e7b2 fix(stream):adjust the idle time. 2024-05-24 09:19:09 +08:00
Yihao Deng a021b62c04 fix backen crash 2024-05-23 12:02:01 +00:00
Haojun Liao eb1f09f47f refactor: do some internal refactor. 2024-05-23 17:25:22 +08:00
Haojun Liao 0c61fb20d6 fix(stream): check if outputQ is full before execute the scan history task. if it is full, idle for 5 sec. 2024-05-23 17:22:29 +08:00
Haojun Liao cc7d5d7a91 Merge branch '3.0' into fix/TD-30028 2024-05-23 16:16:59 +08:00
Haojun Liao cb6e03d985
Merge pull request #25896 from taosdata/fix/TD-30208
check delete mark
2024-05-23 15:48:01 +08:00
Haojun Liao 69567799eb fix(stream): initialization tasks before start all tasks. 2024-05-23 15:45:59 +08:00
Haojun Liao 61b08259ba fix(stream): initialization fill-history tasks before start all other stream tasks. 2024-05-23 15:38:16 +08:00
54liuyao 0b9e3c9115 check delete mark 2024-05-23 10:05:24 +08:00
Haojun Liao f146ae4198 fix(stream): 2024-05-22 19:46:24 +08:00
Haojun Liao 96e1487787 refactor: do some internal refactor. 2024-05-22 16:57:09 +08:00
Haojun Liao 142bc9046d fix(stream): fix memory leak. 2024-05-22 15:13:00 +08:00
Haojun Liao be39044b66 fix(stream): add more info 2024-05-22 11:04:54 +08:00
wangmm0220 f21eeae56c fix:[TD-30180]error in judging if groupId already added to the end of table name 2024-05-21 16:57:00 +08:00
Haojun Liao 3baa4169e6 Merge branch '3.0' into fix/3_liaohj 2024-05-20 10:31:53 +08:00
Hongze Cheng 9527b66db1
Merge pull request #25841 from taosdata/feat/ly_opt_checkpointYh
Feat/ly_opt_checkpointYh
2024-05-20 10:10:28 +08:00
Haojun Liao 130f7a292d fix(stream): reset the error code when trying to restore checkpoint. 2024-05-19 22:36:09 +08:00
Haojun Liao f74fad7e60 fix(query): fix error in refactor. 2024-05-19 17:17:40 +08:00
Haojun Liao 0fe2686b63 fix(query): fix bugs caused by refactor. 2024-05-19 14:55:51 +08:00
Haojun Liao 7a90e68667 fix(query): fix bugs caused by refactor. 2024-05-19 13:55:46 +08:00
Haojun Liao 82c10fd709 fix(query): fix bugs caused by refactor. 2024-05-19 13:40:09 +08:00
Haojun Liao 1e5098f676 fix(query): fix bugs caused by refactor. 2024-05-19 13:32:30 +08:00
Yihao Deng bb47a8df33 opt checkpoint 2024-05-17 15:30:04 +08:00
Yihao Deng b0377a2e3a opt checkpoint 2024-05-17 14:21:04 +08:00
wade zhang b299ff0449
Merge pull request #25798 from taosdata/fix/backendInvalidFree
Fix/backendInvalidFree
2024-05-17 13:46:18 +08:00
Yihao Deng a7b434075b opt checkpoint 2024-05-16 20:16:59 +08:00
Yihao Deng 2359e0e61b opt checkpoint 2024-05-16 18:07:57 +08:00
Yihao Deng ef5d9316bb Merge branch 'enh/refactoBackendCp' into feat/ly_opt_checkpoint 2024-05-16 16:30:27 +08:00
54liuyao 7b50663240 optimize stream operator checkpoint 2024-05-16 16:24:58 +08:00
Yihao Deng f33bf898b4 fix invalid free 2024-05-15 16:56:02 +08:00
Yihao Deng 01e9ae6299 fix invalid free 2024-05-15 16:53:42 +08:00
Haojun Liao 2b44211928 fix(test): update test case and fix a typo. 2024-05-15 14:52:59 +08:00
Haojun Liao abd90c733a fix(stream): remove backend files only after the in-memory task is dropped. 2024-05-15 14:24:35 +08:00
Yihao Deng b1c50e23b6 refactor checkpoint 2024-05-15 11:38:43 +08:00
Haojun Liao 042ed3caff fix(stream): fix invalid unlock. 2024-05-15 10:08:56 +08:00
Haojun Liao 610aa80e65 fix(stream): init backend for fill-history task. 2024-05-15 00:08:38 +08:00
Haojun Liao 4eacf86843 fix(tsdb): fix deadlock when stopping reader. 2024-05-14 19:20:19 +08:00
Haojun Liao 241f8b3d2e fix(tsdb): fix deadlock when stopping reader. 2024-05-14 18:05:13 +08:00
Haojun Liao 1ccf743215 fix(stream): fix syntax error. 2024-05-14 16:19:21 +08:00
Haojun Liao 4fa8cfbffe fix(stream): fix syntax error. 2024-05-14 15:42:37 +08:00
Haojun Liao 6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
Haojun Liao fb248b2682 fix(stream): not save the stream task for rsma. 2024-05-13 17:26:39 +08:00
Haojun Liao 3dfffe9113 fix(stream): async load and start stream tasks. 2024-05-13 15:31:26 +08:00
Haojun Liao d214dd5cdd fix(stream): fix error in downloading remote backup checkpoint data. 2024-05-11 16:19:11 +08:00
Haojun Liao f8d8061260 refactor: do some internal refactor. 2024-05-11 11:08:51 +08:00
Haojun Liao d7e1f37cd4 Merge branch '3.0' into fix/3_liaohj 2024-05-11 10:28:12 +08:00
Haojun Liao 370c255128 refactor: do some internal refactor. 2024-05-11 10:27:55 +08:00
Haojun Liao 11ed1f54b3 refactor: do some internal refactor. 2024-05-11 10:09:23 +08:00
Haojun Liao 7f93ec2c53 fix(stream): update the checkpoint info for followers, and some internal refactor. 2024-05-11 09:37:02 +08:00
Haojun Liao 845fcfa247
Merge pull request #25700 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-09 15:14:46 +08:00
Haojun Liao 6721ec3cd8 refactor: do some internal refactor. 2024-05-09 14:06:25 +08:00
Haojun Liao 2ee8f7da32
Merge pull request #25695 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-09 13:36:56 +08:00
Haojun Liao db848f7e6b refactor: do some internal refactor. 2024-05-09 10:15:34 +08:00
Haojun Liao 6693efaa85 refactor: do some internal refactor. 2024-05-09 10:11:37 +08:00
Haojun Liao a450deb60b
Merge pull request #25679 from taosdata/fix/3_liaohj
fix(query): set correct row length for rowid sort.
2024-05-09 10:10:27 +08:00
Haojun Liao 4f59754a63 refactor: do some internal refactor. 2024-05-08 16:22:02 +08:00
Haojun Liao a1a198630a
Merge pull request #25666 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-08 15:33:53 +08:00
Haojun Liao bc04093d11 refactor: do some internal refactor. 2024-05-08 13:54:25 +08:00
Haojun Liao 9ce8f6953d refactor: do some internal refactor. 2024-05-08 13:52:20 +08:00
Haojun Liao b26656fd1c
Merge pull request #25661 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-08 13:03:13 +08:00