Commit Graph

422 Commits

Author SHA1 Message Date
54liuyao 25b150af10 fix(stream):fill result immediately after delete data 2024-06-25 17:24:59 +08:00
Haojun Liao c2ad0a6ec5
Revert "fix(stream):fill result immediately after delete data" 2024-06-25 16:53:32 +08:00
Haojun Liao 156e3ce109
Merge pull request #26267 from taosdata/fix/TD-30585
fix(stream):fill result immediately after delete data
2024-06-25 16:46:52 +08:00
Yihao Deng 33aef6ddc5 add self check info 2024-06-25 07:12:09 +00:00
Yihao Deng 7cab27110a add self check info 2024-06-24 12:26:10 +00:00
54liuyao a4211efacf calc end key 2024-06-24 19:19:15 +08:00
54liuyao 2d7d144ca2 fix(stream):fill dresultimmediately after delete data 2024-06-24 10:56:26 +08:00
Haojun Liao 5a9500055d fix(stream): check the task status checkpoint-ready msg send timer. 2024-06-21 18:44:54 +08:00
Haojun Liao 4c4bb0a2e4 other: merge 3.0. 2024-06-21 16:11:50 +08:00
Haojun Liao ebf2df965c
Update streamBackendRocksdb.c 2024-06-21 09:28:42 +08:00
Haojun Liao 2cb9644471 fix(stream): update the checkpoint info only when the status is normal. 2024-06-21 09:23:29 +08:00
Haojun Liao bf16c596a6 fix(stream): fix syntax error. 2024-06-21 08:46:09 +08:00
Haojun Liao e1cb4e021f fix(stream): clear the local backend default directory, when no checkpoint generated yet. 2024-06-20 16:24:02 +08:00
Haojun Liao 29d34200b5 other: fix coverity issues. 2024-06-05 13:39:46 +08:00
Haojun Liao cc318d7e2d enh(stream): sink task does not initialize the backend. 2024-05-28 11:34:04 +08:00
Haojun Liao be107b204c enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes. 2024-05-28 09:54:22 +08:00
Haojun Liao 89fb56e77d other: merge 3.0 2024-05-24 11:41:51 +08:00
Yihao Deng a021b62c04 fix backen crash 2024-05-23 12:02:01 +00:00
Haojun Liao 3baa4169e6 Merge branch '3.0' into fix/3_liaohj 2024-05-20 10:31:53 +08:00
Hongze Cheng 9527b66db1
Merge pull request #25841 from taosdata/feat/ly_opt_checkpointYh
Feat/ly_opt_checkpointYh
2024-05-20 10:10:28 +08:00
Haojun Liao 130f7a292d fix(stream): reset the error code when trying to restore checkpoint. 2024-05-19 22:36:09 +08:00
Yihao Deng bb47a8df33 opt checkpoint 2024-05-17 15:30:04 +08:00
Yihao Deng a7b434075b opt checkpoint 2024-05-16 20:16:59 +08:00
Yihao Deng 2359e0e61b opt checkpoint 2024-05-16 18:07:57 +08:00
Yihao Deng f33bf898b4 fix invalid free 2024-05-15 16:56:02 +08:00
Yihao Deng 01e9ae6299 fix invalid free 2024-05-15 16:53:42 +08:00
Haojun Liao 2b44211928 fix(test): update test case and fix a typo. 2024-05-15 14:52:59 +08:00
Haojun Liao abd90c733a fix(stream): remove backend files only after the in-memory task is dropped. 2024-05-15 14:24:35 +08:00
Yihao Deng b1c50e23b6 refactor checkpoint 2024-05-15 11:38:43 +08:00
Haojun Liao 1ccf743215 fix(stream): fix syntax error. 2024-05-14 16:19:21 +08:00
Haojun Liao 4fa8cfbffe fix(stream): fix syntax error. 2024-05-14 15:42:37 +08:00
Haojun Liao 6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
Haojun Liao 3dfffe9113 fix(stream): async load and start stream tasks. 2024-05-13 15:31:26 +08:00
Haojun Liao d214dd5cdd fix(stream): fix error in downloading remote backup checkpoint data. 2024-05-11 16:19:11 +08:00
Haojun Liao f8d8061260 refactor: do some internal refactor. 2024-05-11 11:08:51 +08:00
Haojun Liao d7e1f37cd4 Merge branch '3.0' into fix/3_liaohj 2024-05-11 10:28:12 +08:00
Haojun Liao 11ed1f54b3 refactor: do some internal refactor. 2024-05-11 10:09:23 +08:00
Haojun Liao 7f93ec2c53 fix(stream): update the checkpoint info for followers, and some internal refactor. 2024-05-11 09:37:02 +08:00
Haojun Liao a1a198630a
Merge pull request #25666 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-08 15:33:53 +08:00
Haojun Liao 9ce8f6953d refactor: do some internal refactor. 2024-05-08 13:52:20 +08:00
Haojun Liao 55a630911d
Merge pull request #25653 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-07 23:12:30 +08:00
Haojun Liao b6debd985b fix(stream): always return success if repeatly recv checkpoint source msg. 2024-05-07 16:33:08 +08:00
Yihao Deng 8061688e79 fix rocskdb init failed 2024-05-06 03:22:28 +00:00
Haojun Liao 94a0f9ab8f other: merge 3.0 2024-04-30 17:12:46 +08:00
Haojun Liao 629502e12e refactor: do some internal refactor. 2024-04-30 17:00:51 +08:00
Yihao Deng 97aadd3aa7 avoid invalid read 2024-04-29 03:17:33 +00:00
Haojun Liao 5f5595a6ab
Merge pull request #25517 from taosdata/fix/3_liaohj
fix(stream): add task node into update list if it is timeout for more than 100sec.
2024-04-26 17:00:23 +08:00
Haojun Liao 8b53f76691 fix(stream): discard the repeatly recv checkpoint-source msg. 2024-04-26 15:56:34 +08:00
Yihao Deng d06cf49182 Fix memory leak in copyDataAt function 2024-04-25 07:44:31 +00:00
Haojun Liao 4802cd1ddf Merge branch '3.0' into fix/3_liaohj 2024-04-18 17:53:30 +08:00
Haojun Liao ddf98ae0c2 refactor: do some internal refactor. 2024-04-17 18:04:02 +08:00
Yihao Deng a461b24ac9 add compress 2024-04-17 09:37:23 +00:00
Yihao Deng 07008747ed add compress 2024-04-17 09:09:30 +00:00
Yihao Deng 2547f29de9 add compress 2024-04-17 08:59:38 +00:00
Yihao Deng f8dcf806d2 add compress 2024-04-17 08:58:10 +00:00
Yihao Deng 7cec8836b1 add compress 2024-04-17 08:39:43 +00:00
Yihao Deng 15f9e1e29e add compress 2024-04-17 08:38:46 +00:00
Yihao Deng 1363cd0a71 add compress 2024-04-17 08:33:40 +00:00
Yihao Deng 0f629bebda add compress 2024-04-17 07:35:00 +00:00
yihaoDeng 40390ad918 add compress 2024-04-17 10:23:17 +08:00
yihaoDeng 2da8645d36 add compress 2024-04-17 10:22:54 +08:00
yihaoDeng 469e9ba069 add compress 2024-04-17 10:20:11 +08:00
yihaoDeng 3416d68433 add coverity scan 2024-03-05 21:02:20 +08:00
yihaoDeng b3c18c31da add test case to stream backend 2024-02-27 12:19:37 +00:00
54liuyao ea9353b9fd merge 3.0 2024-02-04 16:04:23 +08:00
Haojun Liao 834f08a2e0
Merge pull request #24552 from taosdata/fix/3_liaohj
fix(stream): do checkpoint after fill-history task completed.
2024-01-25 16:53:11 +08:00
yihaoDeng b1ac1deedb change db opt 2024-01-19 17:39:02 +08:00
Yihao Deng 06c9b8974b rebuild stream backen from locak 2024-01-18 04:06:25 +00:00
Yihao Deng 52b9c09d6c fix mem leak 2024-01-15 11:33:03 +00:00
Yihao Deng 8a2e431094 add hard link 2024-01-15 09:03:56 +00:00
Yihao Deng f55c93b969 add hard link 2024-01-15 08:27:35 +00:00
Yihao Deng 8d24a34015 add hard link 2024-01-15 07:46:30 +00:00
Yihao Deng 1c28f53525 refactor stream code 2024-01-08 08:28:00 +00:00
Alex Duan 28238fa7dc coverage: no call function with BUILD_NO_CALL MACRO define 2023-12-31 18:29:37 +08:00
Haojun Liao 612b50c4cd
Merge pull request #24097 from taosdata/fix/TD-27834
fix stream backend crash when transfer
2023-12-18 23:13:08 +08:00
yihaoDeng 5aa575acfa fix stream backend crash when transfer 2023-12-16 18:03:32 +08:00
yihaoDeng 6f4fb506a0 fix stream backend crash when transfer 2023-12-16 17:43:41 +08:00
yihaoDeng 8045d2bda7 fix stream backend crash when transfer 2023-12-16 15:20:38 +08:00
yihaoDeng 547d797a26 fix stream backend crash when transfer 2023-12-16 15:05:27 +08:00
yihaoDeng 08cc976975 fix crash 2023-11-29 19:57:30 +08:00
yihaoDeng cc1eb2769f fix crash while quit 2023-11-28 20:29:42 +08:00
yihaoDeng 6416a6153a Merge branch '3.0' into enh/refactorBackend 2023-11-24 16:29:09 +08:00
yihaoDeng 23ae62d268 Merge branch '3.0' into enh/refactorBackend 2023-11-24 11:10:39 +08:00
yihaoDeng 50f996bbf7 Merge branch '3.0' into enh/refactorBackend 2023-11-23 21:07:58 +08:00
yihaoDeng 0eba15b4a4 Merge branch '3.0' into enh/refactorBackend 2023-11-22 10:57:41 +08:00
yihaoDeng 0d724244dc Merge branch '3.0' into enh/refactorBackend 2023-11-20 16:55:14 +08:00
yihaoDeng 734bf07317 Merge branch '3.0' into enh/refactorBackend 2023-11-20 10:48:49 +08:00
wangmm0220 3241f9bda5 fix:memory leak 2023-11-17 17:26:52 +08:00
yihaoDeng 20de2f3cb5 Merge branch '3.0' into enh/refactorBackend 2023-11-17 17:15:14 +08:00
yihaoDeng e7830bfdfd fix stream backend convert 2023-11-17 16:50:45 +08:00
yihaoDeng 286413abbb fix stream backend convert 2023-11-17 16:14:51 +08:00
yihaoDeng ccc74ef558 fix stream backend convert 2023-11-17 15:39:03 +08:00
yihaoDeng 1dbdb32dd7 fix stream backend convert 2023-11-17 11:56:22 +08:00
yihaoDeng c7c1bdef6e fix stream backend convert 2023-11-17 11:44:21 +08:00
yihaoDeng e455c4799d fix stream backend convert 2023-11-17 10:33:43 +08:00
yihaoDeng b6994413d0 fix stream backend convert 2023-11-17 10:13:39 +08:00
yihaoDeng 52d7a26c10 fix stream backend convert 2023-11-16 21:22:47 +08:00
yihaoDeng f5ef2e727f fix stream backend convert 2023-11-16 14:41:04 +08:00
yihaoDeng cee33ffb95 fix stream backend convert 2023-11-16 11:22:18 +08:00
yihaoDeng 77261068e0 fix stream backend convert 2023-11-16 11:06:55 +08:00