Commit Graph

180 Commits

Author SHA1 Message Date
Haojun Liao 29bb5854cc fix(stream): fix error in check stream state. 2023-08-21 11:48:55 +08:00
Haojun Liao ea6574b3c7 other: merge 3.0 2023-08-17 00:07:55 +08:00
Haojun Liao 7628be236d other: merge main. 2023-08-16 09:03:54 +08:00
Haojun Liao 9551fcf7bb fix(tsdb): check the 2023-08-15 20:57:12 +08:00
Haojun Liao 13640f5f53 other 2023-08-15 20:46:06 +08:00
Haojun Liao 6d7b6fbb74 other: add some logs. 2023-08-15 20:01:53 +08:00
Haojun Liao 39079ab64a fix(stream): load term from sync model to decide if the node is restart or not 2023-08-15 15:52:06 +08:00
Haojun Liao c9f3e0b0e1 fix(stream): fix an syntax error. 2023-08-15 09:34:19 +08:00
Haojun Liao b1d35f43ba enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not. 2023-08-15 09:25:05 +08:00
Haojun Liao 2e6263b43f fix(stream): fix memory leak. 2023-08-14 17:16:11 +08:00
Haojun Liao 91710b0c0f fix(stream): 2023-08-14 14:56:17 +08:00
Haojun Liao e8c9a019a4 fix(stream): remove the invalid set of scheduler status. 2023-08-14 11:41:24 +08:00
Haojun Liao 0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao ce721a0146 fix(stream): fix error. 2023-08-12 16:32:05 +08:00
Haojun Liao a89ce1a20b fix(stream): transfer state by using data block. 2023-08-12 01:24:07 +08:00
Haojun Liao 6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
Haojun Liao f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao c10b323188 other: merge main. 2023-08-10 09:26:33 +08:00
Haojun Liao 4393375e47 fix(stream): set correct task id. 2023-08-10 02:16:04 +08:00
Haojun Liao 1e8579e8c5 fix(stream): fix other cases. 2023-08-09 16:04:48 +08:00
Haojun Liao 4c92997328 fix(stream): use streamId&taskId to identify the stream task in the stream meta. 2023-08-09 15:52:23 +08:00
Haojun Liao f8ee055641 other: merge 3.0 2023-08-08 00:19:08 +08:00
Haojun Liao 85756e4404
Merge pull request #22353 from taosdata/fix/liaohj
fix(stream): commit the update to make sure the new state of tasks will be persistent to disk.
2023-08-07 22:57:08 +08:00
Haojun Liao 2da67392c6 fix(stream): commit the update to make sure the new state of tasks will be persistent to disk. 2023-08-07 19:30:23 +08:00
Haojun Liao aea1690cd1 fix(stream): fix the stream task after checking if it is in the timer activities. 2023-08-07 17:49:36 +08:00
Haojun Liao 225c0e61dc hen(stream): support the rollback and checkdown stream tasks. 2023-08-07 16:13:39 +08:00
Haojun Liao 8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
Haojun Liao d45596bb33 fix(stream): kill task when pause the stream execution. 2023-07-31 18:07:37 +08:00
Haojun Liao 9981cecbed refactor: do some internal refactor. 2023-07-31 15:24:35 +08:00
Haojun Liao 8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao f6e07d1fdb other: merge 3.0 2023-07-29 01:32:02 +08:00
Haojun Liao 92d1dbd9ad fix(stream): set the time window filter before generating create table result. 2023-07-29 01:23:06 +08:00
Haojun Liao 936afeb5ac refactor: do internal refactor to simple the pause/resume in case of fill history exists. 2023-07-28 19:13:03 +08:00
Haojun Liao ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj
fix(stream): scan wal in step2
2023-07-28 00:42:15 +08:00
liuyao 5d21f50340 adjust history task trigger mode 2023-07-27 17:45:28 +08:00
Haojun Liao 6ff50d4eaf fix(stream): update the step2 scan wal files. 2023-07-27 16:10:55 +08:00
Haojun Liao 40fe3ef4f6 fix(stream): refactor the step2 wal scan. 2023-07-27 14:49:20 +08:00
Haojun Liao e89f530db2 fix(stream): scan wal in step2 2023-07-27 10:55:59 +08:00
Haojun Liao 728112ed89 fix(stream): set correct upstream epinfo. 2023-07-26 10:26:59 +08:00
Haojun Liao 1c1bf63e1f other: merge 3.0 2023-07-25 18:17:11 +08:00
Haojun Liao 0bdccd2681 refactor: do some internal refactor. 2023-07-25 17:31:54 +08:00
Haojun Liao a2694b9ce9 fix(stream): fix the invalid check of step2 . 2023-07-24 19:44:28 +08:00
Haojun Liao 1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
Haojun Liao 1367552f38 fix(stream): refactor the halt status to check more status. 2023-07-24 10:04:15 +08:00
Haojun Liao 0b6e1a12bb refactor: do some internal refactor. 2023-07-23 19:09:43 +08:00
Haojun Liao 4e0f7ffbf8 fix(stream): set the correct flag of pause/resume. 2023-07-23 18:49:56 +08:00
Haojun Liao bfc4a07207 fix(stream): fix memory leak. 2023-07-22 00:20:02 +08:00
Haojun Liao 16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
Haojun Liao 39ca9b537f fix(stream): fix syntax error 2023-07-21 09:43:08 +08:00
Haojun Liao bd8b811b9d refactor: do some internal refactor. 2023-07-21 09:14:25 +08:00
Haojun Liao 0d1c4f9ee2 fix(stream): fix syntax error 2023-07-21 09:13:06 +08:00
Haojun Liao db46d31ca5 fix(stream): refactor the halt function. 2023-07-21 01:32:42 +08:00
Haojun Liao c9fa170e65 refactor: do some internal refactor. 2023-07-20 16:31:46 +08:00
Haojun Liao 45cb478b31 refactor: do some internal refactor. 2023-07-20 15:36:46 +08:00
Haojun Liao aed99da6c1 refactor: refactor the stream task starting order. 2023-07-20 12:14:53 +08:00
Haojun Liao 97c44e7c18 refactor: do some internal refactor. 2023-07-19 18:42:02 +08:00
Haojun Liao a32c650248 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-19 10:05:48 +08:00
Haojun Liao 2ae95217bd fix(stream): open inputQ by default for task deployed on snode. 2023-07-19 10:05:35 +08:00
liuyao fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
Haojun Liao 9513f76172 fix(stream): set downstream task ready state. 2023-07-18 19:02:24 +08:00
Haojun Liao b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
Haojun Liao 8c8b1a6d79 fix(stream): handle block before checkpoint msg in the inputQ. 2023-07-17 10:47:05 +08:00
Haojun Liao eb7e6152ae refactor(stream): do some internal refactor. 2023-07-14 17:21:20 +08:00
Haojun Liao 813f4cb363 refactor: do some internal refactor. 2023-07-13 16:32:25 +08:00
Haojun Liao fed3803739 fix(stream): fix memory leak. 2023-07-11 19:29:52 +08:00
Haojun Liao da6a4de021 fix(stream): disable invalid set normal task status. 2023-07-11 15:12:34 +08:00
Haojun Liao a803eaee3e fix(stream): fix concurrent bug in save task meta. 2023-07-11 10:01:43 +08:00
Haojun Liao 9c30abf95b fix(stream): fix error in generating checkpoint. 2023-07-07 21:38:53 +08:00
Haojun Liao 47877898d0 enh(stream): generate the checkpoint framework. 2023-07-07 16:07:52 +08:00
Haojun Liao d7101f7109 enh(stream): support dispatch checkpoint msg. 2023-07-06 18:26:22 +08:00
Haojun Liao 03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
Haojun Liao ff2bf35603 fix(stream): fix error in set the version range for secondary scan. 2023-07-04 15:08:39 +08:00
Haojun Liao 57fcd553f8 refactor: do some internal refactor. 2023-06-28 13:13:13 +08:00
Haojun Liao a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
Haojun Liao b73444b291 fix(stream): start stream task in case of scan history completing. 2023-06-27 09:44:51 +08:00
Haojun Liao 437eb93a4d fix(stream): fix error while fill history exists. 2023-06-26 18:44:59 +08:00
Haojun Liao daafe240ed fix(stream): fix memory leak. 2023-06-26 14:18:47 +08:00
Haojun Liao 402c091df0 fix(stream): fix sma error. 2023-06-25 19:41:44 +08:00
liuyao 41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
Haojun Liao 64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
Haojun Liao 53377c2c1f fix(stream): wait for stream task completed. 2023-06-15 01:14:41 +08:00
liuyao 9a3708e17b pause&resume fill history 2023-06-14 15:54:07 +08:00
Haojun Liao 7c6fbd7772 enh(stream): do some internal refactor and support secondary scan for history data. 2023-06-14 14:10:09 +08:00
Haojun Liao 11f0c3b336 refactor: do some internal refactor. 2023-06-14 10:46:46 +08:00
Haojun Liao b44447e6f3 enh(stream): support restore from disk. 2023-06-14 10:19:03 +08:00
Haojun Liao 97da2a8fac fix(stream): set the fill history status. 2023-06-13 16:10:55 +08:00
Haojun Liao fb24ed161d enh(stream): set correct task status. 2023-06-12 22:48:23 +08:00
Haojun Liao 78a240be8f enh(stream): add dispatch msg. 2023-06-12 13:12:45 +08:00
Haojun Liao 2b6ace653a refactor: do some internal refactor. 2023-06-08 16:14:27 +08:00
Haojun Liao 06cf3588da refactor: do some internal refactor. 2023-06-07 15:03:04 +08:00
Haojun Liao 6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
Haojun Liao 0dd933013c enh(stream): make history task for stream running. 2023-06-05 17:58:00 +08:00
Haojun Liao e8549ce511 refactor: do some internal refactor. 2023-06-05 16:19:37 +08:00
Haojun Liao fcc706c45c enh(stream): refactor the fill history task. 2023-06-05 15:59:01 +08:00
Haojun Liao de44c9160c refactor: do some internal refactor. 2023-05-20 18:05:39 +08:00
Haojun Liao d8525123a2 enh(stream): add API to retrieve last ts for multi-tables. 2023-05-19 11:03:41 +08:00
Haojun Liao 041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
Haojun Liao f3f52c0232 fix(stream): add some logs and set the wal offset to be the ended version when finishing the step2 recover stage. 2023-05-17 10:43:23 +08:00
Haojun Liao da6212bab0 other: merge main. 2023-05-06 12:51:38 +08:00
Haojun Liao a1263b8b04 fix(query):fix syntax error. 2023-05-01 19:40:26 +08:00