Commit Graph

235 Commits

Author SHA1 Message Date
Haojun Liao 1855a16981 other: merge 3.0 2023-07-05 16:12:32 +08:00
Haojun Liao 03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
Haojun Liao 42e1cd741a
Merge pull request #21935 from taosdata/fix/3_liaohj
fix(stream): fix message lost bug during pause stream.
2023-07-03 17:37:56 +08:00
Haojun Liao 9e62b9d0d2 fix(stream): fix error in extract data from inputQ. 2023-07-03 15:33:08 +08:00
Haojun Liao ceb06635fe fix(stream): fix error in pause stream. 2023-07-03 15:12:35 +08:00
Haojun Liao f84bfc96fb fix(stream): fix error in pause in stream. 2023-07-03 14:30:11 +08:00
Haojun Liao 5d4efe1198 fix(stream): fix error in pause. 2023-07-03 11:46:05 +08:00
Haojun Liao 317a7c83c7 fix(stream): fix message lost bug during pause stream. 2023-07-03 10:55:45 +08:00
Haojun Liao 622e1cb608 fix: fix coverity issue. 2023-06-29 15:54:09 +08:00
Haojun Liao 3710ea4aca refactor: do some internal refactor. 2023-06-28 09:41:08 +08:00
Haojun Liao a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
Haojun Liao 32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
Haojun Liao 437eb93a4d fix(stream): fix error while fill history exists. 2023-06-26 18:44:59 +08:00
Haojun Liao daafe240ed fix(stream): fix memory leak. 2023-06-26 14:18:47 +08:00
liuyao 870d75bf82 fill history pause&resume 2023-06-20 11:34:09 +08:00
liuyao 41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
liuyao 693942b821 trans state 2023-06-15 14:13:17 +08:00
Haojun Liao 13028744df refactor: do some internal refactor. 2023-06-15 10:24:21 +08:00
Haojun Liao 53377c2c1f fix(stream): wait for stream task completed. 2023-06-15 01:14:41 +08:00
Haojun Liao 5282492663 refactor: do some internal refactor. 2023-06-14 10:35:03 +08:00
Haojun Liao b44447e6f3 enh(stream): support restore from disk. 2023-06-14 10:19:03 +08:00
Haojun Liao 97da2a8fac fix(stream): set the fill history status. 2023-06-13 16:10:55 +08:00
Haojun Liao fb24ed161d enh(stream): set correct task status. 2023-06-12 22:48:23 +08:00
Haojun Liao 78a240be8f enh(stream): add dispatch msg. 2023-06-12 13:12:45 +08:00
Haojun Liao 69c9eda7af fix(stream): fix race condition. 2023-06-09 11:37:38 +08:00
Haojun Liao 0fd11aaefe other: add some logs. 2023-06-08 19:14:36 +08:00
Haojun Liao cb26dd9fa2 refactor(stream): do some internal refactor. 2023-06-08 10:17:21 +08:00
Haojun Liao 06cf3588da refactor: do some internal refactor. 2023-06-07 15:03:04 +08:00
Haojun Liao 044e56fc97
Merge branch '3.0' into fix/resume_mem 2023-06-03 12:19:17 +08:00
yihaoDeng 9e0392ff59 fix mem leak 2023-06-03 09:17:05 +08:00
yihaoDeng 7244ab1f6b fix mem leak 2023-06-03 08:28:21 +08:00
yihaoDeng 81fe174aa2 fix mem leak 2023-06-03 08:19:59 +08:00
Haojun Liao f1bd829977 refactor: do some internal refactor. 2023-06-02 13:10:54 +08:00
Haojun Liao 27b7d1ec88 refactor: do some internal refactor. 2023-06-02 11:17:44 +08:00
Haojun Liao 91de00597d refactor: do some internal refactor. 2023-05-31 22:12:14 +08:00
Haojun Liao ccc86f9916 refactor: do some internal refactor. 2023-05-31 19:36:34 +08:00
Haojun Liao 87deb36f8a refactor: do some internal refactor. 2023-05-31 19:36:02 +08:00
Haojun Liao a3abe25539 refactor: do some internal refactor. 2023-05-31 19:03:37 +08:00
liuyao 5ebe75599e fix pause issue 2023-05-26 14:58:39 +08:00
Haojun Liao f520de0dab refactor: adjust the module dependency. 2023-05-22 10:07:01 +08:00
Haojun Liao dcb91082f9 fix(stream): fix error. 2023-05-20 23:37:40 +08:00
Haojun Liao de44c9160c refactor: do some internal refactor. 2023-05-20 18:05:39 +08:00
Haojun Liao 3cef1e7c42 fix(stream): add some logs. 2023-05-20 15:45:07 +08:00
Haojun Liao aa7ea60bca fix(stream): update the free strategy. 2023-05-20 15:43:48 +08:00
Haojun Liao 84146e6aaa other: merge main. 2023-05-20 15:16:51 +08:00
Haojun Liao 6932c59510 other: merge main. 2023-05-20 15:09:30 +08:00
Haojun Liao 10692fde5e other: merge main. 2023-05-20 14:53:28 +08:00
Haojun Liao afc384bead fix:remove invalid assert. 2023-05-20 14:44:34 +08:00
Haojun Liao 484788a60f fix:add null ptr check. 2023-05-20 14:29:51 +08:00
Haojun Liao 336102b8c5 refactor: do some internal refactor. 2023-05-20 13:34:49 +08:00
Haojun Liao 5cbad1da3e refactor: do some internal refactor. 2023-05-20 12:20:04 +08:00
Haojun Liao 6ded3284da refactor: do some internal refactor. 2023-05-20 11:37:17 +08:00
Haojun Liao 8ab065d01e other: update some logs. 2023-05-19 23:53:23 +08:00
Haojun Liao 56e5a483dd other: update log. 2023-05-19 20:00:32 +08:00
Haojun Liao a9b7b8a5fd other: add some logs. 2023-05-19 19:26:15 +08:00
Haojun Liao e2ec8d738c other: add some logs. 2023-05-19 18:08:01 +08:00
Haojun Liao 90687bae1c refactor: do some internal refactor. 2023-05-19 15:30:50 +08:00
Haojun Liao dbd52ecffa
Merge pull request #21364 from taosdata/enh/rocksdbSstate
state merge into 3.0
2023-05-18 17:25:44 +08:00
liuyao da3fc5111e fix pause agg task 2023-05-18 15:29:41 +08:00
yihaoDeng 9380b22394 merge 3.0 2023-05-18 05:46:38 +00:00
Haojun Liao ffee5ebc61 Merge branch '3.0' into feature/3_liaohj 2023-05-17 17:47:44 +08:00
Haojun Liao 041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
Haojun Liao f3f52c0232 fix(stream): add some logs and set the wal offset to be the ended version when finishing the step2 recover stage. 2023-05-17 10:43:23 +08:00
liuyao 3c81137ffe pause source task 2023-05-16 13:43:46 +08:00
yihaoDeng 4015f544db refactor code 2023-05-15 05:45:17 +00:00
yihaoDeng 42562d388f refactor code 2023-05-15 05:29:56 +00:00
liuyao a6570a4327 Merge branch 'enh/rocksdbSstate' of https://github.com/taosdata/TDengine into enh/rocksdbSstate 2023-05-15 11:19:55 +08:00
liuyao 9258dcd740 fix:mem leak 2023-05-15 11:19:17 +08:00
Haojun Liao 8e15c64499 refactor: do some internal refactor. 2023-05-13 23:22:36 +08:00
Haojun Liao b2d141fe40 fix(stream): limit the batch size. 2023-05-11 15:07:07 +08:00
Haojun Liao b02b3117b5 refactor: do some internal refactor. 2023-05-11 10:14:29 +08:00
Haojun Liao dbd79cc80c refactor: do some internal refactor. 2023-05-10 22:22:01 +08:00
liuyao 62ccd4bf16 avoid delete data 2023-05-10 09:11:04 +08:00
Yihao Deng cb223acf82
Merge branch 'main' into enh/rocksdbSstate 2023-05-08 09:45:27 +08:00
Haojun Liao 31ac1e3eaa fix(stream): revise the input queue capacity. 2023-05-08 00:00:55 +08:00
Haojun Liao da6212bab0 other: merge main. 2023-05-06 12:51:38 +08:00
Haojun Liao 1fa4327f6c Merge branch 'main' into fix/liaohj_main 2023-05-06 10:15:23 +08:00
liuyao 76bf0aea56 opt stream input queue 2023-05-06 10:14:27 +08:00
Haojun Liao 3afc5bdfcf refactor: add some logs. 2023-05-06 10:09:51 +08:00
Haojun Liao 29fcd1b83a refactor: do some internal refactor. 2023-05-06 10:08:05 +08:00
Haojun Liao 8b12d4d3da fix(stream): secure the delete task operation. TD-1198 2023-05-05 15:02:03 +08:00
liuyao 74ab689719 opt batch num 2023-05-05 08:59:07 +08:00
liuyao d8a1f15d10 fix resum bug 2023-05-04 09:28:06 +08:00
Haojun Liao 3c61932ecc refactor: do some internal refactor. 2023-05-01 19:28:54 +08:00
Haojun Liao b7c8346b44 other: merge other branch. 2023-04-28 13:06:47 +08:00
Haojun Liao f9a64cbcd6 other: add some logs. 2023-04-28 12:58:03 +08:00
jiajingbin ebf9a13fe7 inc batch num 2023-04-27 18:15:17 +08:00
liuyao 863d30e5a9 opt tq read 2023-04-26 18:58:19 +08:00
liuyao 2533b5c5c2 op stream 2023-04-26 17:00:33 +08:00
yihaoDeng 917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
Haojun Liao b6f4cac619 fix(stream): set the correct offset version. 2023-04-21 13:35:24 +08:00
Haojun Liao 5e6c06e253 fix(stream): fix the race condition during create new stream tasks. 2023-04-20 23:21:18 +08:00
Haojun Liao 8323ad8670 enh(stream): add more check to stop stream asap. 2023-04-20 17:29:08 +08:00
Haojun Liao 930b267a75 fix(stream): set the correct start offset for stream task. 2023-04-17 22:59:00 +08:00
Haojun Liao b57c813681 other: merge feature/3_liaohj 2023-04-14 10:36:54 +08:00
Haojun Liao 70b45a4cf0 fix(stream): all data should be extracted from wal. 2023-04-13 23:22:09 +08:00
Haojun Liao 5ab54481f0 refactor: do some internal refactor. 2023-04-11 19:24:34 +08:00
yihaoDeng b24b91886a Merge branch 'dev3' into enh/rocksRevert 2023-04-11 10:59:00 +00:00
Haojun Liao 18479d8115 refactor: do some internall refactor. 2023-04-11 15:42:24 +08:00
Haojun Liao 15cceb5a5a refactor: do some internal refactors. 2023-04-11 11:53:10 +08:00