Commit Graph

921 Commits

Author SHA1 Message Date
liuyao 0e914a19c6 stream operartor checkpoint 2023-07-06 14:28:34 +08:00
Haojun Liao 5a9461a69a other: merge 3.0 2023-07-06 11:52:21 +08:00
yihaoDeng 483f9ab896 add other 2023-07-06 03:39:28 +00:00
Haojun Liao f4a3567935 other: merge 3.0 2023-07-06 11:24:30 +08:00
Haojun Liao 7a417a33b0
Merge pull request #21960 from taosdata/fix/3_liaohj
fix(stream): fix error for extract msg from inputQ
2023-07-05 17:47:18 +08:00
Haojun Liao 1855a16981 other: merge 3.0 2023-07-05 16:12:32 +08:00
Haojun Liao 03dbcbf055 refactor: do some internal refactor. 2023-07-05 15:55:55 +08:00
Haojun Liao ff2bf35603 fix(stream): fix error in set the version range for secondary scan. 2023-07-04 15:08:39 +08:00
Haojun Liao 77530e1956 refactor: record the downstream input Queue blocking time. 2023-07-04 10:58:11 +08:00
yihaoDeng e7b37486bb vnode snapshot read 2023-07-04 00:46:39 +00:00
Haojun Liao 393b36d83d Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory 2023-07-03 17:53:18 +08:00
Haojun Liao 2dbccc1573 refactor: do some internal refactor. 2023-07-03 17:52:17 +08:00
Haojun Liao 42e1cd741a
Merge pull request #21935 from taosdata/fix/3_liaohj
fix(stream): fix message lost bug during pause stream.
2023-07-03 17:37:56 +08:00
Haojun Liao 9e62b9d0d2 fix(stream): fix error in extract data from inputQ. 2023-07-03 15:33:08 +08:00
Haojun Liao 200575647c
Merge branch '3.0' into refact/fillhistory 2023-07-03 15:16:18 +08:00
Haojun Liao 20d099dfa6
Merge pull request #21901 from taosdata/fix/liaohj
fix: fix coverity issue.
2023-07-03 15:15:21 +08:00
Haojun Liao ceb06635fe fix(stream): fix error in pause stream. 2023-07-03 15:12:35 +08:00
Haojun Liao f84bfc96fb fix(stream): fix error in pause in stream. 2023-07-03 14:30:11 +08:00
Haojun Liao 5d4efe1198 fix(stream): fix error in pause. 2023-07-03 11:46:05 +08:00
Haojun Liao 317a7c83c7 fix(stream): fix message lost bug during pause stream. 2023-07-03 10:55:45 +08:00
yihaoDeng 247d3ac7ee vnode snapshot read 2023-06-30 12:05:05 +00:00
yihaoDeng 7d30a6e27a vnode snapshot read 2023-06-30 11:48:46 +00:00
yihaoDeng 9eb6d8cf1e vnode snapshot read 2023-06-29 09:35:09 +00:00
Haojun Liao 622e1cb608 fix: fix coverity issue. 2023-06-29 15:54:09 +08:00
dapan1121 3519e9170e Merge remote-tracking branch 'origin/main' into 3.0 2023-06-29 11:13:45 +08:00
yihaoDeng bb520b56e7 add checkpoint 2023-06-28 09:58:07 +00:00
yihaoDeng 6b6e237079 add checkpoint 2023-06-28 09:57:08 +00:00
Haojun Liao 78739e4bdb fix(stream): fix syntax error. 2023-06-28 14:21:11 +08:00
Haojun Liao 57fcd553f8 refactor: do some internal refactor. 2023-06-28 13:13:13 +08:00
Haojun Liao 3710ea4aca refactor: do some internal refactor. 2023-06-28 09:41:08 +08:00
Haojun Liao a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
Yihao Deng 4de7db06f9
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-27 17:57:14 +08:00
Haojun Liao 32fddeff18 fix(stream): fix error retrieve data from source task.And optimize the test cases. 2023-06-27 16:24:47 +08:00
Haojun Liao 3289ad62be other: merge 3.0 2023-06-27 11:33:40 +08:00
liuyao 71f4226e15 fix coverity san issues 2023-06-27 10:39:38 +08:00
Haojun Liao b73444b291 fix(stream): start stream task in case of scan history completing. 2023-06-27 09:44:51 +08:00
yihaoDeng 2c1fc501ff add checkpoint 2023-06-26 12:28:42 +00:00
Haojun Liao 437eb93a4d fix(stream): fix error while fill history exists. 2023-06-26 18:44:59 +08:00
dapan1121 4dae9f4eff merge main to 3.0 2023-06-26 18:43:00 +08:00
Haojun Liao daafe240ed fix(stream): fix memory leak. 2023-06-26 14:18:47 +08:00
liuyao 6b8549dea5 set table name 2023-06-26 14:14:46 +08:00
yihaoDeng 9b451bc56a add checkpoint 2023-06-25 20:14:07 +08:00
yihaoDeng 52f588955b add checkpoint 2023-06-25 20:05:42 +08:00
yihaoDeng 04ab8e19d0 Merge branch 'enh/dev30' into enh/triggerCheckPoint2 2023-06-25 19:58:45 +08:00
Haojun Liao 402c091df0 fix(stream): fix sma error. 2023-06-25 19:41:44 +08:00
yihaoDeng 74a4a89d70 add checkpoint 2023-06-25 17:59:36 +08:00
liuyao e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
yihaoDeng 832aed5e98 add checkpoint 2023-06-25 17:10:59 +08:00
yihaoDeng 0330f3b2db add checkpoint 2023-06-25 17:03:01 +08:00
yihaoDeng e36de5edf7 add checkpoint 2023-06-25 14:35:20 +08:00
Haojun Liao 0322fdc1fc fix(stream): fix memory leak. 2023-06-24 23:43:43 +08:00
Haojun Liao ceb78fdad2
Merge branch '3.0' into refact/fillhistory 2023-06-24 18:53:48 +08:00
yihaoDeng c36d14df77 add compile opt 2023-06-22 13:19:14 +08:00
yihaoDeng 2f656f3854 add checkpoint 2023-06-21 18:04:10 +08:00
yihaoDeng ff3ad6c65f add static lib to 3.0 2023-06-21 14:38:52 +08:00
yihaoDeng e5c62cfa06 add static lib 2023-06-21 12:10:42 +08:00
liuyao d23c80b12f free mem 2023-06-21 10:24:34 +08:00
yihaoDeng daa3b5238f add static lib 2023-06-20 19:29:43 +08:00
yihaoDeng d9e24566c0 add checkpoint 2023-06-20 18:32:56 +08:00
liuyao aafbdcb492 set task status 2023-06-20 15:20:04 +08:00
yihaoDeng b6d4e98e68 fix restart crash 2023-06-20 13:47:46 +08:00
yihaoDeng f1fcc1d2f1 add checkpoint 2023-06-20 11:44:51 +08:00
liuyao 870d75bf82 fill history pause&resume 2023-06-20 11:34:09 +08:00
yihaoDeng 5ccfae87d9 add checkpoint 2023-06-19 20:49:04 +08:00
yihaoDeng 548e439aa2 add checkpoint 2023-06-19 20:48:49 +08:00
liuyao 41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
yihaoDeng 0eeaab9cd3 Merge branch 'refact/fillhistory1' into refact/fillhistory 2023-06-19 13:53:37 +08:00
yihaoDeng fd85a8495a Merge branch 'dev30' into enh/triggerCheckPoint2 2023-06-17 14:17:21 +08:00
yihaoDeng b6fe5d917b refactor checkpoint 2023-06-17 14:05:49 +08:00
Haojun Liao 64365666b7 fix(stream): update the info, and do some internal refactor. 2023-06-16 16:04:43 +08:00
yihaoDeng 1e05f5c693 support fill history 2023-06-16 10:00:16 +08:00
yihaoDeng f4b9d630c0 support fill history 2023-06-16 09:36:44 +08:00
yihaoDeng 0ef8afbdaa support fill history 2023-06-16 09:32:38 +08:00
yihaoDeng 8cb8c05428 support fill history 2023-06-15 21:55:46 +08:00
yihaoDeng 9f9171719a support fill history 2023-06-15 21:29:52 +08:00
Haojun Liao 74e0138f72 Merge branch '3.0' into refact/fillhistory 2023-06-15 15:25:00 +08:00
liuyao 693942b821 trans state 2023-06-15 14:13:17 +08:00
Haojun Liao 1b9eca5ce0 other: merge main. 2023-06-15 13:03:17 +08:00
Haojun Liao 13028744df refactor: do some internal refactor. 2023-06-15 10:24:21 +08:00
Haojun Liao 53377c2c1f fix(stream): wait for stream task completed. 2023-06-15 01:14:41 +08:00
Yihao Deng 7ded6fc7a2
Merge branch '3.0' into enh/triggerCheckPoint2 2023-06-14 16:30:38 +08:00
yihaoDeng 52ca94ea6d trigger checkpoint 2023-06-14 16:20:14 +08:00
liuyao 9a3708e17b pause&resume fill history 2023-06-14 15:54:07 +08:00
Haojun Liao 7c6fbd7772 enh(stream): do some internal refactor and support secondary scan for history data. 2023-06-14 14:10:09 +08:00
yihaoDeng ee3017ed3a add static lib 2023-06-14 12:14:49 +08:00
Haojun Liao 11f0c3b336 refactor: do some internal refactor. 2023-06-14 10:46:46 +08:00
Haojun Liao 5282492663 refactor: do some internal refactor. 2023-06-14 10:35:03 +08:00
Haojun Liao b44447e6f3 enh(stream): support restore from disk. 2023-06-14 10:19:03 +08:00
Haojun Liao 97da2a8fac fix(stream): set the fill history status. 2023-06-13 16:10:55 +08:00
Haojun Liao fb24ed161d enh(stream): set correct task status. 2023-06-12 22:48:23 +08:00
yihaoDeng 83dde6a212 add trigger checkpoint 2023-06-12 14:33:08 +00:00
Haojun Liao 78a240be8f enh(stream): add dispatch msg. 2023-06-12 13:12:45 +08:00
yihaoDeng ae7d5c79e5 fix invald read/write 2023-06-12 02:24:49 +00:00
yihaoDeng a2030dc378 add trigger checkpoint 2023-06-09 12:12:51 +00:00
yihaoDeng a0c2897124 add trigger checkpoint 2023-06-09 10:46:03 +00:00
yihaoDeng d38e3835c0 opt batch write 2023-06-09 08:12:39 +00:00
yihaoDeng 06b65ce5c1 opt batch write 2023-06-09 07:49:43 +00:00
Haojun Liao 69c9eda7af fix(stream): fix race condition. 2023-06-09 11:37:38 +08:00
Haojun Liao 53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
yihaoDeng a67ef8ce91 opt batch write 2023-06-09 01:27:08 +00:00
yihaoDeng d5c0ca3163 opt batch write 2023-06-08 13:36:52 +00:00
Haojun Liao 0fd11aaefe other: add some logs. 2023-06-08 19:14:36 +08:00
Haojun Liao c9aa59cbb9 refactor: do some internal refactor. 2023-06-08 18:59:25 +08:00
Haojun Liao 6726edae0c fix(stream): add more logs. 2023-06-08 17:54:22 +08:00
yihaoDeng 9828ca9d7f add trigger checkpoint 2023-06-08 09:28:34 +00:00
Haojun Liao 6c13491428 refactor: do some internal refactor. 2023-06-08 16:55:41 +08:00
Haojun Liao 2b6ace653a refactor: do some internal refactor. 2023-06-08 16:14:27 +08:00
yihaoDeng 8b91617145 Merge branch 'enh/dv3' into enh/triggerCheckpoint 2023-06-08 07:20:41 +00:00
Haojun Liao 30eba472c3
Merge pull request #21602 from taosdata/fix/TD-24600-dv3
fix/td-24600-dv3
2023-06-08 13:42:02 +08:00
yihaoDeng 9b749b8faa change link op t 2023-06-08 02:43:44 +00:00
Haojun Liao cb26dd9fa2 refactor(stream): do some internal refactor. 2023-06-08 10:17:21 +08:00
yihaoDeng 79b628101c add trigger checkpoint 2023-06-07 14:32:22 +00:00
Haojun Liao 9abe47ff93
Merge pull request #21638 from taosdata/enh/changeLinkOpt
change link opt
2023-06-07 19:07:06 +08:00
Haojun Liao 06cf3588da refactor: do some internal refactor. 2023-06-07 15:03:04 +08:00
yihaoDeng 4fa1cc6dd3 change link opt 2023-06-07 05:26:07 +00:00
Haojun Liao 7bf07b78b2 fix(client): remove dependency 2023-06-07 11:36:01 +08:00
liuyao 1e9c4d5fac opt stream block dispatch 2023-06-07 10:45:27 +08:00
Haojun Liao 6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
yihaoDeng 66f483e51a fix invalid free 2023-06-06 02:32:06 +00:00
yihaoDeng c6242fee01 fix invalid free 2023-06-05 10:54:02 +00:00
yihaoDeng cb024ca069 fix invalid free 2023-06-05 10:52:07 +00:00
Haojun Liao 0dd933013c enh(stream): make history task for stream running. 2023-06-05 17:58:00 +08:00
yihaoDeng 63c4929089 fix invalid free 2023-06-05 08:42:00 +00:00
Haojun Liao e8549ce511 refactor: do some internal refactor. 2023-06-05 16:19:37 +08:00
Haojun Liao fcc706c45c enh(stream): refactor the fill history task. 2023-06-05 15:59:01 +08:00
yihaoDeng c77f7f65d2 fix invalid free 2023-06-05 07:32:28 +00:00
yihaoDeng 3108ecf84b fix invalid free 2023-06-05 06:38:17 +00:00
yihaoDeng 74d5f02969 fix invalid free 2023-06-05 04:56:07 +00:00
Haojun Liao 077e1a1ed4 Merge branch '3.0' into refact/fillhistory 2023-06-05 11:41:13 +08:00
Haojun Liao 044e56fc97
Merge branch '3.0' into fix/resume_mem 2023-06-03 12:19:17 +08:00
Haojun Liao cb7bb954b5
Merge pull request #21577 from taosdata/fix/TD-24515
reset unclosed window info
2023-06-03 11:21:06 +08:00
yihaoDeng 9e0392ff59 fix mem leak 2023-06-03 09:17:05 +08:00
yihaoDeng 7244ab1f6b fix mem leak 2023-06-03 08:28:21 +08:00
yihaoDeng 81fe174aa2 fix mem leak 2023-06-03 08:19:59 +08:00
yihaoDeng 5063c175f4 fix mem problem 2023-06-02 23:47:14 +08:00
yihaoDeng 3ec700e0f7 fix mem problem 2023-06-02 22:25:38 +08:00
yihaoDeng e48e485b6c update default buffer 2023-06-02 11:56:24 +00:00
yihaoDeng 6ee68331b3 update DEFAULT_BUFF 2023-06-02 11:54:36 +00:00
Haojun Liao cca69f3038 Merge branch '3.0' into fix/resume_mem 2023-06-02 18:40:48 +08:00
liuyao 17f2c3f882 reset wind info 2023-06-02 18:27:22 +08:00
yihaoDeng 449051cda6 avoid mem leak 2023-06-02 10:05:32 +00:00
wangmm0220 56f7a137ee fix:conflict 2023-06-02 15:47:53 +08:00
wangmm0220 b2f0d88639 fix:conflict 2023-06-02 15:43:35 +08:00
Haojun Liao 6a9c03309e
Merge pull request #21553 from taosdata/enh/changeRocksParam
change log level
2023-06-02 14:23:50 +08:00
Haojun Liao cce87a036f other: merge 3.0. 2023-06-02 13:34:20 +08:00
Haojun Liao f1bd829977 refactor: do some internal refactor. 2023-06-02 13:10:54 +08:00
yihaoDeng 63d9a5dcf3 avoid mem leak 2023-06-02 04:08:08 +00:00
Haojun Liao 27b7d1ec88 refactor: do some internal refactor. 2023-06-02 11:17:44 +08:00
yihaoDeng becc5c51a4 fix compatibility 2023-06-02 02:35:15 +00:00
yihaoDeng 420ae73728 Avoid creating the same ID task multiple times 2023-06-02 00:35:45 +00:00