Commit Graph

2210 Commits

Author SHA1 Message Date
Haojun Liao 64eee4bbd2 fix(stream): add conflict check for nodeUpdate 2023-12-20 19:06:32 +08:00
Haojun Liao 849aaf8d4f fix(stream): avoid dead lock. 2023-12-20 18:07:53 +08:00
yihaoDeng d6297e26ce init backend mutex 2023-12-20 16:56:12 +08:00
Haojun Liao 43fb7cf14a other: add log info. 2023-12-20 16:04:20 +08:00
Haojun Liao 1a8583887f fix(stream): remove clear backendcache. 2023-12-20 15:35:43 +08:00
Haojun Liao 94b260a1f9 refactor: do some internal refactor. 2023-12-20 10:29:04 +08:00
Haojun Liao 17e9e84aa9 Merge branch '3.0' into fix/3_liaohj 2023-12-19 16:43:08 +08:00
Haojun Liao fee198f9ad refactor: do some internal refactor. 2023-12-19 16:21:11 +08:00
Haojun Liao ec3183b6a8 other: merge 3.0 2023-12-18 23:16:37 +08:00
Haojun Liao 612b50c4cd
Merge pull request #24097 from taosdata/fix/TD-27834
fix stream backend crash when transfer
2023-12-18 23:13:08 +08:00
Haojun Liao e734569de0 fix(stream): fix dead lock. 2023-12-18 18:42:57 +08:00
Haojun Liao bba5a4f08b other: merge main into 3.0 2023-12-18 18:26:42 +08:00
Haojun Liao ea6e78cbaa fix(stream): add async call restart, instead of sync wait. 2023-12-18 16:33:44 +08:00
Haojun Liao 79672f8e5f
Merge pull request #24107 from taosdata/fix/3_liaohj
fix(stream): add check for null ptr and leader .
2023-12-18 16:24:07 +08:00
yihaoDeng 1dea66d4f5 fix stream backend crash when transfer 2023-12-18 15:48:01 +08:00
Haojun Liao b4a1907fb7 fix(stream): add check for null ptr and leader . 2023-12-18 11:52:59 +08:00
yihaoDeng 0840e6a0d8 fix stream backend crash when transfer 2023-12-18 11:19:15 +08:00
Haojun Liao ef0cab18cb
Merge pull request #24098 from taosdata/fix/3_liaohj
fix(stream): send checkpoint complete msg to mnode when dropping it.
2023-12-17 11:03:04 +08:00
Haojun Liao 4f852704f5 fix(stream): send checkpoint complete msg to mnode when dropping it. 2023-12-17 02:06:01 +08:00
Haojun Liao 9bd80cf0f8
Merge pull request #24094 from taosdata/fix/TD-27905
Fix/td 27905
2023-12-16 18:07:17 +08:00
yihaoDeng 5aa575acfa fix stream backend crash when transfer 2023-12-16 18:03:32 +08:00
yihaoDeng 6f4fb506a0 fix stream backend crash when transfer 2023-12-16 17:43:41 +08:00
yihaoDeng 8045d2bda7 fix stream backend crash when transfer 2023-12-16 15:20:38 +08:00
yihaoDeng 547d797a26 fix stream backend crash when transfer 2023-12-16 15:05:27 +08:00
Haojun Liao 9978d8cbfd
Merge pull request #24089 from taosdata/fix/TD-27880
Fix/td 27880
2023-12-16 13:13:48 +08:00
yihaoDeng 7ab7a64eb3 Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 18:16:14 +08:00
yihaoDeng 73c7e17033 fix error case 2023-12-15 18:02:14 +08:00
yihaoDeng d8093d9f21 not do chkp when pbackend not inited 2023-12-15 11:47:44 +08:00
yihaoDeng 5189f3d15b not do chkp when pbackend not inited 2023-12-15 09:18:37 +08:00
Haojun Liao 05ca8f1784
Merge pull request #24056 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-12-14 13:52:04 +08:00
Haojun Liao 81f96603b0 refactor: do some internal refactor. 2023-12-14 09:33:51 +08:00
Minglei Jin 2dbb718101 Merge branch '3.0' into enh/TD-27119 2023-12-08 14:48:17 +08:00
yihaoDeng a82856dff7 fix mem leak 2023-12-05 20:28:12 +08:00
yihaoDeng c692f8c21c add stream backend copy 2023-12-05 18:03:58 +08:00
yihaoDeng 87c78919a9 add stream backend copy 2023-12-05 17:09:03 +08:00
54liuyao 38900d672e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-12-04 09:12:53 +08:00
Haojun Liao 48af3a9559
Merge pull request #23909 from taosdata/fix/TD-27455
fix:[TD-27644]heartbeat closed before snode close leading to snode is…
2023-12-04 09:10:00 +08:00
wangmm0220 f06117dbc9 fix:[TD-27644]heartbeat closed before snode close leading to snode is hanged 2023-12-01 17:32:29 +08:00
Haojun Liao d7a19a9179 fix(stream): fix invalid decode hbmsg and memory leaks caused by invalid hb msg. 2023-12-01 14:45:18 +08:00
Haojun Liao 4e5853d9fe refactor: do some internal refactor. 2023-12-01 12:09:49 +08:00
Haojun Liao dba58f5e38 fix(stream): fix syntax error. 2023-12-01 11:54:13 +08:00
Haojun Liao eac3cbf564 fix(stream): merge 3.0 2023-12-01 11:12:57 +08:00
Haojun Liao e753d631af fix(stream): make sure open operator only once for scan-history task. 2023-12-01 10:21:07 +08:00
Haojun Liao 1df29b5d6c fix(stream): disable the time slice usage limitation for stream task. 2023-12-01 10:20:15 +08:00
Haojun Liao 57b8388dad fix(stream): fix error. 2023-12-01 10:20:00 +08:00
Haojun Liao 468094c86a fix(stream):set failure for the related fill-history task. 2023-12-01 10:19:45 +08:00
Haojun Liao 9d735e7f8b fix(stream): reduce the sink throughput. and fix the bug in status check. 2023-12-01 10:18:25 +08:00
Haojun Liao 2b03d64850 fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-12-01 10:18:15 +08:00
Haojun Liao f54fe2d6ef refactor: do some internal refactor. 2023-12-01 10:17:15 +08:00
Haojun Liao fee9d751d4 fix(stream): fix the race condition in dispatching data. 2023-12-01 10:17:14 +08:00
Minglei Jin 49ecb1093f cos/put: new arg withcp to control resumable uploading 2023-11-30 17:20:21 +08:00
Haojun Liao 30d78c6be1 fix(stream): make sure open operator only once for scan-history task. 2023-11-30 16:10:09 +08:00
54liuyao 271311a770 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-11-30 14:33:48 +08:00
yihaoDeng 5c32680cd8 Merge branch '3.0' into enh/refactorBackend 2023-11-30 10:31:27 +08:00
Haojun Liao 130614c938
Merge pull request #23831 from taosdata/fix/3_liaohj
enh(stream/tsdb): do multiple optimization and fix some bugs.
2023-11-30 09:20:15 +08:00
yihaoDeng 08cc976975 fix crash 2023-11-29 19:57:30 +08:00
yihaoDeng 03b698d8ae change default config 2023-11-29 14:50:07 +08:00
54liuyao ae386c6e34 opt expired data 2023-11-29 11:16:56 +08:00
yihaoDeng cc1eb2769f fix crash while quit 2023-11-28 20:29:42 +08:00
yihaoDeng 08eeee0794 Merge branch '3.0' into enh/refactorBackend 2023-11-28 11:52:49 +08:00
Haojun Liao c5aba60899 fix(stream): disable the time slice usage limitation for stream task. 2023-11-28 09:28:43 +08:00
yihaoDeng a4d475b582 fix rsma 2023-11-27 20:27:53 +08:00
wangmm0220 06e2fbfb1c fix:conflicts from 3.0 2023-11-27 17:53:53 +08:00
wangmm0220 70c5d36103 opti:extract common logic from snode & vnode to tqCommon 2023-11-27 17:49:09 +08:00
Haojun Liao 6111138567 fix(stream): fix error. 2023-11-27 17:23:34 +08:00
yihaoDeng e9bec34c44 Merge branch '3.0' into enh/refactorBackend 2023-11-27 10:01:12 +08:00
yihaoDeng 6416a6153a Merge branch '3.0' into enh/refactorBackend 2023-11-24 16:29:09 +08:00
Haojun Liao 3deab3cfbf fix(stream):set failure for the related fill-history task. 2023-11-24 15:37:30 +08:00
yihaoDeng 23ae62d268 Merge branch '3.0' into enh/refactorBackend 2023-11-24 11:10:39 +08:00
yihaoDeng 50f996bbf7 Merge branch '3.0' into enh/refactorBackend 2023-11-23 21:07:58 +08:00
wangmm0220 d249892b2a fix:conflicts from 3.0 2023-11-23 20:29:46 +08:00
Haojun Liao 2e922fefc6 fix(stream): reduce the sink throughput. and fix the bug in status check. 2023-11-23 18:04:09 +08:00
yihaoDeng 6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
Haojun Liao 0a90c33b4d fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-11-23 15:49:07 +08:00
Haojun Liao de47ea6c81 other: merge 3.0. 2023-11-23 15:42:40 +08:00
Haojun Liao 1a1319908d refactor: do some internal refactor. 2023-11-23 14:25:52 +08:00
yihaoDeng 6a0501967d Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-23 14:06:04 +08:00
Haojun Liao 8ad071e69a other: merge main. 2023-11-23 10:25:51 +08:00
Haojun Liao f3355000a3 refactor: do some internal refactor. 2023-11-23 09:34:20 +08:00
Haojun Liao 00f8103262 fix(stream): fix error in generating token in bucket. 2023-11-23 09:34:19 +08:00
Haojun Liao b7347a1d64 fix(stream): remove invalid assert 2023-11-23 09:33:41 +08:00
Haojun Liao 466c80e370 fix(stream): fix bug in delay send. 2023-11-23 09:33:38 +08:00
Haojun Liao 957ce07dc4 fix(stream): fix syntax error. 2023-11-23 09:33:38 +08:00
Haojun Liao 298755cc4e fix(stream): wait for task to be normal and then send data block. 2023-11-23 09:33:37 +08:00
Haojun Liao 7b1f586d4f
Merge pull request #23762 from taosdata/fix/3_liaohj
fix(stream): fix error in generating token in bucket.
2023-11-23 09:32:14 +08:00
wangmm0220 15d75a0497 fix:spelling errors 2023-11-23 09:17:54 +08:00
Haojun Liao 4ea49fe285 fix(stream): fix the race condition in dispatching data. 2023-11-22 23:49:16 +08:00
wangmm0220 9a09e318ca opti:common message process logic in vnode and snode 2023-11-22 16:53:33 +08:00
Haojun Liao 91e7000433 Merge branch 'enh/refactorBackend' of github.com:taosdata/tdengine into enh/refactorBackend 2023-11-22 15:29:31 +08:00
Haojun Liao c96f7cf182 fix(stream): scheduler the checkpoint generating. 2023-11-22 15:17:21 +08:00
yihaoDeng 0eba15b4a4 Merge branch '3.0' into enh/refactorBackend 2023-11-22 10:57:41 +08:00
yihaoDeng 0c0d9cdd2c Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-22 10:42:30 +08:00
Haojun Liao 81d3e5737e fix(stream): fix send msg error. 2023-11-22 08:41:55 +08:00
Haojun Liao c70c54a099 fix(stream): add missing pushed data. 2023-11-22 08:41:35 +08:00
Haojun Liao b712f5e7dc refactor: do some internal refactor. 2023-11-22 08:41:17 +08:00
Haojun Liao d355b78884 fix(stream): fix invalid read. 2023-11-22 08:40:28 +08:00
Haojun Liao 75420bfefb fix(stream): fix the checkpoint msg failure. 2023-11-22 08:40:01 +08:00
yihaoDeng 947775155b fix transfer crash 2023-11-21 20:51:11 +08:00
Haojun Liao 785d91c17b
Merge pull request #23661 from taosdata/feat/TD-26060
fix: errors in snode in conditions like fill history/checkpoint/restart
2023-11-21 19:02:38 +08:00
yihaoDeng a92602b667 fix mem leak 2023-11-21 15:23:28 +08:00
Haojun Liao 2b099b11dd refactor: do some internal refactor. 2023-11-21 10:09:59 +08:00
yihaoDeng 939aa7a3cc Merge branch '3.0' into enh/refactorBackend 2023-11-20 17:33:30 +08:00
yihaoDeng 0d724244dc Merge branch '3.0' into enh/refactorBackend 2023-11-20 16:55:14 +08:00
Haojun Liao 9f8a63099c fix(stream): fix error in generating token in bucket. 2023-11-20 15:26:50 +08:00
Haojun Liao 7cfa45e95e enh(stream): add sink_quota/scan-history-idle-duration column for stream tasks. 2023-11-20 11:59:49 +08:00
yihaoDeng 734bf07317 Merge branch '3.0' into enh/refactorBackend 2023-11-20 10:48:49 +08:00
Haojun Liao 1b4f187ded
Merge pull request #23743 from taosdata/fix/pause_stream
fix(stream): remove invalid assert
2023-11-17 23:48:47 +08:00
Haojun Liao 709502ba9e fix(stream): record the check downstream failure. 2023-11-17 22:05:36 +08:00
wangmm0220 3241f9bda5 fix:memory leak 2023-11-17 17:26:52 +08:00
yihaoDeng 20de2f3cb5 Merge branch '3.0' into enh/refactorBackend 2023-11-17 17:15:14 +08:00
yihaoDeng e7830bfdfd fix stream backend convert 2023-11-17 16:50:45 +08:00
Haojun Liao 753716f1e6 fix(stream): remove invalid assert 2023-11-17 16:36:17 +08:00
yihaoDeng 286413abbb fix stream backend convert 2023-11-17 16:14:51 +08:00
Haojun Liao b12e5050ea fix(stream): remove invalid assert 2023-11-17 15:57:46 +08:00
yihaoDeng ccc74ef558 fix stream backend convert 2023-11-17 15:39:03 +08:00
yihaoDeng 1dbdb32dd7 fix stream backend convert 2023-11-17 11:56:22 +08:00
yihaoDeng c7c1bdef6e fix stream backend convert 2023-11-17 11:44:21 +08:00
yihaoDeng e455c4799d fix stream backend convert 2023-11-17 10:33:43 +08:00
yihaoDeng b6994413d0 fix stream backend convert 2023-11-17 10:13:39 +08:00
Haojun Liao 27f3723cd3
Merge pull request #23723 from taosdata/fix/3_liaohj
fix(stream): wait for task to be normal and then send data block.
2023-11-16 22:58:50 +08:00
yihaoDeng 52d7a26c10 fix stream backend convert 2023-11-16 21:22:47 +08:00
wangmm0220 a5de1b032b fix:snode upport stream task 2023-11-16 21:19:58 +08:00
Haojun Liao 3100edae5d
Merge pull request #23727 from taosdata/fix/pause_stream
fix(stream): wait for task to be normal and then send data block.
2023-11-16 19:51:33 +08:00
Haojun Liao bc779edda9 fix(stream): fix bug in delay send. 2023-11-16 17:57:13 +08:00
Haojun Liao f0f4b988a1 fix(stream): fix syntax error. 2023-11-16 17:57:13 +08:00
Haojun Liao a69b870260 fix(stream): wait for task to be normal and then send data block. 2023-11-16 17:57:13 +08:00
Haojun Liao 811d661d83 fix(stream): fix bug in delay send. 2023-11-16 17:34:47 +08:00
Haojun Liao 37d181bb9c fix(stream): fix syntax error. 2023-11-16 17:00:50 +08:00
Haojun Liao c0d3c15528 fix(stream): wait for task to be normal and then send data block. 2023-11-16 16:34:47 +08:00
yihaoDeng f5ef2e727f fix stream backend convert 2023-11-16 14:41:04 +08:00
yihaoDeng cee33ffb95 fix stream backend convert 2023-11-16 11:22:18 +08:00
yihaoDeng 77261068e0 fix stream backend convert 2023-11-16 11:06:55 +08:00
wangmm0220 a16189d2a9 fix:confilct from 3.0 2023-11-15 19:14:27 +08:00
Haojun Liao f7ee65d059 fix(stream): fix send msg error. 2023-11-15 16:31:07 +08:00
Haojun Liao d7fb9c5b6e fix(stream): add missing pushed data. 2023-11-15 16:10:26 +08:00
Haojun Liao 9d2256ec9c refactor: do some internal refactor. 2023-11-15 16:03:23 +08:00
Haojun Liao 2ca663ce66
Merge pull request #23593 from taosdata/feat/TD-21898
stream event window
2023-11-15 14:18:07 +08:00
dapan1121 dfb3feb5dc Merge remote-tracking branch 'origin/main' into merge/m23 2023-11-15 11:39:18 +08:00
Haojun Liao 51897a679f fix(stream): fix invalid read. 2023-11-15 11:21:31 +08:00
Haojun Liao 4af844ee61 fix(stream): fix the checkpoint msg failure. 2023-11-14 23:35:09 +08:00
yihaoDeng b74105727d fix mem leak 2023-11-14 20:58:35 +08:00
yihaoDeng 20e1bd9cff fix invalid read/write 2023-11-14 20:46:56 +08:00
yihaoDeng f4d6cf7c74 Merge branch '3.0' into enh/refactorBackend 2023-11-14 18:12:48 +08:00
yihaoDeng aa2c09ef5b rm dup data 2023-11-14 18:09:00 +08:00
yihaoDeng 4476e46a5f rm dup data 2023-11-14 17:43:13 +08:00
dapan1121 478c8ef87f
Merge pull request #23665 from taosdata/fix/TD-27281-3.0
fix: extend buffer of trace
2023-11-14 13:50:50 +08:00
Haojun Liao 436c7871a3
Merge pull request #23673 from taosdata/fix/3_liaohj
fix(stream): fix deadlock and do some internal refactor.
2023-11-14 11:26:54 +08:00
Haojun Liao e46a13c788
Merge pull request #23669 from taosdata/enh/stream_delay
opt max delay
2023-11-14 09:31:17 +08:00
Haojun Liao f99e22b91f fix(stream): fix deadlock. 2023-11-13 23:56:42 +08:00
yihaoDeng 68b6cc1d9d Merge branch '3.0' into enh/refactorBackend 2023-11-13 19:07:58 +08:00