Haojun Liao
|
11dccf12de
|
Merge pull request #21131 from taosdata/fix/liaohj_main
refactor: do some internal refactor.
|
2023-05-04 11:26:00 +08:00 |
|
Haojun Liao
|
851193a033
|
Merge pull request #21060 from taosdata/fix/TS-3222
opti:change push mgr to consume msg for subscribe
|
2023-05-04 10:16:41 +08:00 |
liuyao
|
d8a1f15d10
|
fix resum bug
|
2023-05-04 09:28:06 +08:00 |
Haojun Liao
|
3c61932ecc
|
refactor: do some internal refactor.
|
2023-05-01 19:28:54 +08:00 |
|
Haojun Liao
|
777ed1761f
|
refactor: update logs.
|
2023-04-29 18:24:46 +08:00 |
|
Haojun Liao
|
bbb8aaa0dc
|
refactor: add some logs.
|
2023-04-29 02:37:10 +08:00 |
|
Haojun Liao
|
b69137df44
|
refactor(log): add some logs.
|
2023-04-29 00:00:25 +08:00 |
|
Haojun Liao
|
c647ded0da
|
fix(stream): add some logs.
|
2023-04-28 19:47:49 +08:00 |
|
Haojun Liao
|
b7c8346b44
|
other: merge other branch.
|
2023-04-28 13:06:47 +08:00 |
|
Haojun Liao
|
f9a64cbcd6
|
other: add some logs.
|
2023-04-28 12:58:03 +08:00 |
|
liuyao
|
2984c5a758
|
merge main
|
2023-04-28 10:34:46 +08:00 |
wangmm0220
|
cce868d140
|
fix:offset encode assert error
|
2023-04-28 09:45:16 +08:00 |
|
wangmm0220
|
1ee1b0422c
|
fix:change push mgr from SArray to Hash
|
2023-04-27 23:44:27 +08:00 |
|
wangmm0220
|
db5b5c828e
|
fix:add log for msg push
|
2023-04-27 18:35:10 +08:00 |
|
Haojun Liao
|
91f9b58f9a
|
refactor: do some internal refactor.
|
2023-04-27 16:06:06 +08:00 |
|
wangmm0220
|
8677b56a4f
|
fix:assert error in tqProcessSubmitReqForSubscribe if put pHandle to array twice
|
2023-04-27 15:44:44 +08:00 |
|
Haojun Liao
|
b7040ed15e
|
enh(stream): support resume from the latest data, and do some internal refactor.
|
2023-04-27 15:07:54 +08:00 |
|
wangmm0220
|
224d87b131
|
fix:cosume null if rebalance
|
2023-04-26 17:58:14 +08:00 |
|
54liuyao
|
b79313ecd7
|
pause&resume
|
2023-04-25 16:59:09 +08:00 |
|
wangmm0220
|
d1e5d6e0f9
|
fix:pHandle->msg is not null if rebalance
|
2023-04-25 16:23:58 +08:00 |
|
wangmm0220
|
41bec8560a
|
opti:change push mgr to consume msg for subscribe
|
2023-04-25 09:58:28 +08:00 |
|
wangmm0220
|
8572f4a32f
|
opti:change push mgr to consume msg for subscribe
|
2023-04-24 19:41:30 +08:00 |
|
wangmm0220
|
77e03bfd78
|
opti:change push mgr to consume msg for subscribe
|
2023-04-23 20:14:49 +08:00 |
|
liuyao
|
641c707b37
|
pause&resume
|
2023-04-23 17:37:10 +08:00 |
|
liuyao
|
5bd8fe5441
|
feat:add pause&resume
|
2023-04-23 15:09:01 +08:00 |
|
54liuyao
|
5089528a02
|
feat:stream pause&resume
|
2023-04-23 15:08:51 +08:00 |
|
Haojun Liao
|
9cf89c6b6f
|
enh(tmq): add check for consumer Id;
|
2023-04-23 11:51:43 +08:00 |
yihaoDeng
|
917b07348c
|
Merge branch 'fix/rocksdbState' into enh/rocksRevert
|
2023-04-23 02:37:26 +00:00 |
|
Haojun Liao
|
3dbe208712
|
enh(tmq): fix memory error and add retrieve wal info as required.
|
2023-04-22 15:34:46 +08:00 |
|
wangmm0220
|
6efbcfec4b
|
Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222
|
2023-04-21 17:46:35 +08:00 |
|
Haojun Liao
|
6c641cff39
|
fix(stream): fix error in start stream tasks.
|
2023-04-21 09:37:16 +08:00 |
|
Haojun Liao
|
471abd9160
|
log: update the log.
|
2023-04-20 23:39:13 +08:00 |
|
Haojun Liao
|
5e6c06e253
|
fix(stream): fix the race condition during create new stream tasks.
|
2023-04-20 23:21:18 +08:00 |
|
Haojun Liao
|
f9801ba9c5
|
enh(stream): stop stream asap.
|
2023-04-20 18:58:07 +08:00 |
|
Haojun Liao
|
742b5ee08c
|
other: update wal logs level.
|
2023-04-20 13:42:16 +08:00 |
|
Haojun Liao
|
c654f1145d
|
enh(stream): add new msg for seek, and do some internal refactor.
|
2023-04-20 10:59:16 +08:00 |
|
wangmm0220
|
594d68b8a4
|
fix:remove lock for consume handler
|
2023-04-19 11:46:59 +08:00 |
|
wangmm0220
|
14fd2e7904
|
fix:remove lock for consume handler
|
2023-04-19 11:44:52 +08:00 |
|
wangmm0220
|
25542c26c7
|
fix:remove tmPushMsg in consumer
|
2023-04-19 10:43:13 +08:00 |
|
Haojun Liao
|
7a8dd0db45
|
refactor: update the log.
|
2023-04-18 16:08:51 +08:00 |
|
Haojun Liao
|
76becf59b7
|
Merge pull request #20947 from taosdata/feature/3_liaohj
fix(stream): set the correct initial checkpoint versions.
|
2023-04-18 11:26:48 +08:00 |
|
Haojun Liao
|
2ae05b8cf6
|
fix(stream): set the correct initial offset value.
|
2023-04-18 08:56:31 +08:00 |
|
liuyao
|
27d14f742d
|
fix:stream memory leak
|
2023-04-17 17:27:02 +08:00 |
|
Haojun Liao
|
be90d2c511
|
fix(stream): disable stream task when no tasks exist.
|
2023-04-16 23:07:54 +08:00 |
|
Haojun Liao
|
1350af5267
|
fix(stream): set the correct initial checkpoint version to restore the operators state and add check for the initial destination tables.
|
2023-04-16 22:48:22 +08:00 |
|
Haojun Liao
|
ab4b08a4b5
|
Merge branch 'feature/3_liaohj' into enh/rocksRevert
|
2023-04-14 17:44:50 +08:00 |
|
Haojun Liao
|
e0cb8aa534
|
fix(stream): don't the initial task status and do some internal refactor.
|
2023-04-14 17:43:37 +08:00 |
|
Haojun Liao
|
eb0e1f848a
|
fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask.
|
2023-04-14 12:00:09 +08:00 |
|
Haojun Liao
|
b57c813681
|
other: merge feature/3_liaohj
|
2023-04-14 10:36:54 +08:00 |
|
Haojun Liao
|
f8b672f09f
|
other: merge main.
|
2023-04-14 09:07:18 +08:00 |
|
Haojun Liao
|
4d83118ff7
|
fix(stream): fix memory leak.
|
2023-04-13 23:49:14 +08:00 |
|
Haojun Liao
|
70b45a4cf0
|
fix(stream): all data should be extracted from wal.
|
2023-04-13 23:22:09 +08:00 |
|
Haojun Liao
|
5ab54481f0
|
refactor: do some internal refactor.
|
2023-04-11 19:24:34 +08:00 |
|
Haojun Liao
|
f083697dba
|
refactor(tq): do some internal refactor.
|
2023-04-11 19:04:33 +08:00 |
|
yihaoDeng
|
b24b91886a
|
Merge branch 'dev3' into enh/rocksRevert
|
2023-04-11 10:59:00 +00:00 |
Xiaoyu Wang
|
4c04b155d5
|
merge main
|
2023-04-11 15:56:28 +08:00 |
|
Haojun Liao
|
18479d8115
|
refactor: do some internall refactor.
|
2023-04-11 15:42:24 +08:00 |
|
Haojun Liao
|
15cceb5a5a
|
refactor: do some internal refactors.
|
2023-04-11 11:53:10 +08:00 |
|
Haojun Liao
|
a4ba5401f9
|
enh(stream): set the start version of all operators.
|
2023-04-11 10:01:36 +08:00 |
|
Haojun Liao
|
7419c0bfe9
|
enh(stream): the stream will start after vnode restore being completed.
|
2023-04-10 16:56:14 +08:00 |
|
Haojun Liao
|
f5b52749c2
|
refactor: do some internal refactor.
|
2023-04-09 01:39:09 +08:00 |
|
Haojun Liao
|
871cfb4760
|
Merge pull request #20775 from taosdata/fix/TD-23450
fix:tq memory leak
|
2023-04-06 11:48:45 +08:00 |
|
Haojun Liao
|
2b2059ef18
|
Merge pull request #20534 from taosdata/fix/TD-22671
fix:error in TD-23218 & remove useless logic
|
2023-04-06 11:47:24 +08:00 |
|
yihaoDeng
|
5aff5aa93b
|
add backpressure
|
2023-04-04 12:38:56 +00:00 |
|
54liuyao
|
519e2f1cfd
|
fix:tq memory leak
|
2023-04-04 18:21:37 +08:00 |
|
yihaoDeng
|
628bb62c8a
|
add backpressure
|
2023-04-04 07:20:05 +00:00 |
|
Xiaoyu Wang
|
e9d7a099cc
|
merge main
|
2023-04-04 14:50:58 +08:00 |
|
Haojun Liao
|
d48be5c0ce
|
refactor: do some internal refactor.
|
2023-04-03 18:23:35 +08:00 |
|
Haojun Liao
|
a3ac8b647c
|
refactor: do some internal refactor.
|
2023-04-03 18:20:35 +08:00 |
|
Haojun Liao
|
482c319bee
|
refactor: do some internal refactor.
|
2023-04-03 18:07:28 +08:00 |
|
Haojun Liao
|
3ef7d43dae
|
refactor: do some internal refactor.
|
2023-04-03 17:47:48 +08:00 |
|
wangmm0220
|
2d6436c57d
|
fix:modify log & sleep 500ms if data is inserting while consume
|
2023-04-03 11:24:22 +08:00 |
|
wangmm0220
|
97b5c7abee
|
fix:merge from main
|
2023-03-31 16:20:21 +08:00 |
|
Haojun Liao
|
5f4cb41e28
|
fix(tmq): set correct start offset value.
|
2023-03-29 23:45:41 +08:00 |
|
Haojun Liao
|
56c98d7768
|
refactor: do some internal refactor.
|
2023-03-29 19:35:04 +08:00 |
|
wangmm0220
|
2243184a4d
|
fix:conflicts
|
2023-03-29 17:53:05 +08:00 |
|
wangmm0220
|
9d9ae749d1
|
opti:tmq logic & fix CI cases
|
2023-03-29 17:27:04 +08:00 |
|
wangmm0220
|
d0c55ef572
|
fix:conflicts
|
2023-03-28 18:12:13 +08:00 |
|
Haojun Liao
|
a883e57cf2
|
Merge branch 'main' into fix/liaohj
|
2023-03-28 15:07:32 +08:00 |
|
Haojun Liao
|
68f310dd48
|
refactor: do some internal refactor.
|
2023-03-28 15:05:10 +08:00 |
|
Haojun Liao
|
4fd3064fd9
|
refactor: do some internal refactor.
|
2023-03-28 14:43:37 +08:00 |
|
Haojun Liao
|
fca79dbc53
|
Merge branch 'fix/liaohj' into main
|
2023-03-28 11:20:01 +08:00 |
|
Haojun Liao
|
c158087d66
|
fix(tmq): kill the ongoing tsdb scans while transferring the ownership of vnode to other consumers.
|
2023-03-28 09:53:49 +08:00 |
|
Haojun Liao
|
5c128e2292
|
refactor: do some internal refactor.
|
2023-03-28 09:27:48 +08:00 |
|
wangmm0220
|
f1d67b6059
|
fix:conflict
|
2023-03-25 19:03:23 +08:00 |
|
wangmm0220
|
750cd8c5a4
|
fix:ci error
|
2023-03-25 16:33:47 +08:00 |
|
wangmm0220
|
9f5e435140
|
fix:conflict from main
|
2023-03-25 11:49:37 +08:00 |
|
Haojun Liao
|
b22cc82270
|
others: merge main.
|
2023-03-24 15:43:13 +08:00 |
|
wangmm0220
|
5d06474f2e
|
fix:send data batch if consume wal where subscribe db
|
2023-03-24 14:43:29 +08:00 |
|
wangmm0220
|
bf78f63e22
|
fix:send data batch if consume wal where subscribe db
|
2023-03-24 10:10:52 +08:00 |
|
wangmm0220
|
5f9c7e9a7d
|
fix:[TS-2961] consume error change from snapshot to wal for taosx
|
2023-03-22 20:14:19 +08:00 |
|
wangmm0220
|
6fae38619d
|
fix:error in TD-23218 & remove useless logic
|
2023-03-22 19:36:12 +08:00 |
|
wangmm0220
|
dd4cf0597b
|
fix:error in optimize consume logic
|
2023-03-22 17:04:02 +08:00 |
dapan1121
|
5b02af6a91
|
fix: merge main to 3.0
|
2023-03-22 16:08:16 +08:00 |
|
Haojun Liao
|
69ca2b2f7b
|
fix(tmq): do some internal refactor.
|
2023-03-21 19:40:36 +08:00 |
|
Haojun Liao
|
c3acab2070
|
fix(tmq): do some internal refactor.
|
2023-03-21 19:38:34 +08:00 |
|
Haojun Liao
|
ca29dd344f
|
other: merge main.
|
2023-03-21 14:04:52 +08:00 |
|
Haojun Liao
|
18b121c69c
|
fix(tmq): fix the invalid write and do some internal refactor.
|
2023-03-21 13:45:43 +08:00 |
|
Haojun Liao
|
ea0cc2c584
|
Merge pull request #20554 from taosdata/fix/TS-2828
fix: add retry if insert error with meta change
|
2023-03-21 09:01:22 +08:00 |
|
wangmm0220
|
f7b7320f5f
|
fix:set offset if read wal none
|
2023-03-20 16:57:45 +08:00 |
|
wangmm0220
|
f80078030c
|
fix:error in TD-23218 & remove useless logic
|
2023-03-20 15:40:01 +08:00 |
|
Haojun Liao
|
2517f9bb83
|
fix(tmq): add some logs.
|
2023-03-20 15:27:16 +08:00 |
|
Haojun Liao
|
4cb1c51d4e
|
fix(tmq): update some logs.
|
2023-03-20 13:27:58 +08:00 |
|
wangmm0220
|
a5144f0ba2
|
fix:set offset if read wal none
|
2023-03-20 10:10:07 +08:00 |
|
Haojun Liao
|
7e712a14b6
|
fix(tmq): adjust log.
|
2023-03-19 19:06:28 +08:00 |
|
Haojun Liao
|
ae5155edcf
|
fix(tmq): do some internal refactor.
|
2023-03-19 10:49:30 +08:00 |
|
wangmm0220
|
ccba1d07c6
|
fix:error in TD-23218 & remove useless logic
|
2023-03-18 18:42:49 +08:00 |
|
wangmm0220
|
7616a283e3
|
fix:error in TD-23218 & remove useless logic
|
2023-03-18 18:23:38 +08:00 |
|
wangmm0220
|
4fdef7421c
|
fix:add log for taosCreateLog error
|
2023-03-17 10:50:54 +08:00 |
|
yihaoDeng
|
3ac11ce87a
|
enh: change log
|
2023-03-16 06:17:45 +00:00 |
|
yihaoDeng
|
ef092c1cce
|
enh: add queue limit
|
2023-03-15 11:54:36 +00:00 |
|
Haojun Liao
|
32ddecc347
|
other: merge main.
|
2023-03-14 12:13:09 +08:00 |
|
Haojun Liao
|
731a2138df
|
fix(tmq): fix error in tmq.
|
2023-03-13 17:08:17 +08:00 |
|
Haojun Liao
|
7f2aae69d4
|
fix(tmq): fix error in taosx
|
2023-03-13 01:54:29 +08:00 |
|
Haojun Liao
|
564e9bb833
|
Merge branch 'main' into fix/liaohj
|
2023-03-12 14:38:38 +08:00 |
|
wangmm0220
|
0e2cf0ed73
|
fix:deal with ASSERT in tmq
|
2023-03-11 16:51:34 +08:00 |
|
wangmm0220
|
9cc7a9f504
|
fix:deal with ASSERT in tmq
|
2023-03-11 16:12:11 +08:00 |
|
Haojun Liao
|
05ddf68247
|
fix(tmq): fix invalid free.
|
2023-03-10 14:27:34 +08:00 |
|
Haojun Liao
|
d8807d3d5a
|
fix(tmq): fix memory leak.
|
2023-03-10 14:23:16 +08:00 |
|
Haojun Liao
|
691cb08e88
|
refactor: remove some unused attributes.
|
2023-03-10 09:23:03 +08:00 |
|
Haojun Liao
|
09e84884be
|
refactor: remove invalid assert
|
2023-03-09 23:31:29 +08:00 |
|
Haojun Liao
|
03aa391859
|
fix(tmq): add lock before close the tsdbreader.
|
2023-03-09 23:03:51 +08:00 |
|
54liuyao
|
5acf665b7e
|
fix:get dest table version
|
2023-03-09 19:36:10 +08:00 |
|
Haojun Liao
|
d54ae0c840
|
fix(tmq): free reader after check the reader status.
|
2023-03-07 17:49:20 +08:00 |
|
Haojun Liao
|
e8c11c58f0
|
fix(tq): add some logs.
|
2023-03-03 10:20:52 +08:00 |
|
wangmm0220
|
986ae9c4d0
|
fix:conflicts
|
2023-02-28 15:11:16 +08:00 |
|
wangmm0220
|
c638564179
|
fix:confilcts from main
|
2023-02-26 23:09:57 +08:00 |
|
Haojun Liao
|
b46098793d
|
refactor: do some internal refactor and add some logs for tmq.
|
2023-02-26 12:16:45 +08:00 |
|
Haojun Liao
|
0369ff2231
|
other: merge main.
|
2023-02-25 15:42:32 +08:00 |
|
Haojun Liao
|
514369c611
|
other: merge main
|
2023-02-25 11:06:13 +08:00 |
|
Haojun Liao
|
d6fca036e5
|
refactor: do some internal refactor.
|
2023-02-25 11:02:42 +08:00 |
|
Xiaoyu Wang
|
d6dd087f84
|
merge main
|
2023-02-25 10:29:20 +08:00 |
Xiaoyu Wang
|
5856a39827
|
Merge pull request #20123 from taosdata/fix/3.0_merge_main
merge main
|
2023-02-25 10:01:26 +08:00 |
|
wangmm0220
|
54a546931c
|
fix:optimize version logic in tmq and remove useless code
|
2023-02-24 19:22:08 +08:00 |
|
Haojun Liao
|
097723f446
|
Merge pull request #20151 from taosdata/feature/3_liaohj
fix(query): expand output buffer.
|
2023-02-24 18:56:51 +08:00 |
|
Haojun Liao
|
22aa03307c
|
fix(query): fix syntax errors on centos.
|
2023-02-24 11:38:54 +08:00 |
|
Haojun Liao
|
7821bbe0d0
|
refactor: add some logs.
|
2023-02-24 10:08:25 +08:00 |
|
Haojun Liao
|
cc393f3939
|
Merge pull request #20143 from taosdata/feature/3_liaohj
refactor: do some internal refactor.
|
2023-02-24 09:58:44 +08:00 |
|
Haojun Liao
|
bbb571a383
|
refactor: do some internal refactor.
|
2023-02-24 00:06:18 +08:00 |
|
Haojun Liao
|
dbb1e9bd59
|
refactor: do some internal refactor.
|
2023-02-23 21:59:55 +08:00 |
|
Xiaoyu Wang
|
1ab144609e
|
merge main
|
2023-02-23 14:58:22 +08:00 |
|
54liuyao
|
72e7f617e2
|
fix:disable stream
|
2023-02-23 14:24:45 +08:00 |
|
Xiaoyu Wang
|
c597de099f
|
merge main
|
2023-02-20 13:41:27 +08:00 |
|
Haojun Liao
|
7fe250412f
|
refactor:do some internal refactor.
|
2023-02-20 10:13:11 +08:00 |
|
Haojun Liao
|
8d187efc18
|
refactor:do some internal refactor.
|
2023-02-20 10:04:08 +08:00 |
|
Xiaoyu Wang
|
dc984d92f7
|
feat: compatible with older versions of wal
|
2023-02-17 09:21:07 +08:00 |
Liu Jicong
|
2a4708d82a
|
fix: save fill history state
|
2023-02-16 17:01:09 +08:00 |
|
Liu Jicong
|
b147ba2812
|
fix: handle insufficient resource
|
2023-02-14 16:18:40 +08:00 |
|
wangmm0220
|
c8d49b603d
|
fix:roll back htol length for block raw data
|
2023-02-02 17:23:01 +08:00 |
|
Liu Jicong
|
041d0d817a
|
fix: tq open
|
2023-02-02 09:11:17 +08:00 |