Haojun Liao
|
53f9af06ff
|
fix(stream): fix invalid write.
|
2024-06-21 15:44:38 +08:00 |
|
Haojun Liao
|
119001e30b
|
fix(stream): update the retrieve checkpoint-trigger msg.
|
2024-06-21 15:11:48 +08:00 |
|
Haojun Liao
|
e7105edaa4
|
fix(stream): disable pause if task is un-init.
|
2024-06-21 14:14:44 +08:00 |
|
Haojun Liao
|
aea4254d40
|
fix(stream): async start task.
|
2024-06-21 10:37:06 +08:00 |
|
Haojun Liao
|
f8578b4a69
|
fix(stream): fix syntax error.
|
2024-06-21 09:34:18 +08:00 |
Haojun Liao
|
ebf2df965c
|
Update streamBackendRocksdb.c
|
2024-06-21 09:28:42 +08:00 |
|
Haojun Liao
|
2cb9644471
|
fix(stream): update the checkpoint info only when the status is normal.
|
2024-06-21 09:23:29 +08:00 |
|
Haojun Liao
|
8fd9baf6f5
|
fix(stream):synchronized upload checkpoint data to snode.
|
2024-06-21 09:11:16 +08:00 |
|
Haojun Liao
|
bf16c596a6
|
fix(stream): fix syntax error.
|
2024-06-21 08:46:09 +08:00 |
|
Haojun Liao
|
096ba251ec
|
Merge branch '3.0' into fix/3_liaohj
|
2024-06-20 23:12:18 +08:00 |
|
Haojun Liao
|
2ecc725b1a
|
fix(stream): not clear check downstream info.
|
2024-06-20 21:31:23 +08:00 |
|
Haojun Liao
|
151fc212b8
|
Merge pull request #26218 from taosdata/fix/3_liaohj
fix(stream): clear the local backend default directory
|
2024-06-20 18:26:28 +08:00 |
|
Haojun Liao
|
e1cb4e021f
|
fix(stream): clear the local backend default directory, when no checkpoint generated yet.
|
2024-06-20 16:24:02 +08:00 |
54liuyao
|
0471afb840
|
adj sream tbname cache
|
2024-06-20 13:25:36 +08:00 |
|
54liuyao
|
1b317ae578
|
adj sream tbname cache
|
2024-06-20 11:06:09 +08:00 |
|
54liuyao
|
6a3bbccda9
|
adj par tbname cache
|
2024-06-20 10:23:44 +08:00 |
|
54liuyao
|
ecfb5e5f4c
|
adj par name catch
|
2024-06-20 09:28:04 +08:00 |
|
Haojun Liao
|
da63a40796
|
Merge pull request #26188 from taosdata/fix/3_liaohj
fix(stream): fix a typo.
|
2024-06-19 14:58:21 +08:00 |
|
Haojun Liao
|
2534ce5071
|
fix(stream): fix a typo.
|
2024-06-19 10:29:01 +08:00 |
|
54liuyao
|
3ba7bc8ec5
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0
|
2024-06-18 08:41:10 +08:00 |
|
Haojun Liao
|
c3ae66c95c
|
Merge pull request #26169 from taosdata/fix/3_liaohj
fix(stream): not revise the stream id for fill-history task.
|
2024-06-18 08:38:29 +08:00 |
|
Haojun Liao
|
bca3cf4e9e
|
fix(stream): fix error in unit test.
|
2024-06-17 23:51:25 +08:00 |
|
Haojun Liao
|
c4a2756907
|
fix(stream): not revise the stream id for fill-history task.
|
2024-06-17 23:13:54 +08:00 |
|
Haojun Liao
|
f57ff96408
|
fix(stream): do some refactor.
|
2024-06-17 19:56:18 +08:00 |
|
Haojun Liao
|
60fac80345
|
fix(stream): add some logs.
|
2024-06-17 19:34:09 +08:00 |
|
54liuyao
|
00c64ed0e3
|
adj create count window state
|
2024-06-17 19:33:01 +08:00 |
|
Haojun Liao
|
0f4ffdf49a
|
fix(stream): add some info.
|
2024-06-17 18:57:31 +08:00 |
|
Haojun Liao
|
bdbcdf3465
|
refactor: add two assert.
|
2024-06-17 16:58:58 +08:00 |
|
Haojun Liao
|
848b1e19b5
|
fix(stream): fix some typo.
|
2024-06-17 14:39:46 +08:00 |
|
Haojun Liao
|
b89b2158f1
|
Merge pull request #26135 from taosdata/fix/TD-30578
check cursor for count window
|
2024-06-17 11:25:19 +08:00 |
|
54liuyao
|
4474788e36
|
adj log
|
2024-06-17 11:24:30 +08:00 |
|
54liuyao
|
2298b4eae8
|
adj log
|
2024-06-17 11:19:10 +08:00 |
|
Haojun Liao
|
b44d87475d
|
fix(test): fix syntax error.
|
2024-06-14 17:54:44 +08:00 |
|
Haojun Liao
|
42e0dff589
|
fix(stream): move the expansion of the stream task related fill-history task to the place where the fill-history task must have been deoployed already.
|
2024-06-14 17:03:04 +08:00 |
|
Haojun Liao
|
4490f40c96
|
fix(stream): do some internal refactor.
|
2024-06-14 14:43:57 +08:00 |
|
Haojun Liao
|
9af6076b4f
|
fix(stream): add the dispatch entry.
|
2024-06-14 14:42:22 +08:00 |
|
Haojun Liao
|
325ad5beb8
|
fix(stream):set correct node id
|
2024-06-13 18:25:34 +08:00 |
|
54liuyao
|
367b3b153f
|
check cursor for count window
|
2024-06-13 15:35:26 +08:00 |
|
Haojun Liao
|
0f8c0fa8cb
|
fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen.
|
2024-06-13 14:56:20 +08:00 |
|
Haojun Liao
|
9c42c90209
|
Merge pull request #26118 from taosdata/fix/3_liaohj
fix(stream): add fill-history task id in msg.
|
2024-06-12 18:03:43 +08:00 |
|
Haojun Liao
|
d06e1549f1
|
fix(stream): add fill-history task id in msg.
|
2024-06-12 15:27:19 +08:00 |
|
Haojun Liao
|
623a73f57b
|
Merge pull request #26089 from taosdata/fix/3_liaohj
fix(stream): init the node list and task list when starting mnode.
|
2024-06-12 11:34:10 +08:00 |
|
Haojun Liao
|
a41a04dc37
|
fix(stream): remove the related history task correctly.
|
2024-06-11 18:35:59 +08:00 |
|
Haojun Liao
|
00eb621825
|
fix(stream): do scan checkpoint-report in write queue.
|
2024-06-11 14:09:50 +08:00 |
|
Haojun Liao
|
20bade24c3
|
Merge branch '3.0' into fix/3_liaohj
|
2024-06-10 01:34:55 +08:00 |
|
Haojun Liao
|
cbf8b363fc
|
fix(stream): update checkpoint info by using trans.
|
2024-06-10 00:46:01 +08:00 |
|
Haojun Liao
|
895ee30cf3
|
Merge branch '3.0' into enh/opt_prj
|
2024-06-09 23:51:38 +08:00 |
|
Haojun Liao
|
cbd9f86a34
|
Merge pull request #26065 from taosdata/fix/3_liaohj
fix(stream): always load the data for fill-history scan.
|
2024-06-07 14:01:50 +08:00 |
|
Haojun Liao
|
c4447d6873
|
fix(stream): flush executor state for those with only one task for a stream.
|
2024-06-07 12:44:38 +08:00 |
|
Haojun Liao
|
1e47cb7eba
|
other: update the test case.
|
2024-06-07 11:15:23 +08:00 |
|
Haojun Liao
|
385e1a8b0d
|
refactor: do some internal refactor.
|
2024-06-06 23:55:54 +08:00 |
|
Haojun Liao
|
88e77d6bc6
|
fix(stream): remove expired stream in buf.
|
2024-06-06 23:54:48 +08:00 |
|
Haojun Liao
|
420cbc36e5
|
other: fix syntax error.
|
2024-06-06 17:40:17 +08:00 |
|
Haojun Liao
|
52e090634e
|
fix(stream): transfer state before send checkpoint-trigger msg to downstream tasks.
|
2024-06-06 17:21:23 +08:00 |
|
Haojun Liao
|
29d34200b5
|
other: fix coverity issues.
|
2024-06-05 13:39:46 +08:00 |
|
Haojun Liao
|
c529ecc7d2
|
Merge pull request #25734 from taosdata/fix/3_liaohj
fix(stream): update the checkpoint info for followers, and some internal refactor.
|
2024-06-05 13:38:51 +08:00 |
|
Haojun Liao
|
bf9a5135fb
|
fix(stream): disable timer for checkpoint-ready msg in rsma.
|
2024-06-05 00:13:57 +08:00 |
|
Haojun Liao
|
4fc21cc8b0
|
refactor: do some internal refactor.
|
2024-06-04 10:08:18 +08:00 |
|
Haojun Liao
|
407f79cfa6
|
fix(stream): fix dead-lock.
|
2024-06-03 19:14:45 +08:00 |
|
Haojun Liao
|
3b3ed1c30c
|
fix(stream): add monitor for checkpoint-ready msg recv status.
|
2024-06-03 16:45:37 +08:00 |
|
54liuyao
|
ca7e1344e1
|
adj stream count state buff
|
2024-06-03 15:22:12 +08:00 |
|
Haojun Liao
|
31317c4895
|
fix(stream): set the checkpoint ready info for only one task in stream.
|
2024-06-01 23:20:43 +08:00 |
|
Haojun Liao
|
2a8270f9c8
|
fix(stream): track the checkpoint-ready msg on the upstream tasks.
|
2024-06-01 18:26:45 +08:00 |
|
Haojun Liao
|
76b43dc072
|
fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request.
|
2024-05-31 14:32:55 +08:00 |
|
Haojun Liao
|
ee4e4c0e6d
|
refactor: do some internal refactor.
|
2024-05-31 09:17:20 +08:00 |
|
Haojun Liao
|
0946f25e5f
|
fix(stream): fix syntax error.
|
2024-05-29 22:36:22 +08:00 |
|
Haojun Liao
|
becc4cb368
|
enh(stream): limit the concurrent started checkpoint tasks.
|
2024-05-29 19:29:26 +08:00 |
|
Haojun Liao
|
46ca55ac74
|
fix(stream): avoid deadlock.
|
2024-05-29 15:20:35 +08:00 |
|
Haojun Liao
|
27ac6ca16e
|
fix(stream): desc the ref for checkpoint-trigger timer.
|
2024-05-29 14:12:14 +08:00 |
|
Haojun Liao
|
09efbad117
|
fix(stream): drop related fill history task.
|
2024-05-29 11:16:26 +08:00 |
|
Haojun Liao
|
a9abe78eab
|
other: comment invalid sleep for test purpose
|
2024-05-29 09:16:37 +08:00 |
|
Haojun Liao
|
225dfb1a93
|
enh(stream): check checkpoint-trigger msg every 100ms.
|
2024-05-29 00:30:42 +08:00 |
|
Haojun Liao
|
d1d868f239
|
refactor: do some internal refactor and set the pActiveInfo for rsma.
|
2024-05-29 00:08:29 +08:00 |
|
Haojun Liao
|
8d54d45054
|
fix(stream): fix error found by CI.
|
2024-05-28 17:30:14 +08:00 |
|
Haojun Liao
|
cc318d7e2d
|
enh(stream): sink task does not initialize the backend.
|
2024-05-28 11:34:04 +08:00 |
|
Haojun Liao
|
bd514fe4d3
|
other: merge rows.
|
2024-05-28 11:13:09 +08:00 |
|
Haojun Liao
|
be107b204c
|
enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes.
|
2024-05-28 09:54:22 +08:00 |
|
Haojun Liao
|
03a5230bd7
|
Merge pull request #25923 from taosdata/fix/TD-30028
fix(stream): fix memory leak if write failed.
|
2024-05-25 00:40:14 +08:00 |
|
Haojun Liao
|
01fb950cbc
|
refactor: add some logs.
|
2024-05-24 11:44:17 +08:00 |
|
Haojun Liao
|
89fb56e77d
|
other: merge 3.0
|
2024-05-24 11:41:51 +08:00 |
|
Haojun Liao
|
28032dfd39
|
fix(stream): fix memory leak if write failed.
|
2024-05-24 11:39:02 +08:00 |
|
Haojun Liao
|
499ca6c23b
|
Merge pull request #25910 from taosdata/fix/TD-30028
fix(stream): check if outputQ is full before execute the scan history task. if it is full, idle for 5 sec.
|
2024-05-24 10:25:17 +08:00 |
|
Haojun Liao
|
8c0a74e7b2
|
fix(stream):adjust the idle time.
|
2024-05-24 09:19:09 +08:00 |
Yihao Deng
|
a021b62c04
|
fix backen crash
|
2024-05-23 12:02:01 +00:00 |
|
Haojun Liao
|
eb1f09f47f
|
refactor: do some internal refactor.
|
2024-05-23 17:25:22 +08:00 |
|
Haojun Liao
|
0c61fb20d6
|
fix(stream): check if outputQ is full before execute the scan history task. if it is full, idle for 5 sec.
|
2024-05-23 17:22:29 +08:00 |
|
Haojun Liao
|
cc7d5d7a91
|
Merge branch '3.0' into fix/TD-30028
|
2024-05-23 16:16:59 +08:00 |
|
Haojun Liao
|
cb6e03d985
|
Merge pull request #25896 from taosdata/fix/TD-30208
check delete mark
|
2024-05-23 15:48:01 +08:00 |
|
Haojun Liao
|
69567799eb
|
fix(stream): initialization tasks before start all tasks.
|
2024-05-23 15:45:59 +08:00 |
|
Haojun Liao
|
61b08259ba
|
fix(stream): initialization fill-history tasks before start all other stream tasks.
|
2024-05-23 15:38:16 +08:00 |
|
54liuyao
|
0b9e3c9115
|
check delete mark
|
2024-05-23 10:05:24 +08:00 |
|
Haojun Liao
|
f146ae4198
|
fix(stream):
|
2024-05-22 19:46:24 +08:00 |
|
Haojun Liao
|
96e1487787
|
refactor: do some internal refactor.
|
2024-05-22 16:57:09 +08:00 |
|
Haojun Liao
|
142bc9046d
|
fix(stream): fix memory leak.
|
2024-05-22 15:13:00 +08:00 |
|
Haojun Liao
|
be39044b66
|
fix(stream): add more info
|
2024-05-22 11:04:54 +08:00 |
wangmm0220
|
f21eeae56c
|
fix:[TD-30180]error in judging if groupId already added to the end of table name
|
2024-05-21 16:57:00 +08:00 |
|
Haojun Liao
|
3baa4169e6
|
Merge branch '3.0' into fix/3_liaohj
|
2024-05-20 10:31:53 +08:00 |
Hongze Cheng
|
9527b66db1
|
Merge pull request #25841 from taosdata/feat/ly_opt_checkpointYh
Feat/ly_opt_checkpointYh
|
2024-05-20 10:10:28 +08:00 |
|
Haojun Liao
|
130f7a292d
|
fix(stream): reset the error code when trying to restore checkpoint.
|
2024-05-19 22:36:09 +08:00 |
|
Haojun Liao
|
f74fad7e60
|
fix(query): fix error in refactor.
|
2024-05-19 17:17:40 +08:00 |
|
Haojun Liao
|
0fe2686b63
|
fix(query): fix bugs caused by refactor.
|
2024-05-19 14:55:51 +08:00 |
|
Haojun Liao
|
7a90e68667
|
fix(query): fix bugs caused by refactor.
|
2024-05-19 13:55:46 +08:00 |
|
Haojun Liao
|
82c10fd709
|
fix(query): fix bugs caused by refactor.
|
2024-05-19 13:40:09 +08:00 |
|
Haojun Liao
|
1e5098f676
|
fix(query): fix bugs caused by refactor.
|
2024-05-19 13:32:30 +08:00 |
|
Yihao Deng
|
bb47a8df33
|
opt checkpoint
|
2024-05-17 15:30:04 +08:00 |
|
Yihao Deng
|
b0377a2e3a
|
opt checkpoint
|
2024-05-17 14:21:04 +08:00 |
wade zhang
|
b299ff0449
|
Merge pull request #25798 from taosdata/fix/backendInvalidFree
Fix/backendInvalidFree
|
2024-05-17 13:46:18 +08:00 |
|
Yihao Deng
|
a7b434075b
|
opt checkpoint
|
2024-05-16 20:16:59 +08:00 |
|
Yihao Deng
|
2359e0e61b
|
opt checkpoint
|
2024-05-16 18:07:57 +08:00 |
|
Yihao Deng
|
ef5d9316bb
|
Merge branch 'enh/refactoBackendCp' into feat/ly_opt_checkpoint
|
2024-05-16 16:30:27 +08:00 |
|
54liuyao
|
7b50663240
|
optimize stream operator checkpoint
|
2024-05-16 16:24:58 +08:00 |
|
Yihao Deng
|
f33bf898b4
|
fix invalid free
|
2024-05-15 16:56:02 +08:00 |
|
Yihao Deng
|
01e9ae6299
|
fix invalid free
|
2024-05-15 16:53:42 +08:00 |
|
Haojun Liao
|
2b44211928
|
fix(test): update test case and fix a typo.
|
2024-05-15 14:52:59 +08:00 |
|
Haojun Liao
|
abd90c733a
|
fix(stream): remove backend files only after the in-memory task is dropped.
|
2024-05-15 14:24:35 +08:00 |
|
Yihao Deng
|
b1c50e23b6
|
refactor checkpoint
|
2024-05-15 11:38:43 +08:00 |
|
Haojun Liao
|
042ed3caff
|
fix(stream): fix invalid unlock.
|
2024-05-15 10:08:56 +08:00 |
|
Haojun Liao
|
610aa80e65
|
fix(stream): init backend for fill-history task.
|
2024-05-15 00:08:38 +08:00 |
|
Haojun Liao
|
4eacf86843
|
fix(tsdb): fix deadlock when stopping reader.
|
2024-05-14 19:20:19 +08:00 |
|
Haojun Liao
|
241f8b3d2e
|
fix(tsdb): fix deadlock when stopping reader.
|
2024-05-14 18:05:13 +08:00 |
|
Haojun Liao
|
1ccf743215
|
fix(stream): fix syntax error.
|
2024-05-14 16:19:21 +08:00 |
|
Haojun Liao
|
4fa8cfbffe
|
fix(stream): fix syntax error.
|
2024-05-14 15:42:37 +08:00 |
|
Haojun Liao
|
6898eba6ed
|
fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks.
|
2024-05-14 14:34:31 +08:00 |
|
Haojun Liao
|
fb248b2682
|
fix(stream): not save the stream task for rsma.
|
2024-05-13 17:26:39 +08:00 |
|
Haojun Liao
|
3dfffe9113
|
fix(stream): async load and start stream tasks.
|
2024-05-13 15:31:26 +08:00 |
|
Haojun Liao
|
d214dd5cdd
|
fix(stream): fix error in downloading remote backup checkpoint data.
|
2024-05-11 16:19:11 +08:00 |
|
Haojun Liao
|
f8d8061260
|
refactor: do some internal refactor.
|
2024-05-11 11:08:51 +08:00 |
|
Haojun Liao
|
d7e1f37cd4
|
Merge branch '3.0' into fix/3_liaohj
|
2024-05-11 10:28:12 +08:00 |
|
Haojun Liao
|
370c255128
|
refactor: do some internal refactor.
|
2024-05-11 10:27:55 +08:00 |
|
Haojun Liao
|
11ed1f54b3
|
refactor: do some internal refactor.
|
2024-05-11 10:09:23 +08:00 |
|
Haojun Liao
|
7f93ec2c53
|
fix(stream): update the checkpoint info for followers, and some internal refactor.
|
2024-05-11 09:37:02 +08:00 |
|
Haojun Liao
|
845fcfa247
|
Merge pull request #25700 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
|
2024-05-09 15:14:46 +08:00 |
|
Haojun Liao
|
6721ec3cd8
|
refactor: do some internal refactor.
|
2024-05-09 14:06:25 +08:00 |
|
Haojun Liao
|
2ee8f7da32
|
Merge pull request #25695 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
|
2024-05-09 13:36:56 +08:00 |
|
Haojun Liao
|
db848f7e6b
|
refactor: do some internal refactor.
|
2024-05-09 10:15:34 +08:00 |
|
Haojun Liao
|
6693efaa85
|
refactor: do some internal refactor.
|
2024-05-09 10:11:37 +08:00 |
|
Haojun Liao
|
a450deb60b
|
Merge pull request #25679 from taosdata/fix/3_liaohj
fix(query): set correct row length for rowid sort.
|
2024-05-09 10:10:27 +08:00 |
|
Haojun Liao
|
4f59754a63
|
refactor: do some internal refactor.
|
2024-05-08 16:22:02 +08:00 |
|
Haojun Liao
|
a1a198630a
|
Merge pull request #25666 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
|
2024-05-08 15:33:53 +08:00 |
|
Haojun Liao
|
bc04093d11
|
refactor: do some internal refactor.
|
2024-05-08 13:54:25 +08:00 |
|
Haojun Liao
|
9ce8f6953d
|
refactor: do some internal refactor.
|
2024-05-08 13:52:20 +08:00 |
|
Haojun Liao
|
b26656fd1c
|
Merge pull request #25661 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
|
2024-05-08 13:03:13 +08:00 |
|
Haojun Liao
|
c43fbf6fee
|
refactor: do some internal refactor.
|
2024-05-08 11:21:24 +08:00 |
|
Haojun Liao
|
cdeb4462fb
|
refactor: do some internal refactor.
|
2024-05-07 23:43:21 +08:00 |
|
Haojun Liao
|
55a630911d
|
Merge pull request #25653 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
|
2024-05-07 23:12:30 +08:00 |
|
Haojun Liao
|
b6debd985b
|
fix(stream): always return success if repeatly recv checkpoint source msg.
|
2024-05-07 16:33:08 +08:00 |
|
54liuyao
|
a5213e4cf9
|
adj delete mark
|
2024-05-07 15:01:45 +08:00 |
|
Haojun Liao
|
0e0f98eb8d
|
refactor: do some internal refactor.
|
2024-05-07 10:50:44 +08:00 |
|
Haojun Liao
|
bbd423f666
|
refactor: do some internal refactor.
|
2024-05-07 09:46:12 +08:00 |
|
Haojun Liao
|
3b43b8f8c7
|
Merge pull request #25646 from taosdata/fix/3_liaohj
fix(stream): set global close flag in the streamMeta.
|
2024-05-06 22:19:23 +08:00 |
|
Haojun Liao
|
18c66a5491
|
refactor: do some internal refactor.
|
2024-05-06 18:17:38 +08:00 |
|
Haojun Liao
|
c982f6ac80
|
refactor: do some internal refactor.
|
2024-05-06 17:08:11 +08:00 |
|
Haojun Liao
|
7ad7ef7cfc
|
refactor: do some internal refactor.
|
2024-05-06 17:03:41 +08:00 |
|
Haojun Liao
|
46e9fe6f97
|
fix(stream): set global close flag in the streamMeta.
|
2024-05-06 17:03:09 +08:00 |
|
Haojun Liao
|
d879c7c967
|
fix(stream): set global close flag in the streamMeta.
|
2024-05-06 16:40:49 +08:00 |
|
Yihao Deng
|
8061688e79
|
fix rocskdb init failed
|
2024-05-06 03:22:28 +00:00 |
|
Haojun Liao
|
05a204dd6c
|
refactor: do some internal refactor.
|
2024-04-30 19:30:56 +08:00 |
|
Haojun Liao
|
732e52d64d
|
refactor: do some internal refactor, and add some logs.
|
2024-04-30 19:11:58 +08:00 |
|
Haojun Liao
|
94a0f9ab8f
|
other: merge 3.0
|
2024-04-30 17:12:46 +08:00 |
|
Haojun Liao
|
ed610d293f
|
fix(stream): close task if it's in checkdown stream procedure.
|
2024-04-30 17:09:37 +08:00 |
|
Haojun Liao
|
629502e12e
|
refactor: do some internal refactor.
|
2024-04-30 17:00:51 +08:00 |
|
Haojun Liao
|
f2bc93b78d
|
Merge pull request #25598 from taosdata/fix/3_liaohj
refactor(stream): opt stream sink perf.
|
2024-04-30 16:59:22 +08:00 |
|
Haojun Liao
|
973ca3be80
|
refactor: do some internal refactor.
|
2024-04-30 09:51:40 +08:00 |
|
Haojun Liao
|
cd6261c8d4
|
refactor: do some internal refactor.
|
2024-04-30 09:49:11 +08:00 |
|
Yihao Deng
|
3fd6770c81
|
avoid invalid read
|
2024-04-29 05:52:54 +00:00 |
|
Yihao Deng
|
b54198ba4a
|
avoid invalid read
|
2024-04-29 03:18:38 +00:00 |
|
Yihao Deng
|
97aadd3aa7
|
avoid invalid read
|
2024-04-29 03:17:33 +00:00 |
|
Yihao Deng
|
2beb46c9df
|
Merge branch '3.0' into fix/TD-29844
|
2024-04-29 01:27:20 +00:00 |
|
Haojun Liao
|
6c93fe5593
|
fix(stream): fix dead lock.
|
2024-04-28 18:35:00 +08:00 |
|
Haojun Liao
|
b990632e8d
|
fix(stream): fix dead lock.
|
2024-04-28 18:29:18 +08:00 |
|
Haojun Liao
|
bf5d523116
|
fix(stream): disable the exec of complete check status in timer thread.
|
2024-04-28 17:57:34 +08:00 |
|
Yihao Deng
|
9e19c52924
|
Remove unnecessary memory free in uploadCheckpointData function
|
2024-04-28 06:50:54 +00:00 |
|
Yihao Deng
|
fac8530580
|
fix invalid read
|
2024-04-28 06:50:33 +00:00 |
|
Yihao Deng
|
af567ea2cb
|
fix invalid read
|
2024-04-28 06:47:31 +00:00 |
|
Haojun Liao
|
57ee97814f
|
fix(stream): fix failed to launch timer bug.
|
2024-04-28 14:29:18 +08:00 |
|
Haojun Liao
|
3c5ca17737
|
Merge branch '3.0' into fix/3_liaohj
|
2024-04-28 13:57:16 +08:00 |
|
Haojun Liao
|
6ea4823f1e
|
fix(stream): update the timeout measurement.
|
2024-04-28 11:14:10 +08:00 |
|
Haojun Liao
|
b2d8260f14
|
refactor: do some internal refactor.
|
2024-04-28 10:05:22 +08:00 |
|
Haojun Liao
|
8adaeb59a3
|
refactor: do some internal refactor.
|
2024-04-28 09:50:21 +08:00 |
|
Haojun Liao
|
384efdc185
|
Merge pull request #25531 from taosdata/fix/3_liaohj
fix(stream):add ref for task in check rsp monitor timer.
|
2024-04-28 09:22:00 +08:00 |
|
Haojun Liao
|
a33e7b2eb3
|
refactor: do some internal refactor.
|
2024-04-26 22:22:54 +08:00 |
|
Haojun Liao
|
2d1e9ba631
|
fix(stream):add ref for task in check rsp monitor timer.
|
2024-04-26 19:11:57 +08:00 |
|
Haojun Liao
|
324072fed8
|
Merge pull request #25525 from taosdata/fix/3_liaohj
fix(stream): update stream task meta info.
|
2024-04-26 18:15:09 +08:00 |
|
Haojun Liao
|
b1b3246066
|
fix(stream): update the checkpoint executed transId range.
|
2024-04-26 17:03:01 +08:00 |
|
Haojun Liao
|
5f5595a6ab
|
Merge pull request #25517 from taosdata/fix/3_liaohj
fix(stream): add task node into update list if it is timeout for more than 100sec.
|
2024-04-26 17:00:23 +08:00 |
|
Haojun Liao
|
8b53f76691
|
fix(stream): discard the repeatly recv checkpoint-source msg.
|
2024-04-26 15:56:34 +08:00 |
|
Haojun Liao
|
3961903fea
|
refactor: do some internal refactor.
|
2024-04-26 14:00:03 +08:00 |
|
Haojun Liao
|
88af030966
|
refactor: do some internal refactor.
|
2024-04-26 13:53:41 +08:00 |
|
Haojun Liao
|
19b0de6582
|
fix(stream): add task node into update list if it is timeout for more than 100sec.
|
2024-04-26 13:49:40 +08:00 |
|
Hongze Cheng
|
e678d2508f
|
Merge pull request #25462 from taosdata/enh/supportTmqInterface
Enh/support tmq interface
|
2024-04-26 13:05:33 +08:00 |
|
Haojun Liao
|
c565e31638
|
Merge pull request #25510 from taosdata/fix/3_liaohj
fix(stream): handle disorder node Update trans Id.
|
2024-04-26 12:44:00 +08:00 |
|
Haojun Liao
|
e5069669cb
|
refactor: do some internal refactor.
|
2024-04-26 11:16:40 +08:00 |
|
Haojun Liao
|
a0e68c2bfb
|
refactor: do some internal refactor.
|
2024-04-26 11:14:53 +08:00 |
|
Haojun Liao
|
ae4e2bf671
|
fix(stream): suppress some warnings by ide.
|
2024-04-26 10:00:54 +08:00 |
|
Haojun Liao
|
fae53efed9
|
fix(stream): add some logs for retry for notready/timeout downstream tasks. and do some internal refactor.
|
2024-04-26 09:58:20 +08:00 |
|
Haojun Liao
|
77961ea791
|
fix(stream): handle disorder node Update trans Id.
|
2024-04-26 09:45:42 +08:00 |
|
Haojun Liao
|
5df720910e
|
Merge pull request #25497 from taosdata/fix/TD-29672
save stream tbname
|
2024-04-26 09:14:24 +08:00 |
|
Haojun Liao
|
b3d2ccec83
|
Merge pull request #25483 from taosdata/fix/3_liaohj
fix(query): add ts in cache_scan_operator if pk exists and only retri…
|
2024-04-25 22:32:26 +08:00 |
|
54liuyao
|
0551c1189d
|
save stream tbname
|
2024-04-25 18:46:13 +08:00 |
|
54liuyao
|
220a31d02f
|
save stream tbname
|
2024-04-25 17:48:32 +08:00 |
|
54liuyao
|
dbe3b25618
|
save stream tbname
|
2024-04-25 17:37:59 +08:00 |
|
Haojun Liao
|
addd2d2a84
|
fix(stream): fix syntax error.
|
2024-04-25 17:06:15 +08:00 |
|
Haojun Liao
|
cd8baa7ba0
|
fix(stream): add log for update task epset, set correct update flag if epset updated.
|
2024-04-25 16:39:11 +08:00 |
|
Yihao Deng
|
d06cf49182
|
Fix memory leak in copyDataAt function
|
2024-04-25 07:44:31 +00:00 |
|
Haojun Liao
|
d1ecfe5cf3
|
refactor: do some internal refactor.
|
2024-04-25 14:24:20 +08:00 |
|
Haojun Liao
|
b698b8be96
|
fix(stream): pass the address of tmr_h id
|
2024-04-25 09:57:08 +08:00 |
|
54liuyao
|
2a72ceadd1
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0
|
2024-04-24 18:57:22 +08:00 |
|
54liuyao
|
85cd290aa5
|
opt bloom filter
|
2024-04-24 18:40:39 +08:00 |
|
54liuyao
|
3300bf04c1
|
opt bloom filter
|
2024-04-24 17:27:24 +08:00 |
|
Haojun Liao
|
a37667968f
|
refactor: do some internal refactor.
|
2024-04-23 19:49:14 +08:00 |
|
Haojun Liao
|
82cde46614
|
fix(stream): fix memory leak.
|
2024-04-23 19:48:50 +08:00 |
|
Haojun Liao
|
10c792efa2
|
fix(stream):add related fill-history task to be done, when check-rsp moniting quit.
|
2024-04-23 16:55:47 +08:00 |
|
Haojun Liao
|
1adf59e7d8
|
fix(stream): do check when task is paused, and do some internal refactor.
|
2024-04-23 13:53:23 +08:00 |
|
Haojun Liao
|
34048937a4
|
fix(stream): check req id to remove expired check rsp .
|
2024-04-23 10:03:01 +08:00 |
|
Haojun Liao
|
315b86cf66
|
fix(stream): save the epset if task epset updated.
|
2024-04-22 23:52:45 +08:00 |
|
Haojun Liao
|
cf7ffb82e0
|
fix(stream): init before send msg, to avoid race condition.
|
2024-04-22 17:18:01 +08:00 |
|
Haojun Liao
|
97c1f88b22
|
refactor: do some internal refactor.
|
2024-04-22 14:06:11 +08:00 |
|
Haojun Liao
|
6c76790e6c
|
fix(stream): fix a typo
|
2024-04-22 14:03:13 +08:00 |
|
Haojun Liao
|
a8fac441be
|
fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure.
|
2024-04-22 14:02:31 +08:00 |
|
Haojun Liao
|
b903872a4e
|
fix(stream): correct count down the ready tasks.
|
2024-04-19 19:02:34 +08:00 |
|
Haojun Liao
|
adfc1fb927
|
Merge branch '3.0' into fix/3_liaohj
|
2024-04-19 16:24:53 +08:00 |
|
Haojun Liao
|
3baa47f266
|
fix(stream): record the task check downstream failed info.
|
2024-04-19 16:21:05 +08:00 |
|
Hongze Cheng
|
fc5c84422e
|
Merge pull request #25256 from taosdata/feat/TD-24834
Feat/td 24834
|
2024-04-19 13:34:37 +08:00 |
|
Haojun Liao
|
3769da535e
|
fix(stream): re-send checkmsg to downstream for fixed dispatch type.
|
2024-04-19 10:00:47 +08:00 |
|
Haojun Liao
|
815d12fd77
|
fix(stream): set check downstream completed for sink task.
|
2024-04-18 18:36:02 +08:00 |
|
Haojun Liao
|
4802cd1ddf
|
Merge branch '3.0' into fix/3_liaohj
|
2024-04-18 17:53:30 +08:00 |
|
Hongze Cheng
|
614f1f5a9d
|
Merge pull request #25379 from taosdata/feat/addCompress
Feat/add compress
|
2024-04-18 17:10:34 +08:00 |
|
Haojun Liao
|
e7dee4ac63
|
refactor(stream): refactor check msg retry procedure and be tolerant to the dnode disconnection during check downstream tasks.
|
2024-04-18 15:55:21 +08:00 |
|
Haojun Liao
|
ac84a5f82b
|
refactor: do some internal refactor.
|
2024-04-17 21:57:09 +08:00 |
|
Haojun Liao
|
ddf98ae0c2
|
refactor: do some internal refactor.
|
2024-04-17 18:04:02 +08:00 |
|
Yihao Deng
|
a461b24ac9
|
add compress
|
2024-04-17 09:37:23 +00:00 |
dm chen
|
1196ea72da
|
Merge branch '3.0' into feat/TD-24834
|
2024-04-17 17:13:29 +08:00 |
|
Yihao Deng
|
07008747ed
|
add compress
|
2024-04-17 09:09:30 +00:00 |
|
Yihao Deng
|
2547f29de9
|
add compress
|
2024-04-17 08:59:38 +00:00 |
|
Yihao Deng
|
f8dcf806d2
|
add compress
|
2024-04-17 08:58:10 +00:00 |
|
Yihao Deng
|
7cec8836b1
|
add compress
|
2024-04-17 08:39:43 +00:00 |
|
Yihao Deng
|
15f9e1e29e
|
add compress
|
2024-04-17 08:38:46 +00:00 |
|
Yihao Deng
|
1363cd0a71
|
add compress
|
2024-04-17 08:33:40 +00:00 |
|
Yihao Deng
|
0f629bebda
|
add compress
|
2024-04-17 07:35:00 +00:00 |
|
Yihao Deng
|
1d9b65226e
|
add compress
|
2024-04-17 07:02:55 +00:00 |
kailixu
|
74afb8deae
|
chore: solve conflicts
|
2024-04-17 10:52:34 +08:00 |
|
Haojun Liao
|
13e14d0f55
|
fix(stream): add return.
|
2024-04-17 10:48:22 +08:00 |
yihaoDeng
|
40390ad918
|
add compress
|
2024-04-17 10:23:17 +08:00 |
|
yihaoDeng
|
2da8645d36
|
add compress
|
2024-04-17 10:22:54 +08:00 |
|
yihaoDeng
|
469e9ba069
|
add compress
|
2024-04-17 10:20:11 +08:00 |
|
Haojun Liao
|
8bdd43c305
|
fix(stream): wait for 50ms when no token in bucket for sink task.
|
2024-04-16 14:42:21 +08:00 |
|
dm chen
|
aedec5ead7
|
Merge branch '3.0' into feat/TD-24834
|
2024-04-16 11:35:49 +08:00 |
|
Haojun Liao
|
13bd296d58
|
Merge branch '3.0' into fix/3_liaohj
|
2024-04-15 18:53:48 +08:00 |
|
Haojun Liao
|
1ac192c069
|
fix(stream): keep the original tsdb scan version range.
|
2024-04-15 18:41:38 +08:00 |
|
dm chen
|
4d660d89c0
|
Merge branch '3.0' into feat/TD-24834
|
2024-04-15 15:12:32 +08:00 |
|
Haojun Liao
|
665107ad3a
|
enh(stream): add more info in meta table.
|
2024-04-15 14:23:37 +08:00 |
|
Haojun Liao
|
15c18af221
|
fix(stream): fix init error.
|
2024-04-13 18:27:38 +08:00 |
|
54liuyao
|
1d42e927c6
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0
|
2024-04-11 15:35:42 +08:00 |
|
Haojun Liao
|
5fac6ea9c1
|
Merge pull request #25327 from taosdata/fix/TD-29516
set ts column index for function
|
2024-04-11 15:28:11 +08:00 |
|
kailixu
|
3738ce9e10
|
chore: solve conflicts of sql.c
|
2024-04-11 11:05:58 +08:00 |
|
54liuyao
|
b2cefa8039
|
release state buff
|
2024-04-11 09:10:16 +08:00 |
|
Haojun Liao
|
fabb986aa8
|
fix(stream): fix stack overflow, caused by print epset.
|
2024-04-10 19:54:33 +08:00 |
|
Haojun Liao
|
e261023ee6
|
fix(stream): add lock, and fix race condition.
|
2024-04-10 18:42:44 +08:00 |
|
54liuyao
|
c6d492d3fd
|
set ts column index for function
|
2024-04-10 17:41:59 +08:00 |
|
Haojun Liao
|
f23a8a37bc
|
refactor: do some internal refactor.
|
2024-04-10 16:43:02 +08:00 |
|
54liuyao
|
e161556f51
|
set ts column index for function
|
2024-04-10 15:35:25 +08:00 |
|
54liuyao
|
53265e9e09
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0
|
2024-04-08 17:24:09 +08:00 |
|
Haojun Liao
|
fb58ca8592
|
fix(stream): not wait for the timer stopped.
|
2024-04-07 18:53:25 +08:00 |
|
kailixu
|
b4c8375cb9
|
chore: solve conflicts
|
2024-04-07 14:53:05 +08:00 |
|
Haojun Liao
|
f82505ba16
|
fix(stream): remove invalid assert
|
2024-04-07 14:06:25 +08:00 |
|
Haojun Liao
|
1b343e662c
|
fix(stream): retry stop timer for trigger tmr.
|
2024-04-07 10:18:01 +08:00 |
|
Haojun Liao
|
94f703889d
|
fix(stream): remove invalid assert.
|
2024-04-03 12:42:53 +08:00 |
|
54liuyao
|
537395e845
|
Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0
|
2024-04-03 09:54:10 +08:00 |
|
Haojun Liao
|
3619518d54
|
fix(stream): add logs.
|
2024-04-02 21:57:21 +08:00 |
|
Haojun Liao
|
dcc97472d3
|
fix(stream): add strict check for checkpoint-trigger msg dispatach rsp confirmation flag.
|
2024-04-02 21:53:50 +08:00 |
|
Haojun Liao
|
5184e444df
|
Merge branch '3.0' into fix/3_liaohj
|
2024-04-02 18:45:49 +08:00 |
|
Haojun Liao
|
24559725da
|
fix(stream): add lock for when set checkpoint dispatch msg.
|
2024-04-02 18:45:30 +08:00 |
|
Haojun Liao
|
bcb4d62996
|
Merge pull request #25229 from taosdata/fix/3_liaohj
fix(stream): reset the ready upstream counter after task-reset.
|
2024-04-02 10:05:33 +08:00 |
|
54liuyao
|
204c5acefe
|
Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0
|
2024-04-02 09:10:52 +08:00 |
|
Haojun Liao
|
9ca84091df
|
fix(stream): reset the ready upstream counter after task-reset.
|
2024-04-01 16:31:10 +08:00 |
|
Haojun Liao
|
c6294200ea
|
Merge pull request #25211 from taosdata/fix/TD-28032
fix:same subtable same partition by leads to same table name in stream
|
2024-04-01 15:49:47 +08:00 |
|
dmchen
|
b9deb71fc5
|
basic function
|
2024-03-29 02:48:49 +00:00 |
|
wangmm0220
|
8e2a2414c0
|
fix:same subtable same partition by leads to same table name in stream
|
2024-03-28 13:48:46 +08:00 |
dapan1121
|
ca0f790f3e
|
Merge pull request #25179 from taosdata/mark/3.0
fix:decode task error if task version is smaller than 2
|
2024-03-28 13:19:45 +08:00 |
|
Haojun Liao
|
5157d5b97d
|
fix(stream): fix invalid read.
|
2024-03-27 15:53:24 +08:00 |
|
wangmm0220
|
c2ef380166
|
Merge branch 'mark/3.0' of https://github.com/taosdata/TDengine into mark/3.0
|
2024-03-27 15:05:04 +08:00 |
|
wangmm0220
|
8e45bebd66
|
fix:decode task error if task version is smaller than 2
|
2024-03-26 15:16:09 +08:00 |
|
Haojun Liao
|
a11b2c614e
|
fix(stream): not return error when failing to load stream task meta.
|
2024-03-25 23:49:26 +08:00 |
|
wangmm0220
|
6aaac7c0dc
|
fix:decode task error if task version is smaller than 2
|
2024-03-25 17:57:13 +08:00 |
|
54liuyao
|
a02535c3ab
|
Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/ly-TS-4243-3.0
|
2024-03-25 11:15:21 +08:00 |
|
54liuyao
|
a60f390cdc
|
stream primary key
|
2024-03-21 10:50:07 +08:00 |
|
Haojun Liao
|
65e4048f5d
|
Merge branch '3.0' into fix/3_liaohj
|
2024-03-19 15:36:07 +08:00 |
|
Haojun Liao
|
7bdabc309b
|
Merge branch '3.0' into fix/3_liaohj
|
2024-03-18 14:16:15 +08:00 |
|
Haojun Liao
|
6763ac9110
|
fix(stream):adjust current offset by using the scanning version, not the processed version in WAL.
|
2024-03-18 09:12:53 +08:00 |
|
Haojun Liao
|
f28e994409
|
Merge pull request #25091 from taosdata/fix/3_liaohj
fix(stream): transfer state before do checkpoint
|
2024-03-14 17:59:13 +08:00 |
|
Haojun Liao
|
cc0b32b1f8
|
fix(stream): transfer state before do checkpoint, to avoid the retrieve and deadlock by using waiting .
|
2024-03-14 16:13:41 +08:00 |
|
Haojun Liao
|
15663ab450
|
Merge pull request #25084 from taosdata/fix/3_liaohj
fix(tsdb): set strict varchar length check.
|
2024-03-14 11:16:03 +08:00 |
|
Haojun Liao
|
190b02dd1a
|
fix(stream):set correct version for sink/agg tasks.
|
2024-03-14 10:04:43 +08:00 |
|
54liuyao
|
ef32863f07
|
stream event window mem leak
|
2024-03-13 19:44:59 +08:00 |
|
54liuyao
|
c13338d965
|
stream event window mem leak
|
2024-03-13 16:16:44 +08:00 |
|
Haojun Liao
|
aef11bf3a8
|
fix(stream): add one more status for check.
|
2024-03-08 00:25:08 +08:00 |
|
yihaoDeng
|
3416d68433
|
add coverity scan
|
2024-03-05 21:02:20 +08:00 |
|
Haojun Liao
|
3aa2e24d78
|
Merge pull request #25006 from taosdata/fix/nullcheck
fix(stream): set the dest epset from mnode, and set the retry error
|
2024-03-05 19:46:41 +08:00 |
|
Haojun Liao
|
45e779d464
|
refactor: do some internal refactor.
|
2024-03-05 15:48:58 +08:00 |
|
Haojun Liao
|
cdfbbc2985
|
fix(stream): set the dest epset from mnode, and set the retry error code for trans.
|
2024-03-05 13:28:34 +08:00 |