Commit Graph

15633 Commits

Author SHA1 Message Date
Haojun Liao fe5e48b87d fix(stream): remove redundant include. 2023-08-15 09:26:35 +08:00
Haojun Liao b1d35f43ba enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not. 2023-08-15 09:25:05 +08:00
Haojun Liao ff17763ed6
Merge pull request #22417 from taosdata/mark/tmq
opti:wal logic
2023-08-15 09:16:29 +08:00
dapan1121 8fc0f1bbd6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-15 09:00:53 +08:00
dapan1121 31b0bcd716 fix: taosd crash issue 2023-08-15 08:51:23 +08:00
dapan1121 f9f74eaaf4
Merge pull request #22406 from taosdata/fix/TD-24684
fix: remove ins_modules table
2023-08-15 08:42:08 +08:00
Haojun Liao 9e3733a02c
Merge pull request #22358 from taosdata/feat/TD-24559
feat:[TD-24559]support geomety type in schemaless
2023-08-14 22:06:41 +08:00
Haojun Liao a334547726 fix(stream): fix an syntax error. 2023-08-14 19:28:36 +08:00
Haojun Liao 1a08ffc79f fix(stream): check error. 2023-08-14 19:27:09 +08:00
slzhou 012248b681 fix: move the only ctb idx flag to logical plan 2023-08-14 19:26:53 +08:00
Haojun Liao 5d3232d275 fix(stream): fix an syntax error. 2023-08-14 18:14:32 +08:00
liuyao d1c289823f refactor stream session window 2023-08-14 17:52:39 +08:00
liuyao 4b435e2cbf format code 2023-08-14 17:52:39 +08:00
liuyao 3043c7f09f refactor operator 2023-08-14 17:52:39 +08:00
liuyao 57a020edfc refact stream interval 2023-08-14 17:52:39 +08:00
liuyao 9d1e5a512d add stream task id 2023-08-14 17:52:39 +08:00
dapan1121 6a78053b51 feat: add hint supporting 2023-08-14 17:21:15 +08:00
Haojun Liao 2e6263b43f fix(stream): fix memory leak. 2023-08-14 17:16:11 +08:00
slzhou f9c897221c fix: move the setting of onlyCtbIdx to front end 2023-08-14 16:30:31 +08:00
yihaoDeng cf9f9ab471 rebuild index at tag0 2023-08-14 08:01:20 +00:00
slzhou 57d1957dee enhance: tag scan code refactoring 2023-08-14 15:57:27 +08:00
wangjiaming0909 5c276fa547 fix: make kill query work for sysscanoperator 2023-08-14 15:21:58 +08:00
Haojun Liao a1e554fbf3 refactor: exec directly not asynchnoized. 2023-08-14 15:05:13 +08:00
Haojun Liao 91710b0c0f fix(stream): 2023-08-14 14:56:17 +08:00
Haojun Liao ead04964fd Merge branch 'main' into fix/liaohj 2023-08-14 12:11:15 +08:00
Haojun Liao e8c9a019a4 fix(stream): remove the invalid set of scheduler status. 2023-08-14 11:41:24 +08:00
dapan1121 c2417eb5cd
Merge pull request #22404 from taosdata/fix/TD-25621-3.0
fix: dup read lock on windows
2023-08-14 11:37:05 +08:00
wade zhang f63d1f98b2
Merge pull request #22150 from taosdata/test/toolsBuild
test: add build
2023-08-14 11:22:30 +08:00
Haojun Liao 2806fe1c56 fix(stream): ignore the related stream task destory msg in transfer state. 2023-08-14 10:58:24 +08:00
dapan1121 6ce28e8886 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-14 10:49:56 +08:00
dapan1121 ae0426717a feat: add hint option 2023-08-14 10:47:56 +08:00
slzhou 646e52ae7f Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-14 10:19:36 +08:00
wangmm0220 dd0bc0e050 fix:heap use after free 2023-08-14 09:42:55 +08:00
dapan1121 b4b9a12d61 fix: memory issue 2023-08-14 09:06:21 +08:00
Haojun Liao 01ac99a651
Merge pull request #22413 from taosdata/fix/liaohj
refactor: refactor the transfer state procedure.
2023-08-13 23:28:18 +08:00
Haojun Liao 98f40325e9 fix(stream): fix memory leak. 2023-08-13 20:02:15 +08:00
slzhou 6688d70ba4 fix: fix planner test error 2023-08-13 18:46:55 +08:00
Haojun Liao a81cc9aebf fix(stream): fix the error when no agg tasks exist. 2023-08-13 17:31:09 +08:00
Haojun Liao 0d38f389ab refactor: do some internal refactor. 2023-08-13 16:25:35 +08:00
Haojun Liao 0e189f70a1 refactor 2023-08-12 19:44:44 +08:00
Haojun Liao 03c26a9d6d refactor 2023-08-12 19:16:20 +08:00
Haojun Liao afe9b848a5 fix(tsdb): check the 2023-08-12 18:54:39 +08:00
Haojun Liao 09da6c6840 refactor: do some internal refactor. 2023-08-12 18:51:20 +08:00
Haojun Liao 75e6fb0f16 refactor: do some internal refactor. 2023-08-12 18:47:01 +08:00
Haojun Liao 075b5e9481 refactor: do some internal refactor. 2023-08-12 18:41:54 +08:00
Haojun Liao a0534ee715 refactor: do some internal refactor. 2023-08-12 18:40:09 +08:00
Haojun Liao 8f9de93cf0 refactor: do some internal refactor. 2023-08-12 18:37:36 +08:00
Haojun Liao 30c2a9c619 refactor: do some internal refactor. 2023-08-12 18:27:51 +08:00
Haojun Liao 0d0e30b764 fix(stream): fix the error. 2023-08-12 17:20:10 +08:00
Haojun Liao ce721a0146 fix(stream): fix error. 2023-08-12 16:32:05 +08:00
slzhou f83bfec067 fix: change only meta ctb idx back to false 2023-08-12 08:28:25 +08:00
slzhou edd2fa4f35 fix: pass compilation and simple test 2023-08-12 08:17:43 +08:00
Haojun Liao a89ce1a20b fix(stream): transfer state by using data block. 2023-08-12 01:24:07 +08:00
Haojun Liao f24b22000f enh(stream): stop stream task before redistribute vnodes. 2023-08-11 23:46:53 +08:00
wangmm0220 f1baed79b4 opti:rm useless code 2023-08-11 20:22:51 +08:00
wangmm0220 deda4b9eed opti:wal logic 2023-08-11 19:26:17 +08:00
dapan1121 20b3f8c1aa
Merge pull request #22402 from taosdata/fix/TS-3799
fix: add time window boundary check before interpolation
2023-08-11 17:59:55 +08:00
slzhou 47d2f9ad6d fix: first run without tag cond 2023-08-11 17:52:52 +08:00
dapan1121 c9656d3f77 fix: fix memory issues 2023-08-11 17:39:41 +08:00
wangmm0220 7b22d37f12 fix:lost data when consumer db 2023-08-11 17:25:43 +08:00
slzhou 6530658815 fix: continue coding 2023-08-11 17:05:59 +08:00
slzhou 42a4f364c1 Merge branch 'szhou/tag-scan-opt' of github.com:taosdata/TDengine into szhou/tag-scan-opt 2023-08-11 16:48:49 +08:00
Haojun Liao 87c7e4c0fe fix(stream): not launch stream tasks when restarting the stream tasks. 2023-08-11 16:19:46 +08:00
yihaoDeng 6e6eb05d5c Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 08:03:02 +00:00
Haojun Liao e984affe90 fix(stream): disable the stream in the followers nodes. 2023-08-11 15:58:15 +08:00
dapan1121 8987553d9c fix: remove ins_modules 2023-08-11 15:56:38 +08:00
shenglian zhou a0c62d215d enhance: tag scan only meta ctb idx backend modification 2023-08-11 14:54:43 +08:00
shenglian zhou 1c7f854a71 enhance: add only meta ctb index to tag scan physi node 2023-08-11 14:47:28 +08:00
wangmm0220 25e32bbf7c fix:offset error in tmq & add test cases 2023-08-11 14:25:12 +08:00
Haojun Liao 4afe603c6e fix(stream): fix error. 2023-08-11 14:17:09 +08:00
shenglian zhou 7c39bc9890 fix: some minor modifications 2023-08-11 13:50:41 +08:00
kailixu 1d089fe085 fix: dup read lock on windows 2023-08-11 11:34:57 +08:00
yihaoDeng 99be2836b2 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:50:12 +00:00
Haojun Liao 1e636a2ef9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-08-11 10:37:40 +08:00
Haojun Liao 6a9826cf6e enh(stream): update the stream task epset. 2023-08-11 10:37:25 +08:00
Ganlin Zhao 1afbde7d2f fix: add time window boundary check before interpolation 2023-08-11 10:19:32 +08:00
yihaoDeng ba4ce9db02 Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer 2023-08-11 02:15:07 +00:00
Haojun Liao d9bc881fb3
Merge pull request #22384 from taosdata/mark/tmq
fix:offset error in tmq & add test cases
2023-08-11 10:00:08 +08:00
yihaoDeng 32983a11e1 add log and fix crash 2023-08-10 20:34:00 +08:00
shenglian zhou 20f5e2af5b continue coding and save work 2023-08-10 17:40:54 +08:00
shenglian zhou b2e615d4e7 enhance: tag scan cursor based block 2023-08-10 17:30:01 +08:00
dapan1121 1f3eacba17
Merge pull request #22365 from taosdata/enh/TD-25366
enh: remove timeline dependence of certain functions
2023-08-10 17:08:05 +08:00
Haojun Liao 8341fa6878
Merge pull request #22395 from taosdata/fix/liaohj
fix(stream): execute the stream task directly
2023-08-10 16:21:49 +08:00
wangmm0220 78fd70202c fix:offset error in tmq & add test cases 2023-08-10 16:18:53 +08:00
dapan1121 791e453219
Merge pull request #22392 from taosdata/fix/TS-3811-m
fix: sma option for show create table
2023-08-10 15:21:31 +08:00
Haojun Liao 8890fa5781 fix(stream): execute the stream task directly, instead of executing it in a asynchronized way. 2023-08-10 15:13:49 +08:00
yihaoDeng b2fb94d7f8 Merge branch 'enh/chkpTransfer' of https://github.com/taosdata/TDengine into enh/chkpTransfer 2023-08-10 14:57:25 +08:00
yihaoDeng ea00f676fc Merge branch 'enh/chkpTransfer' of https://github.com/taosdata/TDengine into enh/chkpTransfer 2023-08-10 14:57:12 +08:00
yihaoDeng 100d2240c3 support reopen stream state 2023-08-10 06:35:25 +00:00
dm chen dd271bca6d
Merge pull request #22394 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-10 14:14:22 +08:00
Haojun Liao a713b37f35 fix(stream): add more logs. 2023-08-10 14:07:29 +08:00
liuyao e2481599b0 fix mem leak 2023-08-10 13:58:46 +08:00
kailixu 700d9a6d68 fix: sma option for show create table 2023-08-10 13:02:34 +08:00
Minglei Jin 33967b243b
Merge branch '3.0' into fix/TD-25010-3 2023-08-10 12:14:01 +08:00
Haojun Liao f633c7fe2b other: merge 3.0. 2023-08-10 11:56:30 +08:00
Haojun Liao b658608541
Merge pull request #22388 from taosdata/fix/3_liaohj
other: merge main.
2023-08-10 11:43:02 +08:00
dapan1121 ce1b294c51 fix: memory leak issues 2023-08-10 11:29:14 +08:00
kailixu 1ce8d06032 fix: proj col compare func 2023-08-10 09:57:57 +08:00
yihaoDeng ef247cdb1d support reopen stream state 2023-08-10 01:49:26 +00:00
Haojun Liao c10b323188 other: merge main. 2023-08-10 09:26:33 +08:00
Haojun Liao 4393375e47 fix(stream): set correct task id. 2023-08-10 02:16:04 +08:00
Haojun Liao 0cf8144952 fix(stream): fix the invalid key used by remove data in stream meta hash table. 2023-08-09 22:28:23 +08:00
yihaoDeng a20b299f9b support reopen stream state 2023-08-09 13:06:10 +00:00
yihaoDeng 19ac9054d0 support reopen stream state 2023-08-09 12:47:49 +00:00
Haojun Liao 7e3f1d92fc Merge branch 'main' into fix/liaohj 2023-08-09 19:43:24 +08:00
wangmm0220 1f5532fd67 fix:offset error in tmq & add test cases 2023-08-09 19:41:22 +08:00
Haojun Liao d34b9af054 enh(stream): create update stream trans. 2023-08-09 19:38:13 +08:00
Hui Li 10f5d223bb
Merge pull request #22370 from taosdata/FIX/TD-25605-3.0
enh: check if disk space sufficient at primary dir with tfs
2023-08-09 18:32:07 +08:00
yihaoDeng 1db15da4e1 support reopen stream state 2023-08-09 09:50:49 +00:00
yihaoDeng 6fdcd82a33 support reopen stream state 2023-08-09 09:19:03 +00:00
Ganlin Zhao 11823580c7 fix test cases 2023-08-09 17:13:31 +08:00
yihaoDeng f3cf907d5a support reopen stream state 2023-08-09 09:07:13 +00:00
yihaoDeng a336a7b1a4 support reopen stream state 2023-08-09 09:06:22 +00:00
yihaoDeng a619b8f5be rm duplicate para 2023-08-09 08:58:49 +00:00
Haojun Liao 1e8579e8c5 fix(stream): fix other cases. 2023-08-09 16:04:48 +08:00
Haojun Liao 4c92997328 fix(stream): use streamId&taskId to identify the stream task in the stream meta. 2023-08-09 15:52:23 +08:00
Haojun Liao 1d649bccb6
Merge pull request #22372 from taosdata/fix/TD-25626
fix taosd cannot quit
2023-08-09 15:46:14 +08:00
yihaoDeng 92b247aae8 support reopen stream state 2023-08-09 07:36:00 +00:00
Ganlin Zhao 70e4b4f44e remove unique need of primary ts 2023-08-09 14:30:34 +08:00
yihaoDeng bbcfa9ab03 support reopen stream state 2023-08-09 06:10:40 +00:00
dapan1121 81439ba0cf fix: memory invalid read and perf issue 2023-08-09 13:31:38 +08:00
Haojun Liao 3cdb16352c fix(stream): avoid launching check downstream when failed to add stream task into stream meta. 2023-08-09 12:03:14 +08:00
dapan1121 1d0624bbf1 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-09 10:32:13 +08:00
dapan1121 1aac643a9b enh: support single vnode join 2023-08-09 10:30:35 +08:00
Haojun Liao f3c5f20ee2 enh(stream): add timer to check the node changing. 2023-08-09 10:25:16 +08:00
yihaoDeng c43a6b272c support reopen stream state 2023-08-09 02:09:50 +00:00
yihaoDeng fb7dec00e1 support reopen stream state 2023-08-09 01:50:49 +00:00
yihaoDeng cfb5247e30 change var name 2023-08-09 00:46:18 +00:00
yihaoDeng bcc7df2dda fix taosd cannot quit 2023-08-08 10:04:41 +00:00
Benguang Zhao e4d16e594c enh: check if disk space sufficient at primary dir with tfs 2023-08-08 17:53:11 +08:00
Haojun Liao db92546cf7 fix(stream): remove invalid filter. 2023-08-08 16:09:33 +08:00
Ganlin Zhao bea4346232 enh: remove timeline dependence of certain functions 2023-08-08 16:05:21 +08:00
yihaoDeng ac11537fc8 support reopen stream state 2023-08-08 07:21:47 +00:00
Haojun Liao 17c6143471 fix(stream): check more status when handling the state transfer. 2023-08-08 15:08:11 +08:00
slzhou dff1f4954f Merge branch '3.0' of github.com:taosdata/TDengine into szhou/ts-3706 2023-08-08 13:28:17 +08:00
slzhou 9b4bdd819b enhance: subquery can use expr primary key +/- value as primary key 2023-08-08 13:24:06 +08:00
Haojun Liao a0dcec5890 enh(stream): add function handler for hb message. 2023-08-08 11:23:19 +08:00
dapan1121 68e0fb924a
Merge pull request #22165 from taosdata/feat/3.0/TD-25271
feature: optimize interval with limit
2023-08-08 10:34:02 +08:00
Haojun Liao db8ce3de3b other: merge main. 2023-08-08 10:17:51 +08:00
Haojun Liao 327e13c3f7 fix(stream): fix the syntax error. 2023-08-08 10:07:28 +08:00
Haojun Liao d6d63ec54c fix(stream): add more check. 2023-08-08 09:54:49 +08:00
Haojun Liao e89d3c18d6 fix(stream): remove invalid check. 2023-08-08 09:54:46 +08:00
Haojun Liao ac00e1d520 fix(stream): fetch all data before paused and dump to sink node. 2023-08-08 09:54:43 +08:00
Haojun Liao 0e3fd5277d fix(stream): dump results to sink node before paused. 2023-08-08 09:54:39 +08:00
dm chen 70a598f072
Merge pull request #22355 from taosdata/3.0
merge 3.0 to TD-22970
2023-08-08 09:53:07 +08:00
Haojun Liao 1e680d4df1 fix(stream): ignore the sink task transfer state. 2023-08-08 09:52:19 +08:00
Haojun Liao 3bcc7ed83e fix(stream): transfer the state for agg tasks. 2023-08-08 09:52:04 +08:00
Haojun Liao d43cb3fcdf fix(stream): kill task when pause the stream execution. 2023-08-08 09:51:21 +08:00
Haojun Liao ca2183acfd refactor: do some internal refactor. 2023-08-08 09:50:40 +08:00
Haojun Liao 143f39b6f7 fix(stream): set the correct end key of delete block. 2023-08-08 09:49:43 +08:00
Haojun Liao 82ab81810b refactor: do some internal refactor. 2023-08-08 09:40:21 +08:00
Haojun Liao 51e0b903b0 refactor: do some internal refactor. 2023-08-08 09:36:42 +08:00
dapan1121 0ea34286cf
Merge pull request #22301 from taosdata/feat/3.0/TD-25394
feat: optimize table merge scan when 1 child table
2023-08-08 09:31:39 +08:00
Haojun Liao af3a87560a refactor: do some refactor. 2023-08-08 09:11:41 +08:00
Haojun Liao f8ee055641 other: merge 3.0 2023-08-08 00:19:08 +08:00
Haojun Liao ad3e231b2f
Merge pull request #22350 from taosdata/fix/3_liaohj
other: merge main and fix bugs in stop stream tasks.
2023-08-07 22:57:13 +08:00
Haojun Liao 85756e4404
Merge pull request #22353 from taosdata/fix/liaohj
fix(stream): commit the update to make sure the new state of tasks will be persistent to disk.
2023-08-07 22:57:08 +08:00
yihaoDeng 6b73fc9c06 support reopen stream state 2023-08-07 13:56:53 +00:00
yihaoDeng 80e78e054d support reopen stream state 2023-08-07 11:39:32 +00:00
wangmm0220 864d07e1bc feat:[TD-24559]support geomety type in schemaless 2023-08-07 19:39:06 +08:00
dapan1121 a95295774a enh: end table scan 2023-08-07 19:35:33 +08:00
Haojun Liao 2da67392c6 fix(stream): commit the update to make sure the new state of tasks will be persistent to disk. 2023-08-07 19:30:23 +08:00
dapan1121 443c6ef318
Merge pull request #22333 from taosdata/fix/TD-25546
fix: fix tsort crash caused by not enough disk space
2023-08-07 19:02:11 +08:00
yihaoDeng 6a69c56b32 support reopen stream state 2023-08-07 10:55:42 +00:00
yihaoDeng 6c8c575549 support reopen stream state 2023-08-07 10:48:04 +00:00
Haojun Liao aea1690cd1 fix(stream): fix the stream task after checking if it is in the timer activities. 2023-08-07 17:49:36 +08:00
yihaoDeng b6c991f896 support reopen stream state 2023-08-07 08:59:04 +00:00
yihaoDeng eeb97351e8 support reopen stream state 2023-08-07 08:51:01 +00:00
dm chen 3bdf5774bc
Merge pull request #22347 from taosdata/3.0
merge 3.0 to feat/TD-22970
2023-08-07 16:25:25 +08:00
Haojun Liao 225c0e61dc hen(stream): support the rollback and checkdown stream tasks. 2023-08-07 16:13:39 +08:00
Minglei Jin fac7e521e9 s3/evict: fetch atime from stat file 2023-08-07 15:59:37 +08:00
yihaoDeng 7ef4df8752 support reopen stream state 2023-08-07 07:20:05 +00:00
Haojun Liao 7924d7e0af
Merge pull request #22337 from taosdata/fix/fixInvalidFree
fix invalid free
2023-08-07 11:45:29 +08:00
Haojun Liao a8006d3d0d
Merge pull request #22278 from taosdata/fix/fixStateMemleak
fix state mem leak
2023-08-07 11:45:16 +08:00
dapan1121 0546bdceb2 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-08-07 11:23:15 +08:00
dapan1121 da27a306db fix: mutex init issue 2023-08-07 11:22:25 +08:00
yihaoDeng 4ca39d0f3c support reopen stream state 2023-08-07 01:45:16 +00:00
Haojun Liao d3bc7c3c94 refactor: do some internal refactor. 2023-08-07 09:20:53 +08:00
Haojun Liao 8a11a0418f other: merge 3.0 2023-08-07 09:19:26 +08:00
yihaoDeng 7396799d90 fix invalid free 2023-08-04 19:06:16 +08:00
yihaoDeng 36e841b6d0 fix invalid free 2023-08-04 18:59:17 +08:00
Hui Li f19826fa9d
Merge pull request #22313 from taosdata/fix/addStreamVer
add stream verion
2023-08-04 17:36:21 +08:00
wade zhang 40b87a2d55
Merge pull request #22320 from taosdata/fix/TS-3311
fix: fix _wstart,_wennd not matching with interval for ns/us databases
2023-08-04 16:34:07 +08:00
Ganlin Zhao 9f3af66ae0 fix: fix tsort crash caused by not enough disk space 2023-08-04 16:03:06 +08:00
yihaoDeng a4da6e9a88 fix mem leak 2023-08-04 15:59:34 +08:00
wangjiaming0909 fba43e1748 feature: optimize interval with limit 2023-08-04 15:04:04 +08:00
yihaoDeng 81908be32f add stream ver 2023-08-04 14:02:03 +08:00
yihaoDeng 6dc93a8dec add stream ver 2023-08-04 13:52:20 +08:00
liuyao 9cb481dd6e use stream task 2023-08-04 11:01:36 +08:00
Ganlin Zhao d9ef9c4584 fix: fix _wstart,_wennd not matching with interval for ns/us databases 2023-08-04 10:15:15 +08:00
slzhou cb9c6c1256 fix: compilation error 2023-08-03 21:47:33 +08:00
slzhou 2deeec93bf fix: explain with state window 2023-08-03 21:43:08 +08:00
slzhou 7676afff19 fix: stream use column node 2023-08-03 21:43:08 +08:00
slzhou 658c64f16f fix: make statekey of state window operator not target node 2023-08-03 21:43:08 +08:00
dm chen 5b03ab1705
Merge branch '3.0' into feat/TD-22970 2023-08-03 17:43:51 +08:00
yihaoDeng f9d0874e45 support reopen stream state 2023-08-03 08:24:50 +00:00
wangjiaming0909 632f5fbe8f feat: optimize table merge scan when 1 child table 2023-08-03 15:33:25 +08:00
wade zhang 211af11f39
Merge pull request #22303 from taosdata/fix/TD-25538
reset state window end key
2023-08-03 14:03:54 +08:00
liuyao 74c69bbb6e reset state window end key 2023-08-03 11:23:46 +08:00
liuyao 3464979489 set dummy delete data request 2023-08-03 09:03:48 +08:00
dmchen 5d4f0cbc71 myindex 2023-08-02 16:36:07 +08:00
yihaoDeng 918eca4d22 fix state mem leak 2023-08-02 03:31:11 +00:00
yihaoDeng 6cdf94fec0 fix state mem leak 2023-08-02 03:29:13 +00:00
yihaoDeng d9fd95777a fix state mem leak 2023-08-02 03:21:39 +00:00
yihaoDeng 83468a7710 fix state mem leak 2023-08-02 03:18:59 +00:00
Haojun Liao 13543f7daa feature(stream): handle task update in tq module. 2023-08-02 10:33:41 +08:00
Haojun Liao 6b09566549
Merge pull request #22275 from taosdata/enh/addKeepAliveParam
add keep alive parameter
2023-08-02 09:23:03 +08:00
liuyao 71b000f08c reload state window state 2023-08-01 18:22:40 +08:00
Haojun Liao ad4c5916e7 enh(stream): update the stream task. 2023-08-01 18:14:58 +08:00
Haojun Liao 164bfd5408 enh(stream): prepare update trans. 2023-08-01 16:12:35 +08:00
yihaoDeng 111481cef9 fix state mem leak 2023-08-01 08:09:10 +00:00
Haojun Liao 6365d5000b
Merge pull request #22271 from taosdata/fix/3_liaohj
fix(stream): dump results to sink node before paused.
2023-08-01 15:50:17 +08:00
yihaoDeng 2caaae392a add keep alive parameter 2023-08-01 06:38:30 +00:00
Haojun Liao f1e0e64918 fix(stream): add more check. 2023-08-01 14:31:41 +08:00
dmchen 8a0e9ff0e0 fix/retry_resolve_fqdn 2023-08-01 14:24:28 +08:00
Haojun Liao 75b1520be0 enh(stream): create task update info 2023-08-01 14:04:07 +08:00
Haojun Liao e11cda17c0 fix(stream): remove invalid check. 2023-08-01 10:30:24 +08:00
Haojun Liao f6ae9cf9bb fix(stream): fetch all data before paused and dump to sink node. 2023-08-01 10:16:14 +08:00
Haojun Liao b83860372c fix(stream): dump results to sink node before paused. 2023-08-01 00:50:30 +08:00
Haojun Liao 36ef9a537f
Merge pull request #22256 from taosdata/fix/TD-25457
check update data
2023-07-31 22:56:05 +08:00
Haojun Liao 2640e41705
Merge pull request #22261 from taosdata/fix/3_liaohj
fix(stream): set the correct end key of delete block.
2023-07-31 22:55:50 +08:00
Haojun Liao 8c1c17e31e fix(stream): ignore the sink task transfer state. 2023-07-31 19:23:53 +08:00
Haojun Liao d72580dad7 fix(stream): transfer the state for agg tasks. 2023-07-31 19:12:23 +08:00
Haojun Liao d45596bb33 fix(stream): kill task when pause the stream execution. 2023-07-31 18:07:37 +08:00
liuyao 32b59af4b1 check update data 2023-07-31 17:32:24 +08:00
wangmm0220 8093ef2dc8 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-31 16:14:25 +08:00
Haojun Liao 9981cecbed refactor: do some internal refactor. 2023-07-31 15:24:35 +08:00
Haojun Liao fe21943c9c fix(stream): set the correct end key of delete block. 2023-07-31 14:23:46 +08:00
Haojun Liao f359a0dca3 fix(stream): set the correct end key of delete block. 2023-07-31 14:22:46 +08:00
Haojun Liao e61aa83594 enh(stream): handle the stream hb. 2023-07-31 14:07:18 +08:00
wade zhang bae028d65c
Merge pull request #22230 from taosdata/mark/tmq
fix:semaphore always wait in tmq commit logic
2023-07-31 09:10:13 +08:00
Haojun Liao cc5ff44604 enh(stream): handle the stream hb. 2023-07-30 19:25:00 +08:00
liuyao 09c806539f fix double free 2023-07-30 17:21:42 +08:00
wade zhang 3a59b95211
Merge pull request #22226 from taosdata/wjm/fix/TD-25374
fix: window fill ts range check with int64 overflow
2023-07-30 14:32:31 +08:00
Haojun Liao 8dfef8768a other: merge 3.0 2023-07-29 22:54:16 +08:00
Haojun Liao 80ad5a0abb
Merge pull request #22243 from taosdata/fix/3_liaohj
fix(stream): initialize the filter window initial range.
2023-07-29 21:10:42 +08:00
Haojun Liao 399088e2bd fix(stream): remove invalid code. 2023-07-29 19:23:35 +08:00
Haojun Liao 94551e6e46 fix(stream): update the load block position. 2023-07-29 18:48:22 +08:00
Haojun Liao e0c310215c
Merge pull request #22237 from taosdata/fix/TD-25420
init scan state
2023-07-29 16:55:43 +08:00
Haojun Liao 71e16d1eeb
Merge pull request #22238 from taosdata/fix/TD-25423
save compact window info
2023-07-29 16:55:27 +08:00
Haojun Liao 0bd2548937 fix(stream): initialize the filter window initial range. 2023-07-29 16:41:01 +08:00
Haojun Liao f6e07d1fdb other: merge 3.0 2023-07-29 01:32:02 +08:00
Haojun Liao 92d1dbd9ad fix(stream): set the time window filter before generating create table result. 2023-07-29 01:23:06 +08:00
Haojun Liao 6c9fa4d7c8 fix(stream): check for pause when handling the fill history data. 2023-07-28 19:58:52 +08:00
liuyao 73ed6fe649 save compace window info 2023-07-28 19:30:26 +08:00
Haojun Liao 936afeb5ac refactor: do internal refactor to simple the pause/resume in case of fill history exists. 2023-07-28 19:13:03 +08:00
Haojun Liao d5974a8f25 refactor(stream): refactor the pause/resume for fill history execution. 2023-07-28 18:05:32 +08:00
dapan1121 b7126b9cc6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-28 18:01:11 +08:00
dapan1121 9ed1417bba enh: remove group cache 2023-07-28 18:00:33 +08:00
liuyao d712124921 init scan state 2023-07-28 17:25:56 +08:00
wangmm0220 ce7db7bf90 fix:subscribe time & return -1 if wal not exist 2023-07-28 15:07:15 +08:00
Haojun Liao 9f943213ed enh(stream): update the hb info. 2023-07-28 14:23:53 +08:00
wangjiaming0909 6713882b48 fix: window fill ts range check with int64 overflow 2023-07-28 14:17:21 +08:00
dapan1121 9c7b53083b
Merge pull request #22223 from taosdata/fix/td-25378
fix: fix memleak during create initial sources for block merge sort
2023-07-28 13:09:34 +08:00
Haojun Liao 74834aea11 enh(stream): prepare hb to mnode from stream meta. 2023-07-28 13:07:16 +08:00
Haojun Liao 2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj
other: merge main.
2023-07-28 13:06:17 +08:00
Haojun Liao 6459587ae7 other: fix merge error. 2023-07-28 10:59:34 +08:00
slzhou bcf4c1ebae fix: fix memleak during create initial sources for block merge sort 2023-07-28 09:54:56 +08:00
Haojun Liao 688884de08
Merge pull request #22220 from taosdata/fix/ly_stream_fill
fix stream fill issue
2023-07-28 09:27:21 +08:00
Haojun Liao ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj
fix(stream): scan wal in step2
2023-07-28 00:42:15 +08:00
Haojun Liao 22a5a18fff fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store. 2023-07-27 18:57:36 +08:00
liuyao f667a09cc6 fix stream fill issue 2023-07-27 18:56:25 +08:00
liuyao 5d21f50340 adjust history task trigger mode 2023-07-27 17:45:28 +08:00
Haojun Liao 6319cb8dd4 fix: fix syntax error. 2023-07-27 17:16:45 +08:00
Haojun Liao b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao 3fdbd5383f Merge remote-tracking branch 'origin/fix/3_liaohj' into fix/3_liaohj 2023-07-27 16:11:07 +08:00
Haojun Liao 6ff50d4eaf fix(stream): update the step2 scan wal files. 2023-07-27 16:10:55 +08:00
liuyao 7c9898cfa5 adj stream scan 2023-07-27 15:56:06 +08:00
wade zhang cc3cc73cfc
Merge pull request #22199 from taosdata/fix/TS-3708
fix/TS-3708: check term for role time
2023-07-27 15:43:23 +08:00
liuyao c54bd55c68 op stream scan 2023-07-27 15:16:22 +08:00
liuyao c72274504e op stream scan 2023-07-27 15:13:57 +08:00
liuyao 0b53bdbae6 op stream scan 2023-07-27 15:09:25 +08:00
liuyao 0ac7ebe9c7 op stream scan 2023-07-27 14:56:06 +08:00
Haojun Liao 40fe3ef4f6 fix(stream): refactor the step2 wal scan. 2023-07-27 14:49:20 +08:00
Shungang Li 167ecea705 fix: check term for role time
1. time of mnode becomes current role in this term
2. show 0 for offline mnodes
2023-07-27 14:16:54 +08:00
Haojun Liao d9fe1a3107
Merge pull request #22209 from taosdata/fix/TD-25392
optimize session operator reload state
2023-07-27 14:10:46 +08:00
Haojun Liao e89f530db2 fix(stream): scan wal in step2 2023-07-27 10:55:59 +08:00
wade zhang 866f469bc1
Merge pull request #22203 from taosdata/FIX/TD-25382-3.0
fix: not to walEndSnapshot in syncNodeTimerRoutine
2023-07-27 10:15:55 +08:00
liuyao 1894608b80 optimize session operator reload state 2023-07-27 09:59:58 +08:00
Haojun Liao 05504023f5
Merge pull request #22200 from taosdata/fix/ly_stream_test
stream fill operator mem leak
2023-07-27 09:38:22 +08:00
Benguang Zhao f5fced5ab9 fix: not to walEndSnapshot in syncNodeTimerRoutine 2023-07-26 20:06:51 +08:00
dapan1121 e83a46b88f enh: cache necessary file for seq mode 2023-07-26 19:17:59 +08:00
yihaoDeng 287088ae3f fix stream state transfer 2023-07-26 10:16:06 +00:00
liuyao c368db30c3 stream fill operator mem leak 2023-07-26 17:38:37 +08:00
Haojun Liao 7d9fa2b0d4 Merge branch '3.0' into fix/3_liaohj 2023-07-26 16:36:41 +08:00
Haojun Liao 432c943c25 fix(stream): do filter before the update check. 2023-07-26 16:34:39 +08:00
Haojun Liao 610f9d19c1
Merge pull request #22188 from taosdata/fix/3_liaohj
fix(stream): set the correct step2 scan time window range.
2023-07-26 16:34:10 +08:00
wade zhang 0666284547
Merge pull request #22183 from taosdata/fix/TS-3691
fix/TS-3691: monitor reports log summary
2023-07-26 16:21:18 +08:00
Haojun Liao df57768a3e Merge branch '3.0' into fix/3_liaohj 2023-07-26 14:45:11 +08:00
Haojun Liao cdffabcdad fix(stream): fix memory leak. 2023-07-26 14:37:04 +08:00
dapan1121 4e5fbb52ee Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-26 13:56:46 +08:00
dapan1121 6a0061ccfb fix: invalid task status update issue 2023-07-26 13:54:58 +08:00
Shungang Li 0b167c94f3 fix: monitor reports log summary 2023-07-26 13:54:32 +08:00
Haojun Liao 728112ed89 fix(stream): set correct upstream epinfo. 2023-07-26 10:26:59 +08:00
liuyao 6d40cdb62e adj max combine fucntion 2023-07-26 09:52:07 +08:00
Haojun Liao 12986ff594 fix(stream): fix memory leaks. 2023-07-26 09:25:30 +08:00
Haojun Liao 4d6b9d4a15 fix(stream): split delete msg for real-time scan from wal. 2023-07-26 09:08:17 +08:00
yihaoDeng 22c85fcbad fix stream state transfer 2023-07-25 13:07:49 +00:00
yihaoDeng 0c2e86f416 fix stream state transfer 2023-07-25 10:17:30 +00:00
Haojun Liao 1c1bf63e1f other: merge 3.0 2023-07-25 18:17:11 +08:00
Haojun Liao 063673726a fix(stream): fix syntax error 2023-07-25 18:08:22 +08:00
Haojun Liao 2cc4e0a727 fix(stream): fix syntax error 2023-07-25 17:56:40 +08:00
dapan1121 66042669a1
Merge pull request #22176 from taosdata/szhou/enhance-limit-proc
fix: choose heap sort for table merge scan with long row and limit
2023-07-25 17:48:11 +08:00
Haojun Liao 0bdccd2681 refactor: do some internal refactor. 2023-07-25 17:31:54 +08:00
slzhou f4c28d848b fix: table merge scan use heap sort when there is limit 2023-07-25 15:23:00 +08:00
Haojun Liao d29f835a63 fix(stream): set the correct step2 scan time window range. 2023-07-25 15:09:22 +08:00
dapan1121 768a84647c
Merge pull request #22177 from taosdata/enh/TS-3625
fix: fix error message
2023-07-25 13:28:19 +08:00
slzhou ca2ad71bb8 fix: return null when there are no input stream blocks for priority queue sort 2023-07-25 13:08:37 +08:00
wade zhang 7579144599
Merge pull request #22133 from taosdata/fix/TS-3691-main
fix/TS-3691: (main) monitor no longer reports logs
2023-07-25 10:28:38 +08:00
wade zhang f963c4332e
Merge pull request #22132 from taosdata/fix/TS-3691
fix/TS-3691: monitor no longer reports logs
2023-07-25 10:28:12 +08:00
Ganlin Zhao c9c7f99764 fix: fix error message 2023-07-25 09:49:23 +08:00
slzhou a205eba2ab fix: choose heap sort for table merge scan when row size is big and has limit 2023-07-25 09:48:08 +08:00
Haojun Liao f3f1fade43 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-25 09:25:32 +08:00
Haojun Liao c116b69941 fix(stream): fix memory leak. 2023-07-25 09:25:18 +08:00
dapan1121 fb63294289 fix: hash join res issue 2023-07-25 09:03:52 +08:00
dapan1121 10f9c40dba
Merge pull request #22171 from taosdata/szhou/enhance-limit-proc
enhance: skip data blocks with the merge limit ts when create initial…
2023-07-25 08:42:35 +08:00
Haojun Liao 96722a07b1
Merge pull request #22174 from taosdata/fix/3_liaohj
fix(stream): fix the invalid check of step2 .
2023-07-25 00:30:06 +08:00
Haojun Liao a2694b9ce9 fix(stream): fix the invalid check of step2 . 2023-07-24 19:44:28 +08:00
yihaoDeng fe262d308e del wal 2023-07-24 11:10:15 +00:00
Haojun Liao d36903bf08
Merge pull request #22162 from taosdata/fix/3_liaohj
fix(stream): add some logs, and remove the invalid loop.
2023-07-24 16:29:51 +08:00
wangmm0220 9628a9f74e fix:open info log in tmq & ignore wal apply ver when read wal 2023-07-24 15:53:02 +08:00
Haojun Liao 01f11bf5a6 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2
# Conflicts:
#	source/common/src/tglobal.c
#	source/libs/executor/src/timewindowoperator.c
2023-07-24 15:25:43 +08:00
Haojun Liao 1e34f84f78 other: merge 3.0 2023-07-24 15:23:03 +08:00
Shungang Li dc77e783a5 fix: monitor no longer reports logs 2023-07-24 15:17:36 +08:00
Shungang Li d78f28ce2e fix: monitor no longer reports logs 2023-07-24 15:16:48 +08:00
slzhou 1d24b96e82 enhance: skip data blocks with the merge limit ts when create initial source 2023-07-24 15:16:39 +08:00
liuyao 992f1cb328 merge code 2023-07-24 15:00:48 +08:00
Haojun Liao 9bae91bcba fix(stream): add some logs, and remove the invalid loop. 2023-07-24 13:37:44 +08:00
dapan1121 6fbf251978
Merge pull request #22138 from taosdata/enh/TS-3625
fix: fix(value, null) output behavior
2023-07-24 13:17:19 +08:00
dapan1121 4f75eb5655 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-24 11:43:15 +08:00
dapan1121 ebf1a91fb5 enh: read/write from disk cache 2023-07-24 11:39:00 +08:00
Haojun Liao 13bab114cb
Merge pull request #22155 from taosdata/fix/3_liaohj
fix(stream): refactor the halt status to check more status.
2023-07-24 11:04:08 +08:00
yihaoDeng 6a27e81964 fix stream state transfer 2023-07-24 02:05:14 +00:00
Haojun Liao 1367552f38 fix(stream): refactor the halt status to check more status. 2023-07-24 10:04:15 +08:00
Haojun Liao 6a19ad3127
Merge pull request #22151 from taosdata/fix/3_liaohj
fix(stream): set the correct flag of pause/resume.
2023-07-24 09:07:49 +08:00
Haojun Liao 0b6e1a12bb refactor: do some internal refactor. 2023-07-23 19:09:43 +08:00
Haojun Liao e387b2f932 refactor: do some internal refactor. 2023-07-23 18:59:34 +08:00
Haojun Liao 4e0f7ffbf8 fix(stream): set the correct flag of pause/resume. 2023-07-23 18:49:56 +08:00
Alex Duan 41aa6a0c67 test: test build taos-tools 2023-07-23 18:17:18 +08:00
Haojun Liao 321be1f83f
Merge pull request #22135 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-07-22 15:06:28 +08:00
Haojun Liao 9679cc4527 fix(stream): fix race condition. 2023-07-22 10:19:51 +08:00
Haojun Liao f4864b8713 fix(stream): fix memory leak. 2023-07-22 01:02:58 +08:00
Haojun Liao bfc4a07207 fix(stream): fix memory leak. 2023-07-22 00:20:02 +08:00
Haojun Liao 1b2636028a fix(stream): fix memory leak. 2023-07-21 23:05:42 +08:00
Haojun Liao 16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
dapan1121 ae8caa8275 enh: add disk cache 2023-07-21 19:25:38 +08:00
dapan1121 3725cafe00 enh: add disk cache 2023-07-21 17:30:09 +08:00
wade zhang 7b1e809d98
Merge pull request #21794 from taosdata/enh/tsdb_optimize
for test purpose
2023-07-21 14:18:32 +08:00
liuyao 4451b2185a transform stream state 2023-07-21 10:32:53 +08:00
dmchen 7d480cf3ac compatible old sync config 2023-07-21 10:31:53 +08:00
liuyao d45563684b
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-21 10:23:41 +08:00
Ganlin Zhao 62b73db8bf fix: fix(value, null) output behavior 2023-07-21 10:19:41 +08:00
Ganlin Zhao 624b6b094f fix: fix(value, null) output behavior 2023-07-21 10:14:12 +08:00
Haojun Liao d0da988b7d Merge branch '3.0' into fix/3_liaohj 2023-07-21 09:47:44 +08:00
Haojun Liao 39ca9b537f fix(stream): fix syntax error 2023-07-21 09:43:08 +08:00
dapan1121 2ef01728ca
Merge pull request #22089 from wangjiaming0909/fix/3.0/TD-23763
feat: optimize partition by tbname slimit
2023-07-21 09:29:36 +08:00
dapan1121 d81727afa9
Merge pull request #22130 from taosdata/fix/TD-25270
enh: support show create table for system tables
2023-07-21 09:26:11 +08:00
Haojun Liao bd8b811b9d refactor: do some internal refactor. 2023-07-21 09:14:25 +08:00
Haojun Liao 0d1c4f9ee2 fix(stream): fix syntax error 2023-07-21 09:13:06 +08:00
Haojun Liao db46d31ca5 fix(stream): refactor the halt function. 2023-07-21 01:32:42 +08:00
yihaoDeng 82df77eba8 fix stream state transfer 2023-07-20 11:52:31 +00:00
yihaoDeng fc2d6744e2 fix stream state transfer 2023-07-20 10:52:34 +00:00
yihaoDeng 519d3b74d1 fix stream state transfer 2023-07-20 09:51:18 +00:00
Ganlin Zhao 076a425d53 fix: fix show create table issue for system tables 2023-07-20 17:21:24 +08:00
Haojun Liao c9fa170e65 refactor: do some internal refactor. 2023-07-20 16:31:46 +08:00
dapan1121 fde8eabfd7
Merge pull request #22111 from taosdata/szhou/tms-dev-2
enhance: table merge scan optimization
2023-07-20 16:28:29 +08:00
Haojun Liao 45cb478b31 refactor: do some internal refactor. 2023-07-20 15:36:46 +08:00
wangjiaming0909 7d850c1a5e feat: optimize partition by tbname slimit 2023-07-20 15:07:55 +08:00
slzhou 1a0031a43c enhance: uinfo to qdebug and increase pages num to 2048 2023-07-20 13:53:13 +08:00
slzhou 5d9f6fd481 fix: fix limit/offset bugs 2023-07-20 12:29:34 +08:00
Haojun Liao 87fa8f0c4c Merge branch '3.0' into fix/3_liaohj 2023-07-20 12:15:23 +08:00
Haojun Liao aed99da6c1 refactor: refactor the stream task starting order. 2023-07-20 12:14:53 +08:00
yihaoDeng 6e5be0d30e fix stream state transfer 2023-07-20 03:49:32 +00:00
dapan1121 7221f447df fix: group cache table index issue 2023-07-20 11:00:29 +08:00
dapan1121 3f58bc5578 fix: group cache last block index issue 2023-07-20 10:55:15 +08:00
dapan1121 58c5d5e70e fix: group cache block cache issue 2023-07-20 10:21:19 +08:00
slzhou 30129f64da enhance: merge blocks of the same table before sort 2023-07-20 09:28:19 +08:00
liuyao 8a6ed67f9d fill history 2023-07-20 09:13:30 +08:00
liuyao ccc8142ab3 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2023-07-20 09:07:54 +08:00
wangmm0220 9378a0ef83 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-19 23:42:23 +08:00
yihaoDeng 733db123ad refactor code 2023-07-19 13:24:59 +00:00
dapan1121 b9b8fa1ba2 fix: table list issue 2023-07-19 19:41:54 +08:00
dapan1121 a41888a9ef fix: batch fetch issue 2023-07-19 19:14:30 +08:00
Haojun Liao 97c44e7c18 refactor: do some internal refactor. 2023-07-19 18:42:02 +08:00
Haojun Liao c30c53c3d2
Merge pull request #22120 from taosdata/fix/TD-25268
remove redundant results
2023-07-19 18:33:33 +08:00
Yihao Deng 91a15fd7bd
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 18:14:08 +08:00
dapan1121 ec04a5eff7
Merge pull request #22121 from taosdata/fix/TD-25236-3.0a
fix: auth check for sys table when user is disabled
2023-07-19 18:03:50 +08:00
dapan1121 cbe03ef212
Merge pull request #22069 from taosdata/enh/TS-2288
enh: add scope for show xx variables
2023-07-19 18:01:11 +08:00
dmchen 154bc177a7 memory leak 2023-07-19 17:33:55 +08:00
liuyao af18afba9d fill history 2023-07-19 17:19:55 +08:00
liuyao c7e4aa4f77 set win range 2023-07-19 15:51:22 +08:00
kailixu 8e06a75d24 fix: auth check for sys table when user is disabled 2023-07-19 15:28:59 +08:00
dapan1121 d125bb0952 fix: merge join reset params issue 2023-07-19 14:59:05 +08:00
liuyao 8481725517 remove redundant results 2023-07-19 14:58:28 +08:00
dapan1121 8b62c75c26 fix: merge join ignore param issue 2023-07-19 14:42:18 +08:00
slzhou d1a1976aa4 enhance: add limit to merge sort 2023-07-19 13:59:43 +08:00
dapan1121 38be8f2a8e fix: reset rows before reuse block 2023-07-19 13:42:15 +08:00
dapan1121 6960872515 enh: add merge join reset 2023-07-19 11:56:13 +08:00
dapan1121 b2cea6ab84 fix: block info capicity issue 2023-07-19 11:42:54 +08:00
dapan1121 6d7912003d fix: block data memory issue 2023-07-19 11:34:44 +08:00
Minglei Jin 4b96bc7147
Merge branch '3.0' into enh/tsdb_optimize 2023-07-19 11:15:57 +08:00
dm chen 141004bf77
Merge branch '3.0' into feat/TD-22970 2023-07-19 10:57:40 +08:00
dmchen 7468749666 memory leak 2023-07-19 10:48:04 +08:00
dapan1121 c45359c989 enh: add batch table scan 2023-07-19 10:37:30 +08:00
dmchen e7dfb8c26d memory leak 2023-07-19 10:36:55 +08:00
Haojun Liao a32c650248 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-19 10:05:48 +08:00
Haojun Liao 2ae95217bd fix(stream): open inputQ by default for task deployed on snode. 2023-07-19 10:05:35 +08:00
liuyao fd02b9a71e
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-19 10:02:06 +08:00
wade zhang c3e5375f15
Merge pull request #22085 from taosdata/FEAT/TS-2699-3.0
feat: distribute vnode primary dirs among disks of level 0
2023-07-19 09:44:43 +08:00
wangmm0220 5c344b0159 fix:conflicts from main 2023-07-19 09:05:05 +08:00
dmchen 93766f8c96 memory leak 2023-07-19 08:32:16 +08:00
Haojun Liao 5c75883069
Merge pull request #22112 from taosdata/fix/3_liaohj
fix(stream): set downstream task ready state.
2023-07-18 22:02:18 +08:00
yihaoDeng de4efca56f update ip 2023-07-18 12:12:56 +00:00
dapan1121 04fea1e38f enh: add batch fetch process 2023-07-18 19:35:45 +08:00
Haojun Liao 40411fcd01 Merge branch '3.0' into fix/3_liaohj 2023-07-18 19:27:15 +08:00
Haojun Liao 9513f76172 fix(stream): set downstream task ready state. 2023-07-18 19:02:24 +08:00
Haojun Liao 5b29a5ec97 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-18 18:30:10 +08:00
Haojun Liao 902f9d1f94 fix(stream): set not-ready initial value. 2023-07-18 18:29:35 +08:00
yihaoDeng 039befa3d6 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-18 10:15:20 +00:00
yihaoDeng 790101ced2 fix mem leak 2023-07-18 10:14:04 +00:00
liuyao caa4503352 reset state key memory 2023-07-18 18:02:39 +08:00
liuyao bada18f5f0 heap use after free 2023-07-18 17:59:42 +08:00
slzhou 4348b9c51d fix: use uinfo to show on stdout 2023-07-18 16:47:31 +08:00
dmchen 3711fdd865 feat/TD-22970 2023-07-18 16:09:38 +08:00
slzhou f79fc81d9c fix: add to page buf in the same way as single source sort 2023-07-18 15:46:38 +08:00
Haojun Liao d2c875e774 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-18 15:19:09 +08:00
Haojun Liao 901b7d8ecc fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore. 2023-07-18 15:18:57 +08:00
liuyao 14e591c802 mem leak 2023-07-18 14:51:32 +08:00
dapan1121 07fca2124d Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-18 14:45:26 +08:00
dapan1121 294376de0b enh: add batch table scan 2023-07-18 14:44:53 +08:00
yihaoDeng ad0b0c3821 fix mem leak 2023-07-18 06:04:41 +00:00
Benguang Zhao 24fed51137 enh: tfsRename dir on primary disk at last 2023-07-18 13:58:43 +08:00
dapan1121 c2245a3546
Merge pull request #22100 from taosdata/fix/TD-25241
fix: fix interval in nested query filter not applied
2023-07-18 13:52:35 +08:00
yihaoDeng 95b8754dab Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-18 04:03:56 +00:00
yihaoDeng 40d59990d8 fix mem leak 2023-07-18 04:01:20 +00:00
Benguang Zhao 5624ecc8df fix: prepare vnode dir recursively in vnodeCreate 2023-07-18 11:32:23 +08:00
Benguang Zhao 6b6b7d8d8f enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk 2023-07-18 11:32:23 +08:00
liuyao a4676fc74b init winkey 2023-07-18 10:43:35 +08:00
slzhou 97a6e89d11 enhance: refactor create initial sources 2023-07-18 10:38:40 +08:00
Ganlin Zhao 94b13df641 fix: fix interval in nested query filter not applied 2023-07-18 10:36:07 +08:00
Haojun Liao 92106312d2 fix(stream): not dispatch checkpoint block result to downstream. 2023-07-18 09:43:38 +08:00
Haojun Liao 2f24f776fb fix(stream): fix error in generating checkpoint for state_window. 2023-07-18 09:04:28 +08:00
kailixu 52c56f4bd7 chore: support non sma option () if supported 2023-07-17 22:40:22 +08:00
kailixu cf39fcdd12 fix: add sma option when show create table for stb/ntb 2023-07-17 22:24:27 +08:00
slzhou ba2b404295 enhance: optimize msortComparFn for table merge scan 2023-07-17 21:07:55 +08:00
wangmm0220 872222eb77 fix:[TD-25222] error in drop topic if topic num is too long 2023-07-17 19:52:07 +08:00
yihaoDeng 1b8ec19509 fix compile err on windows 2023-07-17 11:44:40 +00:00
yihaoDeng 863d96eac0 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-17 11:04:54 +00:00
yihaoDeng 40eb50676d add checkpoint 2023-07-17 11:04:19 +00:00
liuyao d45adeaa4e add checksum 2023-07-17 18:04:17 +08:00
slzhou 1b9754f1bc enhance: add log with info level. change to debug later 2023-07-17 16:18:06 +08:00
Ganlin Zhao 929db3d647 Merge branch '3.0' into enh/TS-2288 2023-07-17 16:09:07 +08:00
Haojun Liao 14b9d920ba fix(stream): fix memory leak. 2023-07-17 16:02:41 +08:00
Haojun Liao 08f43b9d00 fix(stream): fix checkpoint block not fetched bug. 2023-07-17 15:31:54 +08:00
dapan1121 c22619ab67 fix: add perf debug info 2023-07-17 15:26:59 +08:00
slzhou 655233fd4f fix: create initial source with blocks 2023-07-17 15:05:30 +08:00
yihaoDeng 2834c4f56c Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-17 06:47:59 +00:00
yihaoDeng 394cc771e5 add checkpoint 2023-07-17 06:47:23 +00:00
dapan1121 2e0b4236e3 fix: hash join row index issue 2023-07-17 14:45:45 +08:00
liuyao e80ae266ab refact 2023-07-17 14:37:54 +08:00
dapan1121 2822245a37
Merge pull request #22076 from wangjiaming0909/fix/m/TD-25199
fix: create sma index for us/ns database failed
2023-07-17 14:21:57 +08:00
yihaoDeng f0f2215f49 add checkpoint 2023-07-17 06:21:45 +00:00
yihaoDeng 3168096e40 add checkpoint 2023-07-17 06:06:21 +00:00
dapan1121 efbb6cb193 fix: add debug line 2023-07-17 13:50:19 +08:00
yihaoDeng e0bb3c8f94 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-17 05:26:57 +00:00
yihaoDeng f7732ddd18 recoverSnapshot 2023-07-17 05:26:30 +00:00
Haojun Liao 4dd93494d1 fix(stream): fix syntax error 2023-07-17 13:23:06 +08:00
Haojun Liao d7f7a7d6cf fix(stream): fix syntax error 2023-07-17 12:53:36 +08:00
Haojun Liao b2a905bd91
Merge branch '3.0' into enh/triggerCheckPoint2 2023-07-17 11:50:12 +08:00
yihaoDeng 5adf580764 add checkpoint 2023-07-17 03:44:06 +00:00
dapan1121 8872e017af fix: group table scan issue 2023-07-17 11:15:17 +08:00
Haojun Liao 8c8b1a6d79 fix(stream): handle block before checkpoint msg in the inputQ. 2023-07-17 10:47:05 +08:00
yihaoDeng dea2e73d2e add checkpoint 2023-07-17 02:22:21 +00:00
dapan1121 bcadc8d85b
Merge pull request #22070 from wangjiaming0909/fix/m/TS-3671
fix: state/session/event window with order by _wstart/_wend has no effect
2023-07-17 10:06:16 +08:00
dapan1121 a1e18ac898 fix: fix global cache issue 2023-07-17 09:25:28 +08:00
wangjiaming0909 ee7c8289aa fix: create sma index for us/ns database failed 2023-07-17 09:02:30 +08:00
shenglian zhou 9a0e9df567 enhance: block is ts sorted and each book is a source 2023-07-16 23:39:41 +08:00
slzhou f93af4d2e0 enhance: pass simple test 2023-07-16 20:28:54 +08:00
shenglian zhou 8b6d7db7ad enhance: use one tsdb reader to read table sequentially 2023-07-16 17:54:39 +08:00
Haojun Liao a9757637d9 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-16 12:47:24 +08:00
Haojun Liao c6a322e0ef refactor(stream): back pressure is active, which is trigger by dispatch rsp. 2023-07-16 12:47:08 +08:00
yihaoDeng b4de0892e6 add checkpoint 2023-07-15 09:35:33 +00:00
yihaoDeng 7b4185dc56 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-15 04:27:39 +00:00
yihaoDeng e18c9ea672 add checkpoint 2023-07-15 04:26:34 +00:00
yihaoDeng aad669e33c add checkpoint 2023-07-14 14:46:13 +00:00
Haojun Liao 725db16af9 fix(stream): set save checkpoint ver. 2023-07-14 19:47:19 +08:00
dapan1121 188df1d675 fix: fix bugs 2023-07-14 19:36:56 +08:00
Haojun Liao 035b199497 refactor(stream): do some internal refactor. 2023-07-14 18:46:38 +08:00
Haojun Liao 6798e31bb5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-14 18:35:53 +08:00
Haojun Liao 8c79157822 fix(stream): close the inputQ if checkpoint msg received. 2023-07-14 18:35:41 +08:00
yihaoDeng 3020e27114 fix mem leak 2023-07-14 10:20:37 +00:00
yihaoDeng ed931c1100 Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2 2023-07-14 10:11:20 +00:00
yihaoDeng 3c4631ef1f add checkpoint 2023-07-14 10:06:24 +00:00
Haojun Liao 2b85ea62aa refactor: do some internal refactor. 2023-07-14 17:48:47 +08:00
Haojun Liao b16432280e Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-14 17:21:37 +08:00
Haojun Liao eb7e6152ae refactor(stream): do some internal refactor. 2023-07-14 17:21:20 +08:00
wangmm0220 6762a01d88 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-14 16:44:00 +08:00
wangmm0220 bbdcbcb75b fix:modify commit version to next validate version 2023-07-14 16:43:28 +08:00
wangjiaming0909 b850c1af47 fix: state/session/event window with order by _wstart/_wend has no effect 2023-07-14 16:03:59 +08:00