Commit Graph

391 Commits

Author SHA1 Message Date
dapan1121 b7126b9cc6 Merge remote-tracking branch 'origin/3.0' into feat/TD-24700 2023-07-28 18:01:11 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
dapan1121 6a0061ccfb fix: invalid task status update issue 2023-07-26 13:54:58 +08:00
wangmm0220 bbdcbcb75b fix:modify commit version to next validate version 2023-07-14 16:43:28 +08:00
Haojun Liao 2f90a53548 fix(stream): set checkpoint id when expanding task. 2023-07-13 10:16:57 +08:00
Haojun Liao 3ce54423a5 Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 2023-07-12 11:38:27 +08:00
Haojun Liao d392bb60ba refactor(stream): set the initial version from the checkpoint. 2023-07-12 11:38:13 +08:00
liuyao 7d4bb1b932 add checkpoint id for recover 2023-07-12 10:48:58 +08:00
liuyao 6298f17c45 delete invalid code 2023-07-11 19:21:27 +08:00
liuyao 0e914a19c6 stream operartor checkpoint 2023-07-06 14:28:34 +08:00
dapan1121 b371b7e6be fix: compile issue and merge join crash issue 2023-07-06 10:52:28 +08:00
dapan1121 0718859c0a enh: support passing params between nodes 2023-07-05 19:24:06 +08:00
Haojun Liao 9b3e34d589
Merge pull request #21735 from taosdata/refact/fillhistory
refactor: refactor the fill history operation
2023-07-05 10:48:51 +08:00
wangmm0220 58c7011e0e feat:support only meta in tmq subscriptions 2023-06-30 11:42:40 +08:00
liuyao 2fc5eeb810 session win range 2023-06-28 17:20:08 +08:00
Haojun Liao a19e63fd23 fix(stream): fix error in handling fill history. 2023-06-27 23:00:14 +08:00
liuyao e236bf818c set fill history info 2023-06-25 17:47:10 +08:00
Haojun Liao 6857881742 Merge branch '3.0' into refact/fillhistory 2023-06-25 10:41:32 +08:00
Shungang Li b93f653d7e feat: enhance ttl, deletetime modified by writing-ops
new config item: ttlChangeOnWrite (default 0)
ttl delete time changes on last write if true
2023-06-19 19:03:35 +08:00
liuyao 41c193945f fill history pause&resume 2023-06-19 17:28:19 +08:00
liuyao 693942b821 trans state 2023-06-15 14:13:17 +08:00
Haojun Liao 7c6fbd7772 enh(stream): do some internal refactor and support secondary scan for history data. 2023-06-14 14:10:09 +08:00
Haojun Liao 53246ed6bb other: merge other branch. 2023-06-09 09:41:10 +08:00
Haojun Liao c9aa59cbb9 refactor: do some internal refactor. 2023-06-08 18:59:25 +08:00
Haojun Liao 6a3c935b4a fix(stream): fix error in fill history scan. 2023-06-07 09:15:55 +08:00
Haojun Liao fcc706c45c enh(stream): refactor the fill history task. 2023-06-05 15:59:01 +08:00
Minglei Jin d02746d86f fix(query/sys): pause/resume with sys scan operator 2023-06-05 15:24:39 +08:00
Haojun Liao d45aa7ef84
Merge pull request #21555 from taosdata/fix/liaohj_main
other: merge main into 3.0.
2023-06-02 13:11:12 +08:00
Haojun Liao 5301c5756a other: merge main into 3.0. 2023-06-01 09:29:18 +08:00
wangmm0220 d490ca753f Merge branch '3.0' of https://github.com/taosdata/TDengine into feature/TD-19042 2023-05-30 09:48:49 +08:00
wangmm0220 41ed0138b4 fix:compile error 2023-05-29 17:25:11 +08:00
wangmm0220 07bdb95b1a fix:compile error 2023-05-29 17:10:11 +08:00
wangmm0220 78db3520a6 fix:conflict 2023-05-29 14:57:03 +08:00
wangmm0220 a71878d07f feat: support create topic as stable with conditions 2023-05-29 11:46:59 +08:00
Haojun Liao 8f61e2d6ef refactor: do some internal refactor. 2023-05-29 10:50:50 +08:00
Haojun Liao 953a69a829 refactor: do some internal refactor. 2023-05-29 10:12:27 +08:00
Haojun Liao e24ce2111f fix: set function ptr. 2023-05-26 00:00:07 +08:00
Haojun Liao c3be7b14be fix: set correct function ptr. 2023-05-25 17:51:03 +08:00
Haojun Liao 0966213847 fix(arch): set the correct module api dependency. 2023-05-25 14:21:40 +08:00
Haojun Liao 4a42f6b983 fix: fix error in api call. 2023-05-25 00:50:03 +08:00
Haojun Liao a9b18d203d fix:fix error. 2023-05-24 23:49:26 +08:00
Haojun Liao ab907e3344 fix(query): fix syntax error. 2023-05-24 21:53:40 +08:00
wangmm0220 8537e4e80e feat:add tag filter for stable subscribe 2023-05-24 18:26:55 +08:00
Haojun Liao fe09705855 fix: set the init function pointer. 2023-05-24 17:13:20 +08:00
Haojun Liao a566180770 fix: fix syntax error. 2023-05-24 15:16:50 +08:00
Haojun Liao 1f7f326bed refactor: do some internal refactor and set the api function ptr. 2023-05-24 13:22:05 +08:00
Haojun Liao 66477a28ca refactor: do some internal refactor. 2023-05-23 19:10:50 +08:00
Haojun Liao 85afbf0d35 refactor: do some internal refactor. 2023-05-23 18:58:54 +08:00
Haojun Liao a63473b1cc refacotor: do some internal refactor. 2023-05-23 18:54:32 +08:00
Haojun Liao c66c0c4dfd refactor: do some internal refactor. 2023-05-23 18:42:52 +08:00
Haojun Liao e67b532d8a refactor: refactor the module dependency. 2023-05-23 18:29:23 +08:00
Hui Li 3f824e2045
Merge pull request #21355 from taosdata/mark/tmq
fix:error in pHandle lock
2023-05-22 08:57:45 +08:00
wangmm0220 04858fae22 fix:tsdbreader is free by mistake 2023-05-20 12:20:54 +08:00
wangmm0220 ff2b545b27 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 17:16:47 +08:00
Haojun Liao 1e020a46c9 other: merge main. 2023-05-19 09:07:35 +08:00
Haojun Liao 5d5b2bb16a refactor: do some internal refactor. 2023-05-18 12:59:19 +08:00
wangmm0220 ee32620808 fix:[TS-3347]set ver to first version if version stored is smaller than first version in wal when subscribe db 2023-05-06 16:22:30 +08:00
Haojun Liao 09a04052ec refactor: do some internal refactor. 2023-05-04 16:15:14 +08:00
Haojun Liao 03b1de017a refactor: remove assert. 2023-04-28 14:12:17 +08:00
Haojun Liao eb7f510ccb fix(query): return correct suid to delete sink. 2023-04-17 10:59:24 +08:00
Haojun Liao eb0e1f848a fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask. 2023-04-14 12:00:09 +08:00
Haojun Liao f8b672f09f other: merge main. 2023-04-14 09:07:18 +08:00
Xiaoyu Wang 4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
liuyao 74da3c05bc feat:set check point id 2023-04-11 10:33:10 +08:00
Haojun Liao a4ba5401f9 enh(stream): set the start version of all operators. 2023-04-11 10:01:36 +08:00
Haojun Liao f5b52749c2 refactor: do some internal refactor. 2023-04-09 01:39:09 +08:00
Xiaoyu Wang e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
wangmm0220 d651ba02ae fix:lose consume data because of exec close if consume while insert data 2023-04-03 19:54:52 +08:00
wangmm0220 97b5c7abee fix:merge from main 2023-03-31 16:20:21 +08:00
Haojun Liao 56c98d7768 refactor: do some internal refactor. 2023-03-29 19:35:04 +08:00
wangmm0220 d0c55ef572 fix:conflicts 2023-03-28 18:12:13 +08:00
Haojun Liao c158087d66 fix(tmq): kill the ongoing tsdb scans while transferring the ownership of vnode to other consumers. 2023-03-28 09:53:49 +08:00
dapan1121 5b02af6a91 fix: merge main to 3.0 2023-03-22 16:08:16 +08:00
wangmm0220 f7b7320f5f fix:set offset if read wal none 2023-03-20 16:57:45 +08:00
wangmm0220 506c192bff fix:error in TD-23218 & remove useless logic 2023-03-20 16:26:15 +08:00
wangmm0220 f80078030c fix:error in TD-23218 & remove useless logic 2023-03-20 15:40:01 +08:00
Haojun Liao 7e712a14b6 fix(tmq): adjust log. 2023-03-19 19:06:28 +08:00
Haojun Liao ae5155edcf fix(tmq): do some internal refactor. 2023-03-19 10:49:30 +08:00
wangmm0220 7616a283e3 fix:error in TD-23218 & remove useless logic 2023-03-18 18:23:38 +08:00
54liuyao 0cd871010f fix:fix fill history bug 2023-03-07 13:34:26 +08:00
Haojun Liao 0d9d2ea293 fix(query): do some internal refactor, and fix the bug when calender time duration exists in sliding and offset. 2023-02-17 18:31:32 +08:00
Shengliang Guan 3016f35e9f Merge branch '3.0' into merge/mainto3.0_0105 2023-01-05 16:08:23 +08:00
Liu Jicong e30c00875c enh: close tsdb reader 2023-01-04 15:14:00 +08:00
dapan1121 1477ce97a7 fix: drop task while task executing issue 2023-01-03 18:07:18 +08:00
Shengliang Guan d342ebcd77
Merge pull request #18720 from taosdata/refact/submit_req
Refact/submit req
2022-12-28 10:29:00 +08:00
Liu Jicong 39eb62d80d enh: set scan limit 2022-12-27 14:52:41 +08:00
Liu Jicong b1bd24d15a enh: scan exec set limit 2022-12-23 16:35:40 +08:00
Liu Jicong 74a253eac4 refactor 2022-12-08 13:34:42 +08:00
Liu Jicong b133a56219 refactor: support submitreq2 2022-12-07 15:19:34 +08:00
Hongze Cheng 899d7b0bcc Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/submit_req 2022-12-06 14:37:22 +08:00
Liu Jicong 619bbdfd82 refactor: support submitreq2 2022-12-06 05:58:28 +08:00
dapan1121 f9f60a8f39
Merge pull request #18646 from taosdata/fix/TD-20684-3.0
feat(api): add new api int64_t taos_affected_rows64
2022-12-04 16:47:51 +08:00
Alex Duan 213b97b79a feat(api): taos_affected_rows64 add and modfiy tmsg.h 2022-12-02 23:20:19 +08:00
dapan1121 b430f653b9 Merge remote-tracking branch 'origin/3.0' into fix/TD-20802 2022-12-01 09:22:31 +08:00
Haojun Liao 2c8b962b5a refactor: do some internal refactor. 2022-11-30 21:04:58 +08:00
dapan1121 8ee170bef1 enh: add retry for vnode closed case 2022-11-29 16:17:05 +08:00
Haojun Liao 203ea1f9c8 fix(query): fix error 2022-11-27 14:57:44 +08:00
Liu Jicong 5e253cc8ea refactor(stream): fill history 2022-11-01 11:56:14 +08:00
Liu Jicong 52d8f7bd35
Merge pull request #17701 from taosdata/feature/stream
fix(query): set block capacity
2022-10-27 13:38:46 +08:00
Liu Jicong 6cd8361a0a refactor(sma) 2022-10-27 11:06:16 +08:00
Liu Jicong b56e7a0f8c
Merge pull request #17650 from taosdata/feature/stream
refactor(stream): recover and fill history
2022-10-26 11:10:03 +08:00
Liu Jicong 8d8fd2b2bc refactor(stream): recover and fill history 2022-10-26 10:20:33 +08:00
Haojun Liao d06bcb2219 refactor: fix typo and do some internal refactor. 2022-10-26 09:47:11 +08:00
Liu Jicong 75e5e490fd refactor(stream): recover and fill history 2022-10-26 00:31:00 +08:00
Haojun Liao b53cc7f3dd fix(query): fix coverity issues. 2022-10-21 14:00:46 +08:00
Hongze Cheng 4cc94968ee refact: format header file 2022-10-13 11:09:43 +08:00
Liu Jicong 2f9aeeb5fc feat(stream): support define table name 2022-10-09 16:54:27 +08:00
Liu Jicong 057edd92c3
Merge branch '3.0' into feature/tq 2022-09-28 20:27:09 +08:00
Liu Jicong 0e8aaf4c9e feat(tmq): push optimization 2022-09-28 10:38:49 +08:00
Haojun Liao aa055abd7c refactor:do some internal refactor. 2022-09-27 10:52:55 +08:00
Haojun Liao 5c1f55f6ca other:merge 3.0 2022-09-26 11:35:19 +08:00
dapan1121 a85a73e2de fix: fix memory leak issues 2022-09-15 16:30:21 +08:00
dapan1121 9e44816bcc enh: support client local merge policy 2022-09-15 14:46:15 +08:00
dapan1121 1427a8f3b0 enh: support client query policy 2022-09-09 19:03:42 +08:00
wangmm0220 c7bf08d5af feat: get snapshot data for taosX 2022-08-24 17:42:33 +08:00
wangmm0220 2afc23a120 fix:conflicts from 3.0 2022-08-24 13:59:51 +08:00
Liu Jicong c296dd0a63 fix compile 2022-08-24 01:48:00 +08:00
Liu Jicong 2d628491b2 feat(stream): support tdb state backend 2022-08-23 19:30:04 +08:00
wangmm0220 78c9f245b1 fix:conflicts from 3.0 2022-08-16 15:18:11 +08:00
wangmm0220 c381ffd38c fix:error in tmq for snapshot 2022-08-09 19:06:24 +08:00
Haojun Liao b9c6e0cdf9 refactor: stream invoke previous APIs. 2022-08-09 13:55:51 +08:00
Haojun Liao a2a1da06dd other:merge 3.0 2022-08-09 13:45:44 +08:00
Haojun Liao 4d8842c21f other:merge 3.0 2022-08-08 16:37:37 +08:00
wangmm0220 9f9788c205 Merge branch '3.0' into feature/TD-14761 2022-08-08 10:04:03 +08:00
wangmm0220 1309c489e2 fix:error in tmq for snapshot 2022-08-06 19:31:53 +08:00
dapan1121 fd654b126a fix: fix taosd memory leak issue 2022-08-06 18:00:26 +08:00
wangmm0220 f28155714e fix:confilcts from 3.0 2022-08-06 12:31:15 +08:00
wangmm0220 45e7597df3 feat:get data from snapshot for taosx 2022-08-05 21:12:18 +08:00
Cary Xu a179b6e64d fix: solve stream input data block leak 2022-08-05 01:37:54 +08:00
dapan1121 27d223356a enh: merge multiple blocks in one rsp msg 2022-08-04 20:41:30 +08:00
wangmm0220 c3cd858a63 feat:add snapshot for tmq in stable and db 2022-08-04 15:01:59 +08:00
Haojun Liao ed57347579 fix(query): fix memory leak. 2022-07-30 11:30:31 +08:00
Liu Jicong cf54ec5551
Merge pull request #15475 from taosdata/feature/stream
refactor(stream): remove option
2022-07-27 21:56:26 +08:00
Liu Jicong ba0c1b3689 refactor(stream) 2022-07-27 20:11:03 +08:00
wangmm0220 2ba6ac5fba feat:add ts,table name from SDeleterRes 2022-07-27 17:11:57 +08:00
Liu Jicong 5e1bbe0e7e refactor(sma): remove option 2022-07-27 16:55:23 +08:00
wangmm0220 ba1962cacf feat:add tmq get data interface 2022-07-26 17:43:22 +08:00
Haojun Liao e9936db95e other: merge 3.0 2022-07-23 09:37:23 +08:00
Haojun Liao 4a7a85ab07 other: merge 3.0 2022-07-23 00:02:53 +08:00
Haojun Liao 998dedb9fa other: merge 3.0 2022-07-22 21:16:52 +08:00
Liu Jicong e1046c7a98 fix: memory leak 2022-07-22 18:11:29 +08:00
Liu Jicong 2441ec22bd feat(tmq): check alter for ntb 2022-07-22 16:05:28 +08:00
Haojun Liao ee34c3bb3e fix(query): add query involved column info 2022-07-21 11:20:30 +08:00
Haojun Liao 282630a394 Merge branch '3.0' into feature/3_liaohj 2022-07-19 17:42:45 +08:00
Haojun Liao cd2eaf0152 fix(query): set the output column number for subscribe. 2022-07-19 16:01:28 +08:00
54liuyao 8e41fc912b feat(stream): add num of children 2022-07-19 14:17:53 +08:00
Liu Jicong 9394e3380f feat(stream): recover from failure 2022-07-15 17:58:53 +08:00
Liu Jicong 8a6e4b877a refactor(stream): simple batch 2022-07-13 16:37:33 +08:00
Liu Jicong d637ffe22c refactor(tmq): prepare only needed 2022-07-12 14:10:22 +08:00
Haojun Liao ac8e9d103c other: merge 3.0 2022-07-10 17:40:55 +08:00
Haojun Liao 7dc7f478de refactor: do some internal refactor and fix some memory leak. 2022-07-10 17:34:21 +08:00
Liu Jicong 9189f886a9 feat(tmq): support consume from tsdb then wal 2022-07-10 16:34:45 +08:00
Liu Jicong a2107992e2 refactor(stream) 2022-07-10 11:18:15 +08:00
Liu Jicong 938868e39f merge from 3.0 2022-07-08 17:57:11 +08:00
Liu Jicong 3cd5a35054 refactor(stream): internal refactor 2022-07-08 17:48:34 +08:00
dapan1121 0925064d24 Merge branch 'feature/3.0_debug_wxy' into feature/insertselect 2022-07-08 10:28:53 +08:00
Liu Jicong 866e4c4be0 refactor(stream): internal refactor 2022-07-07 17:56:52 +08:00
dapan1121 d4696ef31f Merge branch '3.0' into feature/insertselect 2022-07-07 09:02:09 +08:00
dapan1121 d625cc2e47 feat: insert from query 2022-07-06 21:00:31 +08:00
dapan1121 0d4fb5bb80 feat: support insert from query 2022-07-06 16:29:51 +08:00
Liu Jicong 8c5dbde918 refactor(stream): stream reader created in scanner 2022-07-06 14:20:07 +08:00
dapan1121 39a31e8d25 fix: remove mock code 2022-07-05 10:52:33 +08:00
Hongze Cheng ddb198de23 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/tsdb_refact 2022-07-04 03:42:50 +00:00
Liu Jicong 94f07836d6 fix(tmq): set scan rsp offset correctly 2022-06-30 17:25:19 +08:00
Liu Jicong 4695dc2dae feat(tmq): add snapshot test 2022-06-30 14:41:50 +08:00
Liu Jicong 0f0fe6276a merge from 3.0 2022-06-29 21:33:10 +08:00
Liu Jicong c2955a807b feat(tmq): offset support snapshot 2022-06-29 21:04:51 +08:00
Haojun Liao 1b8c5d9269 enh(query): add api to extract scan status 2022-06-29 16:19:19 +08:00
dapan1121 bd7a2adc5f add mock code 2022-06-28 17:13:51 +08:00
wangmm0220 0d9ed6d60a fix:merge from 3.0 2022-06-24 13:51:33 +08:00
Shengliang Guan 750a046e31
Merge pull request #14153 from taosdata/enh/delete
enh: modify delete output res
2022-06-23 14:52:33 +08:00
dapan1121 95c1b00056 enh: modify delete output res 2022-06-23 14:25:30 +08:00
Liu Jicong 4ed47a0296 feat(tmq): scan tsdb as snapshot 2022-06-23 13:35:24 +08:00
Haojun Liao d2f8a330e1 refactor(query): do some internal refactor. 2022-06-17 20:09:49 +08:00
Haojun Liao 2360f072a8 fix(query): add indef process procedure. 2022-06-16 11:43:11 +08:00
Liu Jicong 8eb08fa0d4 feat(stream): trigger mode add max delay 2022-06-15 16:11:20 +08:00
dapan1121 33a7a83d65 feature delete data 2022-06-06 20:59:36 +08:00
Liu Jicong 77fe6a4ef7
Merge branch '3.0' into feature/3_liaohj 2022-06-02 15:05:49 +08:00
dapan1121 496ae4ca89 schedule based on qnode's load 2022-05-31 14:03:47 +08:00
Haojun Liao d87bb5f3fa refactor(query): set the block groupId for stream block. 2022-05-27 10:03:45 +08:00
Haojun Liao 1652cd0ec2 enh(query): enable twa function in select clause. 2022-05-29 12:35:11 +08:00
Haojun Liao 47e6e95866 enh(query): record and return the schema version and tags version of current queried table. 2022-05-18 20:39:00 +08:00
Liu Jicong 4e640b6d67 enh(tmq): update tb list for existing topic 2022-05-18 16:27:50 +08:00
Shengliang Guan c8865f3a05 refactor: remove rpc client in executor and scanoperator 2022-05-07 20:19:40 +08:00
Haojun Liao 1d8af5d4cf fix(query): fix memory leak. 2022-05-07 15:11:49 +08:00
Haojun Liao d9aa35ecfe fix(query): revise the output data column info in the exchange operator to be adaptable for the case of extensive datablocks. 2022-04-28 18:08:56 +08:00
Haojun Liao 47a9b26507 fix(query): show tables in information_schema db. 2022-04-28 15:30:18 +08:00
Haojun Liao d62ddcf2db enh(query): add more information for the result of show tables. 2022-04-27 15:17:15 +08:00
dapan1121 7602f91612 feature/qnode 2022-04-01 19:45:45 +08:00
Haojun Liao e8f0d4df0b [td-13039] support stream execution interval query. 2022-03-30 14:54:00 +08:00
Liu Jicong 4fd6f59092 stream set multi input 2022-03-29 15:24:25 +08:00
Haojun Liao bdbb984894 [td-13039] add new api. 2022-03-29 13:31:17 +08:00
Haojun Liao 33d5f1ac22
Merge branch '3.0' into feature/3.0_liaohj 2022-03-23 10:02:47 +08:00
Haojun Liao d82e66b7c2 [td-13039] merge 3.0 and fix bug. 2022-03-22 23:29:38 +08:00
Liu Jicong af67c49f0e
Merge branch '3.0' into feature/tq 2022-03-22 19:25:55 +08:00
Liu Jicong d3104e78ec stream task exec 2022-03-22 18:00:03 +08:00
Haojun Liao 1c1c95edee [td-13039] merge 3.0 2022-03-21 18:34:42 +08:00
Haojun Liao fcb058cee4 [td-13039] support scan ssdatablock. 2022-03-21 16:15:51 +08:00
Haojun Liao 84818987b3 [td-13039] fix bug in show tables; 2022-03-21 15:25:13 +08:00
dapan1121 43d7912987 feature/scheduler 2022-03-15 15:34:17 +08:00