Commit Graph

254 Commits

Author SHA1 Message Date
Haojun Liao 18b121c69c fix(tmq): fix the invalid write and do some internal refactor. 2023-03-21 13:45:43 +08:00
wangmm0220 ccba1d07c6 fix:error in TD-23218 & remove useless logic 2023-03-18 18:42:49 +08:00
wangmm0220 7616a283e3 fix:error in TD-23218 & remove useless logic 2023-03-18 18:23:38 +08:00
Haojun Liao 253a760810 fix(query): set the correct cached tags list key length, and update some logs. 2023-03-15 14:30:12 +08:00
Haojun Liao 32ddecc347 other: merge main. 2023-03-14 12:13:09 +08:00
Haojun Liao 7f2aae69d4 fix(tmq): fix error in taosx 2023-03-13 01:54:29 +08:00
54liuyao 84ef1c78d4 fix:auto fill null column 2023-03-11 11:33:50 +08:00
wangmm0220 86ef6522ae fix:wal curVersion error if switch to wal 2023-03-06 17:40:02 +08:00
Haojun Liao 22a85734c6 fix(mq): add more chek for balance couner to avoid the negative value emerges. 2023-03-05 13:23:50 +08:00
Haojun Liao 24bb33f24a refactor: add some logs. 2023-03-03 18:34:38 +08:00
wangmm0220 986ae9c4d0 fix:conflicts 2023-02-28 15:11:16 +08:00
Haojun Liao d18dd3067b other: merge main. 2023-02-28 00:38:37 +08:00
wangmm0220 c638564179 fix:confilcts from main 2023-02-26 23:09:57 +08:00
Haojun Liao b46098793d refactor: do some internal refactor and add some logs for tmq. 2023-02-26 12:16:45 +08:00
Xiaoyu Wang d6dd087f84 merge main 2023-02-25 10:29:20 +08:00
wangmm0220 54a546931c fix:optimize version logic in tmq and remove useless code 2023-02-24 19:22:08 +08:00
Haojun Liao 6e39bec448
Merge pull request #20089 from taosdata/fix/TD-22671
fix:remove useless logic in tmq
2023-02-23 17:27:00 +08:00
Xiaoyu Wang 1ab144609e merge main 2023-02-23 14:58:22 +08:00
Haojun Liao b203107922
Merge branch 'main' into feature/3_liaohj 2023-02-23 10:22:17 +08:00
Haojun Liao 6015729560 refactor: add some logs. 2023-02-23 09:21:32 +08:00
wangmm0220 b28c0ad952 fix:remove useless logic in tmq 2023-02-21 18:49:39 +08:00
Haojun Liao 8d187efc18 refactor:do some internal refactor. 2023-02-20 10:04:08 +08:00
Xiaoyu Wang 0f4de9daec feat: compatible with older versions of wal 2023-02-17 18:06:57 +08:00
wangmm0220 0e630b8f81 fix:remove id in execReader & enable task case 2023-02-13 13:38:05 +08:00
wangmm0220 c8d49b603d fix:roll back htol length for block raw data 2023-02-02 17:23:01 +08:00
wangmm0220 2bf0916bcf fix:split block data if there are none value in block for taosx 2023-02-01 16:12:59 +08:00
wangmm0220 4128c5653c fix:error in tmq for taosx 2023-01-30 17:23:04 +08:00
wangmm0220 d96cdff8f3 fix:add logic for auto create table while inserting data for taosx 2023-01-28 18:25:43 +08:00
Xiaoyu Wang 0c269c317b merge 3.0 2022-12-23 17:50:05 +08:00
Liu Jicong 2a7de0cd46 refactor: remove assert 2022-12-21 13:54:14 +08:00
Haojun Liao fdade6d6a3
Merge branch '3.0' into refact/submit_req 2022-12-19 11:24:00 +08:00
Haojun Liao e3e42cdfbd fix(query): set update ts flag for stream. 2022-12-13 00:16:40 +08:00
Liu Jicong 2c13c8b357 check null ptr 2022-12-08 11:47:52 +08:00
Liu Jicong 43233b9798 refactor 2022-12-08 09:48:23 +08:00
Liu Jicong 271822ebc4 refactor: support submitreq2 2022-12-08 01:55:47 +08:00
Liu Jicong 9e7bbf622a refactor: support submitreq2 2022-12-07 17:54:09 +08:00
Liu Jicong c5dc7e8227 refactor: support submitreq2 2022-12-07 16:39:46 +08:00
Liu Jicong b133a56219 refactor: support submitreq2 2022-12-07 15:19:34 +08:00
Liu Jicong 619bbdfd82 refactor: support submitreq2 2022-12-06 05:58:28 +08:00
Haojun Liao 6e81e8cc73 refactor: do some internal refactor. 2022-11-28 12:32:40 +08:00
Haojun Liao 0948216ca9 fix(query): fix dead lock. 2022-11-26 21:13:34 +08:00
Liu Jicong 9358429e78 Merge branch '3.0' into feature/stream 2022-11-21 20:54:21 +08:00
Liu Jicong 5d471a0ceb enh(taosx): split block when none column not match 2022-11-21 15:32:27 +08:00
Liu Jicong 9a603e5663 enh(stream): put user defined tb name into stream state 2022-11-18 17:21:50 +08:00
Liu Jicong ccd3bb20a7 fix: reset cache when table is dropped 2022-11-15 14:10:46 +08:00
Liu Jicong f0a66602da fix(taosx): set version 2022-11-01 19:28:42 +08:00
Liu Jicong 94e7c79ca0 fix(tmq): handle adding subtable for subscribing stb 2022-11-01 18:18:26 +08:00
54liuyao 796cf764f4 fix(executor):add lock to hash map 2022-10-25 17:54:01 +08:00
Shengliang Guan 66a5f6cc8d
Merge pull request #17255 from taosdata/feature/stream
fix: coverity scan
2022-10-10 13:44:07 +08:00
Liu Jicong b1594a6857 fix coverity scan 2022-10-10 11:44:17 +08:00
Minglei Jin 997dfb41d9 fix(meta): use rwlock to favor writers 2022-10-10 11:00:55 +08:00
Liu Jicong cde4085a6d optimize msg batch 2022-09-28 20:24:02 +08:00
Liu Jicong 0e8aaf4c9e feat(tmq): push optimization 2022-09-28 10:38:49 +08:00
wangmm0220 a54f71a03c fix:error in auto create table for taosX 2022-09-16 18:57:33 +08:00
wangmm0220 c5874ca892 fix: add filter logic for tmq in stable wal 2022-08-31 18:32:28 +08:00
wangmm0220 c7bf08d5af feat: get snapshot data for taosX 2022-08-24 17:42:33 +08:00
wangmm0220 f2912a17ba fix:conflicts from 3.0 2022-08-19 16:38:23 +08:00
Liu Jicong 2b092f6551 fix(query): memory leak 2022-08-18 18:39:21 +08:00
wangmm0220 d2727b6252 feat:merge from 3.0 2022-08-18 10:45:20 +08:00
Liu Jicong 357b21cfeb refactor(tmq): use tdb to store check info 2022-08-17 13:58:56 +08:00
wangmm0220 78c9f245b1 fix:conflicts from 3.0 2022-08-16 15:18:11 +08:00
Cary Xu a5ef854e87 row: code optimization 2022-08-11 07:45:49 +08:00
Cary Xu 1d6d0aa2db enh: row iter and fetch optimization 2022-08-10 17:26:44 +08:00
Liu Jicong bb0ce39511 refactor(stream): add stream meta 2022-08-08 15:05:54 +08:00
wangmm0220 f28155714e fix:confilcts from 3.0 2022-08-06 12:31:15 +08:00
wangmm0220 45e7597df3 feat:get data from snapshot for taosx 2022-08-05 21:12:18 +08:00
Liu Jicong 7c9d57bd89 refactor(stream): unify sink and dispatch 2022-08-05 20:16:47 +08:00
wangmm0220 c3cd858a63 feat:add snapshot for tmq in stable and db 2022-08-04 15:01:59 +08:00
Shengliang Guan 56f2e49764 refactor: adjust logs 2022-08-02 17:12:07 +08:00
Liu Jicong 095f6aa4e0 fix(tmq): correctly set reader status 2022-07-23 20:07:16 +08:00
Liu Jicong e1046c7a98 fix: memory leak 2022-07-22 18:11:29 +08:00
Liu Jicong eaf11ca1ac refactor(tmq): disable parallel 2022-07-21 20:15:52 +08:00
Liu Jicong 81d8d2b937 feat(stream): add version in stream block 2022-07-21 17:27:44 +08:00
Liu Jicong bc1af6deaf refactor(stream): batch optimization for submit msg 2022-07-19 15:52:08 +08:00
Liu Jicong d75e9b8f6a merge from 3.0 2022-07-14 15:35:00 +08:00
Liu Jicong 9ea0ad57ec refactor(stream): destroy stream task 2022-07-14 15:32:21 +08:00
Haojun Liao 75aca0b031 fix(query): set correct fill output column index, fix some memory leak, and do some internal refactor, 2022-07-14 13:53:23 +08:00
Liu Jicong 8afb54548f refactor(stream) 2022-07-10 13:21:37 +08:00
Liu Jicong e9077c036f merge from 3.0 2022-07-10 11:24:37 +08:00
Liu Jicong a2107992e2 refactor(stream) 2022-07-10 11:18:15 +08:00
Shengliang Guan c53a84b733 Merge remote-tracking branch 'origin/3.0' into fix/valgrind 2022-07-09 20:13:26 +08:00
Liu Jicong 8d01ae00cb fix(tmq): offset 2022-07-08 21:37:15 +08:00
Liu Jicong a9e75c87aa refactor(stream): internal refactor 2022-07-08 19:30:40 +08:00
Shengliang Guan a5e8ddbc56 refactor: adjust logs 2022-07-08 18:00:19 +08:00
Liu Jicong 3cd5a35054 refactor(stream): internal refactor 2022-07-08 17:48:34 +08:00
Liu Jicong 866e4c4be0 refactor(stream): internal refactor 2022-07-07 17:56:52 +08:00
Liu Jicong 4a2b266612 feat(stream): support ignore expired flag 2022-07-02 10:59:29 +08:00
Liu Jicong 52d09b4173 refactor(wal) 2022-07-01 14:39:21 +08:00
Liu Jicong c2955a807b feat(tmq): offset support snapshot 2022-06-29 21:04:51 +08:00
Liu Jicong 383e7a495b fix(query): enable output check 2022-06-28 13:45:50 +08:00
Liu Jicong 0c1a51bad6 enh(stream): refine tqRetrieveDataBlock api 2022-06-25 20:03:29 +08:00
54liuyao 10e90ce973 feat(stream): auto pull data 2022-06-25 16:44:14 +08:00
Liu Jicong 0964b07229 fix(stream): support none type in submit msg 2022-06-24 21:44:53 +08:00
Liu Jicong b884ca9db7 refactor(stream): seperate stream scheduling and persistence 2022-06-24 14:19:12 +08:00
Liu Jicong f2f5d68f3b fix(stream): memory leak 2022-06-23 22:05:00 +08:00
Haojun Liao 2d31d3cb43 other: merge 3.0 2022-06-23 10:37:07 +08:00
Liu Jicong 14a488c92c feat(stream): stream support multiple type input 2022-06-22 21:21:39 +08:00
Haojun Liao 5c1e7f3114 Merge branch '3.0' into feature/3_liaohj 2022-06-22 17:23:57 +08:00
Haojun Liao 14ddf539e0 refactor(query): do some internal refactor. 2022-06-22 17:21:04 +08:00
Liu Jicong 3f6ce2da73 feat(tmq): support topic with meta 2022-06-21 15:18:09 +08:00
Liu Jicong d3cf004164 fix(tmq): false cache 2022-06-10 18:04:03 +08:00
Hongze Cheng e1967b5708 fix ci problem 2022-06-07 07:56:33 +00:00
Liu Jicong 2677a3c8d9 refactor(stream) 2022-06-06 20:15:36 +08:00
Liu Jicong e1a5000e50 refactor(tmq): tq sink and push 2022-06-01 17:26:15 +08:00
Liu Jicong 451d19f986 feat(tmq): create topic new grammar 2022-05-31 16:20:40 +08:00
Liu Jicong 2de2eafaa8 feat(tmq): use tdb as persistent storage 2022-05-24 20:35:37 +08:00
Liu Jicong 452b154eb9 enh(tmq): add error log 2022-05-22 21:20:36 +08:00
Liu Jicong 30671eaadf fix(tmq): skip dropped table for db subscription 2022-05-22 20:35:57 +08:00
Liu Jicong dacbfc03cd test(tmq): enable drop table case 2022-05-20 23:24:51 +08:00
Haojun Liao ee470a9427 other: merge 3.0 2022-05-20 17:12:04 +08:00
Haojun Liao fa84d0585b enh(query): enable remove the candidate table ids in the stream scanner. 2022-05-20 17:07:53 +08:00
Liu Jicong 71984b4268 refactor(stream): exec 2022-05-20 05:43:36 +08:00
Liu Jicong 2174b5e48e enh(tq): update tb uid when droping table 2022-05-19 16:46:12 +08:00
Hongze Cheng 65edd3296e feat: alter super table 2022-05-14 14:29:04 +00:00
Liu Jicong b8f7526361 fix(tmq): msg schema 2022-05-13 19:09:36 +08:00
54liuyao 3b73dc295f set table uid 2022-05-07 11:53:08 +08:00
Haojun Liao 2b803d8b93 enh(query): set uid for the result datablock of stream scanner when handling the submit block. 2022-05-06 23:40:26 +08:00
Cary Xu 5a0ae19cbc feat: submit req msg iter refactor 2022-05-01 10:50:23 +08:00
Liu Jicong 5c36e4e519 fix: subscrption api 2022-04-29 14:34:30 +08:00
Hongze Cheng 42c6f01980 refact vnode includes 2022-04-26 11:04:26 +00:00
Cary Xu b3058e2611 bug fix 2022-04-26 11:46:21 +08:00
Cary Xu d1b07a1abf merge 3.0 2022-04-25 21:14:01 +08:00
Cary Xu ad9101d3de feat: rollup sma data gen 2022-04-25 21:08:11 +08:00
Liu Jicong 609b21647b fix: msg with schema 2022-04-25 15:40:25 +08:00
Liu Jicong 9a3365e1f1 fix pointer type 2022-04-22 10:59:09 +08:00
Liu Jicong d51336384f feat(tmq): add db subscribe 2022-04-22 10:55:17 +08:00
Liu Jicong 3dd3ad1e05 refactor(tmq): rewrite tq read function 2022-04-21 14:30:37 +08:00
Liu Jicong a98bf9d1b5 add convert for rSma 2022-04-21 14:19:58 +08:00
Liu Jicong 9225155119 rewrite tq read handle 2022-04-21 13:56:37 +08:00
Haojun Liao a036d2f3ff fix(query): fix the bug caused by refactor in first/last function implementation. 2022-04-19 13:07:23 +08:00
Hongze Cheng bb6806b59e refact vnode 2022-04-14 02:25:49 +00:00
Hongze Cheng 272d0ec74a refact vnode 2022-04-14 02:10:56 +00:00
Haojun Liao 4c182340d0 fix[query]:disable the assignment of table uid to ssdatablock. 2022-04-09 19:32:50 +08:00
Liu Jicong 32cc09ae8c remove bdb 2022-04-08 17:52:24 +08:00
Haojun Liao 7b0dfc6c4e [td-13039] support limit/offset 2022-04-01 17:21:24 +08:00
Liu Jicong e21ba1637e revert uid 2022-03-31 18:39:11 +08:00
Liu Jicong 3e5da8bedb fix 2022-03-31 15:52:54 +08:00
Liu Jicong a9ad7ebd10 merge from 3.0 2022-03-29 18:58:15 +08:00
Liu Jicong 09bef18578 add case 2022-03-29 17:13:10 +08:00
Liu Jicong 4fd6f59092 stream set multi input 2022-03-29 15:24:25 +08:00
Liu Jicong fc232212c2 fix submit msg scanner 2022-03-29 11:37:33 +08:00
Cary Xu d4c636589a update definition of SSchema/STColumn to support columns larger than 1MB(int16_t to int32_t) 2022-03-27 10:42:23 +08:00
afwerar 222db126bc [TD-13758]<fix>: redefine memory api. 2022-03-26 00:29:53 +08:00
Xiaoyu Wang 1a785a5294 SSubmitBlk add suid field 2022-03-24 04:46:56 -04:00
Liu Jicong 58122d07d7 add stream trigger 2022-03-23 17:00:21 +08:00
Xiaoyu Wang c2b4ec91ff tmq plan implement 2022-03-18 05:44:08 -04:00
Liu Jicong 36d4ef0af6 refactor stream worker 2022-03-14 20:32:19 +08:00
Liu Jicong 913e8d70d8 define stream token 2022-03-09 19:51:08 +08:00
Liu Jicong 402a5e3b61 add scheduler 2022-03-07 16:30:28 +08:00
Liu Jicong 7ee6657cf7 extract convert to set msg 2022-02-21 10:48:23 +08:00