Commit Graph

8965 Commits

Author SHA1 Message Date
Shungang Li b649a73a19 feat: pk insert/drop last cache 2024-04-07 17:30:54 +08:00
kailixu b4c8375cb9 chore: solve conflicts 2024-04-07 14:53:05 +08:00
Haojun Liao 16c17bbf72 fix(tsdb): fix error in tsdbread. 2024-04-07 14:46:22 +08:00
dmchen c43e937538 write config lock 2024-04-07 02:24:41 +00:00
Haojun Liao ead77fe767 fix(tsdb): fix memory leak. 2024-04-07 10:23:51 +08:00
Haojun Liao e7ed8fbaa6 fix(tsdb): not copy range key if no pk exists. 2024-04-06 00:10:24 +08:00
Haojun Liao dc954e112e fix(tsdb): add key for lastProcessKey, and remove invalid assign for key 2024-04-05 19:47:59 +08:00
Haojun Liao 5184e444df Merge branch '3.0' into fix/3_liaohj 2024-04-02 18:45:49 +08:00
Haojun Liao 24559725da fix(stream): add lock for when set checkpoint dispatch msg. 2024-04-02 18:45:30 +08:00
yihaoDeng a7058668d5 fix compatible error 2024-04-02 10:41:38 +00:00
Haojun Liao 94e6f96a75 other: merge 3.0 2024-04-02 13:39:26 +08:00
yihaoDeng 684055bc7c Merge branch '3.0' into feature/compressData 2024-04-02 04:20:39 +00:00
yihaoDeng d85ae3c26e fix invalid free 2024-04-02 12:14:02 +08:00
Haojun Liao aff681ac64 fix(tsdb):set correct varchar type compare function. 2024-04-02 10:43:38 +08:00
dmchen d06bfd9cea free and log 2024-04-02 02:30:56 +00:00
yihaoDeng cb27761e66 Merge branch '3.0' into feature/compressData 2024-04-01 13:14:37 +00:00
Hongze Cheng c28ee64477 fix: meta snapshot drop table error 2024-04-01 21:11:35 +08:00
yihaoDeng ec35f5718e fix invalid free 2024-04-01 19:58:04 +08:00
dmchen a1b7444a48 refactor 2024-04-01 09:39:29 +00:00
yihaoDeng a77d98cab6 Merge branch '3.0' into feature/compressData 2024-04-01 08:40:50 +00:00
kailixu c4aba0ac37 feat: encryption key optimize and test case adjust 2024-04-01 16:14:55 +08:00
yihaoDeng 53ecfe511a Merge branch '3.0' into feature/compressData 2024-04-01 08:04:16 +00:00
kailixu 717c4b3d9c chore: restore codes 2024-04-01 14:01:09 +08:00
kailixu 6eaa99bb2d feat: encryption algorithm 2024-04-01 13:58:13 +08:00
yihaoDeng 237ec5a46c fix ci error 2024-04-01 01:39:50 +00:00
wangmm0220 fe7a42b118 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-01 09:11:39 +08:00
yihaoDeng 22f9830bbb fix ci error 2024-03-31 12:51:27 +00:00
yihaoDeng e71eefddfc Merge branch 'feat/TS-4243-3.0' into feature/compressData 2024-03-30 14:58:29 +00:00
yihaoDeng cad8fec42e Merge branch '3.0' into feature/compressData 2024-03-30 13:59:45 +00:00
yihaoDeng aa5ccf2b0b Merge branch '3.0' into feature/compressData 2024-03-30 09:57:23 +00:00
yihaoDeng 0cce8df6b5 Merge branch '3.0' into feature/compressData 2024-03-30 02:00:24 +00:00
yihaoDeng d7cee5dd80 fix invalid compress/decompress 2024-03-29 13:48:58 +00:00
Haojun Liao dd2f6287ec fix(tsdb): fix rowkey assign error. 2024-03-29 18:59:29 +08:00
Haojun Liao 55bb6ab341 fix(tsdb): set correct initial value for compare 2024-03-29 18:15:03 +08:00
yihaoDeng b7067e61c8 fix ci error 2024-03-29 08:40:19 +00:00
kailixu 8dce61b68f chore: merge TD-29280-3.0 2024-03-29 11:39:46 +08:00
dmchen b9deb71fc5 basic function 2024-03-29 02:48:49 +00:00
factosea 9ddc0b51cb merge 2024-03-29 10:37:59 +08:00
wangmm0220 8e2a2414c0 fix:same subtable same partition by leads to same table name in stream 2024-03-28 13:48:46 +08:00
kailixu d64594932b feat: support database encryption 2024-03-27 20:03:38 +08:00
Haojun Liao a2112625f9 fix(tsdb): set correct uid list. 2024-03-27 15:06:51 +08:00
yihaoDeng 18986c0ced refactor code 2024-03-26 12:44:53 +00:00
Haojun Liao f61596706d fix(tsdb): add attributes for cache scan optr. 2024-03-26 17:34:30 +08:00
yihaoDeng 02e0e45183 refactor code 2024-03-26 08:50:21 +00:00
Hongze Cheng ee4dda56c1 more code 2024-03-26 14:43:28 +08:00
yihaoDeng ab69c2e750 refactor code 2024-03-26 03:28:31 +00:00
Haojun Liao 52a04cd008 fix(tsdb): fix bug for filter brin record. 2024-03-26 10:55:56 +08:00
Haojun Liao 765546585a
Merge pull request #25184 from taosdata/fix/3_liaohj
fix(stream): not return error when failing to load stream task meta.
2024-03-26 10:29:42 +08:00
Haojun Liao a70d5a4947 fix(tsdb): fix bug during filtering brin records. 2024-03-26 09:50:06 +08:00
Haojun Liao 9638f8d7fc fix(tsdb): set the correct sttkey 2024-03-26 00:14:46 +08:00
Haojun Liao a11b2c614e fix(stream): not return error when failing to load stream task meta. 2024-03-25 23:49:26 +08:00
Haojun Liao 5c729cc836 refactor: do some internal refactor. 2024-03-25 17:57:59 +08:00
Haojun Liao 750ea5789f fix(tsdb): fix errors identified by CI. 2024-03-25 14:20:46 +08:00
Minglei Jin ea424e822e fix(tsdb/util): fix missing column value with row iter 2024-03-25 11:00:33 +08:00
Haojun Liao 75d6b1edde fix(tsdb): fix the bug caused by sttKey changing. 2024-03-25 09:59:10 +08:00
yihaoDeng 54294f6479 refactor code 2024-03-24 09:24:40 +00:00
yihaoDeng 3ccf9942a9 refactor code 2024-03-24 05:35:07 +00:00
Haojun Liao 447b8ddd32 fix(tsdb): remove invalid assert. 2024-03-23 23:33:40 +08:00
yihaoDeng 2d6c9ec7de fix mem problem 2024-03-23 12:56:24 +00:00
yihaoDeng cbb4e83fc4 fix mem problem 2024-03-23 12:12:39 +00:00
yihaoDeng f5c8c8f7c5 fix mem problem 2024-03-23 11:49:09 +00:00
Haojun Liao c35e834141 fix(tsdb): fix error. 2024-03-23 00:11:21 +08:00
Haojun Liao 17a65430cd fix(tsdb): remove assert 2024-03-22 18:42:54 +08:00
wangmm0220 912cb09839 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-03-22 18:22:13 +08:00
Haojun Liao ef6ea16d64 other: merge 3.0 2024-03-22 17:57:25 +08:00
Haojun Liao 9f492a8962 other: merge 3.0 2024-03-22 17:53:11 +08:00
wangmm0220 f1853ced26 feat:[TS-4243] add logic for primark key in tmq 2024-03-22 17:48:59 +08:00
Haojun Liao ca28bb60ef refactor: do some internal refactor. 2024-03-22 17:32:12 +08:00
Haojun Liao 5808c1b86f refactor: do some internal refactor. 2024-03-22 17:31:44 +08:00
Haojun Liao cbf22ed72a refactor: do some internal refactor. 2024-03-22 17:26:56 +08:00
Haojun Liao 018e6f2a71 refactor: do some internal refactor. 2024-03-22 17:18:31 +08:00
Haojun Liao 2ec24c1e04 refactor: do some internal refactor. 2024-03-22 16:43:34 +08:00
Hongze Cheng e36e7d0427 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-22 15:14:32 +08:00
Hongze Cheng 974691e84b fix coredump 2024-03-22 15:14:23 +08:00
Haojun Liao 7d2110bb12 refactor: do some internal refactor. 2024-03-22 15:09:30 +08:00
Haojun Liao a8a0e3edf8 refactor: do some internal refactor. 2024-03-22 14:47:00 +08:00
Haojun Liao 8c5ec3205c refactor: do some internal refactor. 2024-03-22 10:56:04 +08:00
kailixu fb2667d92d fix: sys table scan and meta query 2024-03-22 10:33:46 +08:00
Haojun Liao ecd09059f5 fix(tsdb): fix error in reading data from file block 2024-03-22 10:16:56 +08:00
yihaoDeng 2903d568ea add test 2024-03-21 11:06:46 +00:00
Haojun Liao 8bdd12c3a8 refactor: do some internal refactor. 2024-03-21 17:47:40 +08:00
Haojun Liao fd8f065c67 refactor: do some internal refactor. 2024-03-21 15:08:23 +08:00
Haojun Liao 0c578ab6c0 refactor: do some internal refactor. 2024-03-21 10:44:27 +08:00
Haojun Liao b12e65d144 fix(tsdb): set pk column index. 2024-03-21 09:37:46 +08:00
Haojun Liao 1d77cde433 refactor: do some internal refactor. 2024-03-20 23:03:48 +08:00
Haojun Liao 55f7bc2c9c fix(tsdb):add attributes for ssdatablock. 2024-03-20 15:29:05 +08:00
Haojun Liao 78b0d3fa74 fix(tsdb): fix error in comparing pk. 2024-03-20 14:27:48 +08:00
Haojun Liao 5ed0283494 fix(tsdb): support composite primary key. 2024-03-20 14:17:37 +08:00
Haojun Liao 7ff383cb1f
Merge pull request #25116 from taosdata/fix/3_liaohj
fix(stream):adjust current offset by using the scanning version, not …
2024-03-19 16:44:58 +08:00
Hongze Cheng a9c1bcc91c
Merge pull request #25097 from taosdata/feat/TD-25880
feat: support 2 replica with arbitrator
2024-03-19 16:44:07 +08:00
Haojun Liao 65e4048f5d Merge branch '3.0' into fix/3_liaohj 2024-03-19 15:36:07 +08:00
Haojun Liao 77f8dbeeb9 refactor: do some internal refactor. 2024-03-19 15:21:23 +08:00
Haojun Liao 1c2c2b2b9a refactor: do some internal refactor. 2024-03-19 15:20:38 +08:00
Haojun Liao 6795f6e1cc fix(tsdb): handle the case that no stt statistics info existsin stt files generated by early version of TDengine. 2024-03-19 15:16:46 +08:00
Shungang Li 3a656c3595 feat: support 2 replica with arbitrator 2024-03-19 09:30:35 +08:00
wangmm0220 0ccad9d5de Merge branch '3.0' of https://github.com/taosdata/TDengine into mark/tmq-opti 2024-03-18 21:23:58 +08:00
yihaoDeng cd5f8ea415 tsdb support compress 2024-03-18 12:13:35 +00:00
yihaoDeng d31c7f40c7 tsdb support compress 2024-03-18 12:12:55 +00:00
yihaoDeng 3964f01793 fix invalid read 2024-03-18 07:23:55 +00:00
wangmm0220 5624efff4e opti:tmq 2024-03-18 14:31:40 +08:00
Haojun Liao 2b706f00ad refactor(meta): add some logs. 2024-03-18 14:16:49 +08:00
Haojun Liao 7bdabc309b Merge branch '3.0' into fix/3_liaohj 2024-03-18 14:16:15 +08:00
Hongze Cheng a962441252
Merge pull request #25106 from taosdata/fix/TD-29064-3.0
fix: delete table snapshot coredump
2024-03-18 12:40:52 +08:00
dapan1121 062bdf686e
Merge pull request #25102 from taosdata/fix/TS-4563
fix:[TS-4563]retrieve data error from wal if colid is bigger in tmq
2024-03-17 16:52:29 +08:00
Haojun Liao 74d7a0bd3e
Merge pull request #25112 from taosdata/fix/3_liaohj
fix(meta): fix repeatly reader lock for tsdb meta.
2024-03-16 23:57:55 +08:00
Haojun Liao 15e65d5f07 refactor: do some internal refactor. 2024-03-16 22:42:49 +08:00
yihaoDeng b8fbb804cc tsdb support compress 2024-03-16 14:41:37 +00:00
yihaoDeng c81d90a527 tsdb support compress 2024-03-16 14:31:24 +00:00
yihaoDeng 54d63fe87c tsdb support compress 2024-03-16 14:23:35 +00:00
yihaoDeng 0a03e7ac84 tsdb support compress 2024-03-16 14:01:42 +00:00
yihaoDeng 4fcd80ad27 tsdb support compress 2024-03-16 13:46:50 +00:00
yihaoDeng f607cd60e3 tsdb support compress 2024-03-15 10:22:57 +00:00
Hongze Cheng 6c41fa48dd fix: delete table snapshot coredump 2024-03-15 16:55:50 +08:00
wangmm0220 5f687f0d88 fix:[TS-4563]retrieve data error from wal if colid is bigger in tmq 2024-03-15 15:59:03 +08:00
yihaoDeng ec227180e1 add alg to block col 2024-03-14 12:37:15 +00:00
yihaoDeng 646478c6dc Merge branch 'feat/TS-4243-3.0' into feature/compressData 2024-03-14 12:22:58 +00:00
yihaoDeng bdbe9b042c Merge branch 'feature/compressData' of https://github.com/taosdata/TDengine into feature/compressData 2024-03-14 12:20:13 +00:00
yihaoDeng 739e3ba7ab add zstd lib 2024-03-14 12:19:12 +00:00
facetosea 6678a65dc4 merge ts-4243 2024-03-14 19:06:34 +08:00
Haojun Liao f28e994409
Merge pull request #25091 from taosdata/fix/3_liaohj
fix(stream): transfer state before do checkpoint
2024-03-14 17:59:13 +08:00
Haojun Liao 34c849bdbe enh(tsdb): read composed key in stt. 2024-03-14 17:03:57 +08:00
Haojun Liao cc0b32b1f8 fix(stream): transfer state before do checkpoint, to avoid the retrieve and deadlock by using waiting . 2024-03-14 16:13:41 +08:00
yihaoDeng fe10867547 Merge branch '3.0' into feature/compressData 2024-03-14 03:19:39 +00:00
Haojun Liao 15663ab450
Merge pull request #25084 from taosdata/fix/3_liaohj
fix(tsdb): set strict varchar length check.
2024-03-14 11:16:03 +08:00
Haojun Liao 190b02dd1a fix(stream):set correct version for sink/agg tasks. 2024-03-14 10:04:43 +08:00
Haojun Liao 2b7fd0d15c fix(tsdb): set strict varchar length check. 2024-03-14 10:04:14 +08:00
yihaoDeng cc7d5ce484 add api 2024-03-13 12:58:05 +00:00
yihaoDeng a5eebc90cb add api 2024-03-13 12:04:21 +00:00
yihaoDeng 3c11dc4ec1 fix show create table crash 2024-03-13 09:54:14 +00:00
yihaoDeng 5c67a67363 fix desc crash 2024-03-13 08:33:53 +00:00
yihaoDeng 064e7ef017 fix desc crash 2024-03-13 08:03:43 +00:00
54liuyao 3835e0c156 open operator after resume stream 2024-03-12 16:35:55 +08:00
Haojun Liao 0315e5ac63 feat(tsdb): read complex primary key from buf. 2024-03-12 16:22:56 +08:00
Haojun Liao bc98f12798 feat(tsdb): read complex primary key from buf. 2024-03-12 14:06:59 +08:00
Hongze Cheng f6c2a6bba2 more fix 2024-03-11 19:17:30 +08:00
Hongze Cheng 797a30ec02 more fix 2024-03-11 14:25:26 +08:00
Hongze Cheng 409c170404 fix more 2024-03-11 14:18:04 +08:00
Hongze Cheng acbde220bf more bug fix 2024-03-08 17:04:26 +08:00
yihaoDeng a52213dd23 fix create stable error 2024-03-08 08:40:33 +00:00
Hongze Cheng fbc52d2a9c Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-08 13:15:11 +08:00
Hongze Cheng 710a8ccbf2 fix more code 2024-03-08 13:14:54 +08:00
dapan1121 2349b28c12
Merge pull request #25024 from taosdata/fix/TS-4540
fix:[TS-4540]seperate block if insert in one sql when subscribe query
2024-03-08 10:50:30 +08:00
Hongze Cheng 1d49fc6148 fix more code 2024-03-08 10:43:40 +08:00
Hongze Cheng 7ffcb60f02 fix more code 2024-03-07 16:04:51 +08:00
Hongze Cheng f43a7a6153 fix copy bug 2024-03-07 15:43:15 +08:00
Hongze Cheng f6a5144972 more code 2024-03-07 14:40:42 +08:00
dmchen 69741d6e10 fix/TS-4535 2024-03-07 06:33:45 +00:00
wangmm0220 80f55abc61 fix:[TS-4540]seperate block if insert in one sql when subscribe query 2024-03-07 14:16:10 +08:00
Hongze Cheng b764d51fae more code 2024-03-07 14:02:13 +08:00
Hongze Cheng 456db5b4c3 more code 2024-03-07 13:14:56 +08:00
Hongze Cheng 4dbdd2e35b more code 2024-03-07 10:42:20 +08:00
Hongze Cheng fea538b4c9 remove useless code 2024-03-07 10:02:15 +08:00
yihaoDeng 63d3671f42 add new msg 2024-03-06 12:06:26 +00:00
Hongze Cheng b6c71d8a43 more code 2024-03-06 17:56:35 +08:00
Hongze Cheng 3cb2838202 more code 2024-03-06 17:53:49 +08:00
Hongze Cheng a705ee476c more change 2024-03-06 17:23:51 +08:00
Hongze Cheng c941ad58ee more code 2024-03-06 17:06:39 +08:00
Hongze Cheng 28d83d6ab6 more code 2024-03-06 16:42:54 +08:00
Hongze Cheng f05fe86ef0 more code 2024-03-06 16:23:02 +08:00
Hongze Cheng 5ed903dd01 more code 2024-03-06 15:52:34 +08:00
Hongze Cheng dfd725fbdb more code 2024-03-06 15:37:57 +08:00
Minglei Jin 60ef86da6d vnd/clusterId: new interface to get cluster id for vnode 2024-03-06 14:35:44 +08:00
Hongze Cheng b06e1b8236 refact more code 2024-03-06 13:30:23 +08:00
Hongze Cheng 050d1bc002 more code 2024-03-05 17:25:02 +08:00
Hongze Cheng b33074dcbb &&&b/github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-05 17:06:45 +08:00
Hongze Cheng fb4e17a0cb more code 2024-03-05 17:06:14 +08:00
Hongze Cheng a728f2b5c9 more code 2024-03-05 16:47:59 +08:00
Hongze Cheng 1440c1b942 more code 2024-03-05 16:13:14 +08:00
dapan1121 19b51ec02c
Merge pull request #24994 from taosdata/mark/3.0
fix:add excluded msg for delete in tmq
2024-03-05 15:46:49 +08:00
Hongze Cheng 8aadc70b06 more code 2024-03-05 15:43:46 +08:00
Minglei Jin d2ae4a6e26 enh(s3/writing): enable writing to s3 always 2024-03-05 09:52:26 +08:00
Hongze Cheng b0d9c2632f Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-05 09:27:32 +08:00
Haojun Liao 4d10f28a00
Merge pull request #24999 from taosdata/fix/nullcheck
fix(stream): remove related fill-history if task in stop status.
2024-03-05 09:15:21 +08:00
Haojun Liao 2ac803bf3c fix(stream): clear and set task status. 2024-03-04 22:16:41 +08:00
Haojun Liao 80fd3e0445 fix(stream): remove related fill-history if task in stop status. 2024-03-04 19:31:47 +08:00
Hongze Cheng 40a2b06451 more code 2024-03-04 19:25:20 +08:00
wangmm0220 c7d115d8aa fix:add excluded msg for delete in tmq 2024-03-04 14:58:13 +08:00
Hongze Cheng e9371a1eab Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-04 09:16:08 +08:00
Haojun Liao 0d82ea9e62
Merge pull request #24966 from taosdata/fix/3_liaohj
enh(stream): async handle pause event
2024-03-04 09:10:10 +08:00
Hongze Cheng c8280e05dd Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-03 16:01:34 +08:00
Hongze Cheng 9b8dec7691 more code 2024-03-03 16:01:12 +08:00
Hongze Cheng 818b9d1564
Merge pull request #24943 from taosdata/ENH/TD-28888-3.0
enh: adjust an error logging msg in process sync msg
2024-03-01 10:00:31 +08:00
Haojun Liao 8791a163f8 other: merge 3.0 2024-02-29 22:31:52 +08:00
Haojun Liao db92bf84d8 other: merge 3.0 2024-02-29 22:21:50 +08:00
Hongze Cheng c353f6b350
Merge pull request #24963 from taosdata/fix/TD-28329-2
fix(tsdb/cache): new case for column changing
2024-02-29 21:01:12 +08:00
Minglei Jin 3c80f171ef fix(tsdb/cache): new case for column changing 2024-02-29 18:56:14 +08:00
Hongze Cheng d7a44a22f4 more change 2024-02-29 17:24:31 +08:00
Hongze Cheng 2de7f87c74 more code 2024-02-29 17:06:53 +08:00
Hongze Cheng b8754b4209 more code 2024-02-29 16:32:11 +08:00
Hongze Cheng f6fd32a0c2 more 2024-02-29 16:21:56 +08:00
Benguang Zhao d5eda8c0a9 enh: adjust an error logging msg in process sync msg 2024-02-29 10:42:27 +08:00
Hongze Cheng a8f95f53b7 more code 2024-02-28 16:49:44 +08:00
Hongze Cheng 81d6a1479d more code 2024-02-28 14:34:37 +08:00
Hongze Cheng 1903a7a981 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-28 13:23:02 +08:00
Hongze Cheng d9a4e5ed0f more code 2024-02-28 10:58:42 +08:00
dmchen 34cda13494 enable switch 2024-02-27 10:57:32 +00:00
dmchen cf753cf2e0 fix/TD-28860 2024-02-27 09:24:23 +00:00
Haojun Liao 9762c53cf9
Merge pull request #24895 from taosdata/fix/nullcheck
enh(stream):rsp the checkpoint ready msg.
2024-02-27 14:42:00 +08:00
Haojun Liao d05c55f3fe fix(stream): update the msg struct. 2024-02-27 12:59:08 +08:00
Haojun Liao de1c67f773 fix(stream): rsp the checkpoint ready msg. 2024-02-27 12:57:43 +08:00