Commit Graph

9469 Commits

Author SHA1 Message Date
Haojun Liao 8dbc3b3457 refactor: do some internal refactor. 2023-04-25 15:07:37 +08:00
Haojun Liao 0b6e531dd3 refactor: do some internal refactor. 2023-04-25 14:56:20 +08:00
Haojun Liao 81e54541de refactor: do some internal refactor. 2023-04-25 14:24:24 +08:00
Haojun Liao 05d1692073 refactor: do some internal refactor. 2023-04-25 13:50:05 +08:00
Haojun Liao d8762b9bc9 refactor: do some internal refactor. 2023-04-25 10:48:21 +08:00
Haojun Liao 6467b99a52 refactor: do some internal refactor. 2023-04-25 10:23:21 +08:00
Haojun Liao 4c4e148635 refactor: do some internal refactor. 2023-04-25 10:19:37 +08:00
wangmm0220 41bec8560a opti:change push mgr to consume msg for subscribe 2023-04-25 09:58:28 +08:00
Haojun Liao e724bc15e0 refactor: do some internal refactor. 2023-04-25 09:54:00 +08:00
Hongze Cheng d57676c924 fix: delete table error 2023-04-25 09:52:16 +08:00
Haojun Liao ae8a9d25c0 refactor: do some internal refactor. 2023-04-25 09:41:49 +08:00
Haojun Liao a73957aaba fix(query): fix error in add row into merger. 2023-04-25 09:24:15 +08:00
Haojun Liao 37d042a338 fix(query): fix error in add row into merger. 2023-04-25 00:33:24 +08:00
Haojun Liao 9a14e0db47 fix(query): fix error in add row into merger. 2023-04-25 00:30:43 +08:00
Haojun Liao c6daa68e54 enh(query): opt merge life cycle. 2023-04-25 00:17:37 +08:00
wangmm0220 8572f4a32f opti:change push mgr to consume msg for subscribe 2023-04-24 19:41:30 +08:00
Haojun Liao 7360a6b65c enh(query): opt hash. 2023-04-24 16:39:55 +08:00
Haojun Liao d73306f616 enh(query): opt last row read performance. 2023-04-24 16:08:49 +08:00
Haojun Liao 5663550de2 enh(query): opt query perf by allocate the SLDataIter when opening reader. 2023-04-24 15:47:02 +08:00
wangmm0220 9bd74ec5b2 Merge branch 'fix/TS-3222' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-24 10:14:32 +08:00
Haojun Liao 134c0528ae Merge branch 'main' into fix/liaohj_main 2023-04-24 01:43:00 +08:00
wangmm0220 77e03bfd78 opti:change push mgr to consume msg for subscribe 2023-04-23 20:14:49 +08:00
dapan1121 64a1c1810f
Merge pull request #21032 from taosdata/fix/TD-23794-M
fix: release resources if node open/start failed
2023-04-23 18:13:45 +08:00
Xiaoyu Wang 4bb7a25fc7 feat: subtable level privilege 2023-04-23 16:30:28 +08:00
wangmm0220 4bc319c6dd Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-23 15:15:33 +08:00
Xiaoyu Wang 35f02cdbad
Merge pull request #21013 from taosdata/FIX/TD-23768-main
fix: change tdbTbInsert to tdbTbUpsert for meta update in tdb
2023-04-23 15:15:17 +08:00
kailixu df40699a50 Merge branch 'main' into enh/TD-22404-M 2023-04-23 15:01:31 +08:00
kailixu f31e2b9cb4 chore: more code 2023-04-23 14:56:06 +08:00
kailixu ebb1d83a3e chore: remove ut code 2023-04-23 14:43:26 +08:00
kailixu da2ca889f2 fix: release resources if node open/start failed 2023-04-23 14:42:24 +08:00
Haojun Liao 6fc364db19 fix(query): add null ptr check. 2023-04-23 13:53:55 +08:00
Xiaoyu Wang 206887166c fix: vnode errcode setting error 2023-04-23 10:53:28 +08:00
Benguang Zhao 3c53516299 fix: use tdbTbUpsert for metaUpdate functions 2023-04-21 19:24:09 +08:00
dapan1121 f4d1ac4e93
Merge pull request #21007 from taosdata/feat/TS-3249
feat: support table_prefix/table_suffix new mode
2023-04-21 19:18:28 +08:00
wangmm0220 6efbcfec4b Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-21 17:46:35 +08:00
kailixu 6292fb766f Merge branch 'main' into enh/TD-22404-M 2023-04-21 16:04:11 +08:00
dapan1121 3c2fc48e74 feat: support new table_prefix/table_suffix mode 2023-04-21 14:17:07 +08:00
Haojun Liao b6f4cac619 fix(stream): set the correct offset version. 2023-04-21 13:35:24 +08:00
Haojun Liao 8fac91e265 refactor: do some internal refactor. 2023-04-21 09:38:51 +08:00
Haojun Liao 6c641cff39 fix(stream): fix error in start stream tasks. 2023-04-21 09:37:16 +08:00
Haojun Liao 471abd9160 log: update the log. 2023-04-20 23:39:13 +08:00
Haojun Liao 5e6c06e253 fix(stream): fix the race condition during create new stream tasks. 2023-04-20 23:21:18 +08:00
Haojun Liao 65fded4a28 fix(stream): set the correct number of tasks. 2023-04-20 19:03:43 +08:00
Haojun Liao f9801ba9c5 enh(stream): stop stream asap. 2023-04-20 18:58:07 +08:00
Haojun Liao 8a6b07347c Merge branch 'main' into fix/liaohj_main 2023-04-20 18:51:43 +08:00
Haojun Liao 6f595fb5fd other: add some logs. 2023-04-20 18:50:44 +08:00
Haojun Liao cb686f8709
Merge pull request #20998 from taosdata/fix/liaohj_main
enh(stream): add more check to stop stream asap.
2023-04-20 18:49:54 +08:00
Haojun Liao c7e42d5422 other: do some internal refactor. 2023-04-20 17:30:02 +08:00
Haojun Liao 8323ad8670 enh(stream): add more check to stop stream asap. 2023-04-20 17:29:08 +08:00
Haojun Liao 23e285ac57
Merge pull request #20995 from taosdata/fix/liaohj_main
fix(stream): add lock during check wal to create new stream task.
2023-04-20 17:04:15 +08:00
Benguang Zhao 1b2fe38f75 enh: improve logging msg in metaSnapWrite 2023-04-20 16:22:16 +08:00
Haojun Liao b60b1796f7 fix(stream): add lock during check wal to create new stream task. 2023-04-20 15:53:41 +08:00
Haojun Liao 742b5ee08c other: update wal logs level. 2023-04-20 13:42:16 +08:00
kailixu 5620f51d14 fix: trim database db from mnd 2023-04-19 20:38:33 +08:00
wangmm0220 594d68b8a4 fix:remove lock for consume handler 2023-04-19 11:46:59 +08:00
wangmm0220 14fd2e7904 fix:remove lock for consume handler 2023-04-19 11:44:52 +08:00
wangmm0220 1061eef144 fix:move consumer msg from fetch thread to query thread 2023-04-19 10:49:18 +08:00
wangmm0220 25542c26c7 fix:remove tmPushMsg in consumer 2023-04-19 10:43:13 +08:00
kailixu b93c85fbf5 Merge branch 'main' into enh/TD-22404-M 2023-04-18 18:49:25 +08:00
Haojun Liao fb32ffd960 fix(stream): update the reference count value to be int32, insead of int8 2023-04-18 18:06:03 +08:00
dapan1121 2af63992ea
Merge pull request #20952 from taosdata/fix/TD-23639
fix: fix double free caused crash
2023-04-18 17:50:45 +08:00
Ganlin Zhao e58bf86c33 fix local variable 2023-04-18 16:34:06 +08:00
Haojun Liao 76becf59b7
Merge pull request #20947 from taosdata/feature/3_liaohj
fix(stream): set the correct initial checkpoint versions.
2023-04-18 11:26:48 +08:00
Haojun Liao 97da34050b fix(query): fix invalid free. 2023-04-18 10:40:53 +08:00
Haojun Liao 739dc5a7a6
Merge pull request #20938 from taosdata/fix/TD-22671
opti:the logic of mndDoRebalance for clear
2023-04-18 09:30:17 +08:00
Haojun Liao 7d3e5aa3d3 fix(query): set the table schema correctly when the table is dropped. 2023-04-18 09:03:30 +08:00
Haojun Liao 2ae05b8cf6 fix(stream): set the correct initial offset value. 2023-04-18 08:56:31 +08:00
wangmm0220 1771a54256 fix:rebalance not only one in once timer 2023-04-17 19:59:11 +08:00
liuyao 27d14f742d fix:stream memory leak 2023-04-17 17:27:02 +08:00
Ganlin Zhao d21628b2c9 fix: fix double free caused crash 2023-04-17 16:57:29 +08:00
kailixu 751a821e5d Merge branch 'main' into enh/TD-22404-M 2023-04-17 13:57:53 +08:00
kailixu fcb587b456 Merge branch 'main' into enh/TD-22404-M 2023-04-17 11:42:48 +08:00
Haojun Liao be90d2c511 fix(stream): disable stream task when no tasks exist. 2023-04-16 23:07:54 +08:00
Haojun Liao 1350af5267 fix(stream): set the correct initial checkpoint version to restore the operators state and add check for the initial destination tables. 2023-04-16 22:48:22 +08:00
wangmm0220 f65cd36e80 opti:the logic of mndDoRebalance for clear 2023-04-16 00:54:11 +08:00
Haojun Liao efb9ebe875
Merge pull request #20873 from taosdata/feature/3_liaohj
enh(stream): the stream will start after vnode restore being completed.
2023-04-15 09:34:34 +08:00
Hongze Cheng edf9fdbecc make it compile 2023-04-14 23:19:36 +08:00
Hongze Cheng bd1c8e1902 fix more code 2023-04-14 21:59:08 +08:00
Hongze Cheng 01bacc10ef fix: an important fix 2023-04-14 21:43:40 +08:00
wangmm0220 584cdf041c opti:the logic of mndDoRebalance for clear 2023-04-14 18:34:41 +08:00
Haojun Liao 1cd2268a99 Merge branch 'main' into feature/3_liaohj 2023-04-14 18:30:55 +08:00
Haojun Liao 02ec67ad9e
Merge pull request #20882 from taosdata/fix/TS-3081
fix:open test cases for tmq & add log if rebalance error
2023-04-14 17:56:58 +08:00
Haojun Liao e0cb8aa534 fix(stream): don't the initial task status and do some internal refactor. 2023-04-14 17:43:37 +08:00
Haojun Liao eb0e1f848a fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask. 2023-04-14 12:00:09 +08:00
Xiaoyu Wang 96d2c5b9e3
Merge pull request #20927 from taosdata/FIX/TD-23552-main
enh: try to propose vnode commit at vnode closing
2023-04-14 09:14:10 +08:00
Xiaoyu Wang 31b2db470b
Merge pull request #20923 from taosdata/fix/3.0_merge_main
merge 3.0
2023-04-14 09:11:51 +08:00
Haojun Liao f8b672f09f other: merge main. 2023-04-14 09:07:18 +08:00
Haojun Liao 4d83118ff7 fix(stream): fix memory leak. 2023-04-13 23:49:14 +08:00
Haojun Liao 70b45a4cf0 fix(stream): all data should be extracted from wal. 2023-04-13 23:22:09 +08:00
Benguang Zhao d8386754ee enh: try to propose vnode commit at vnode closing 2023-04-13 19:45:24 +08:00
Xiaoyu Wang 7e51190bc8
Merge pull request #20914 from taosdata/fix/TD-22941-1
fix(tsdb/read): release bi cache entry before returning
2023-04-13 19:24:06 +08:00
Xiaoyu Wang d3642c84a2 Merge remote-tracking branch 'origin/3.0' into fix/3.0_merge_main 2023-04-13 16:36:30 +08:00
Minglei Jin ab372d501a fix(tsdb/read): release bi cache entry before returning 2023-04-13 14:33:37 +08:00
Xiaoyu Wang a44d455e56 merge 3.0 2023-04-13 14:32:05 +08:00
cadem b405855ba8 balance leader to enterprise 2023-04-13 13:40:42 +08:00
Xiaoyu Wang 3d962cd950
Merge pull request #20905 from taosdata/fix/TD-22941
fix(tsdb/cache): fix block index ref releasing
2023-04-13 13:37:20 +08:00
Minglei Jin 589ed9d0ce fix(tsdb/cache): fix block index ref releasing 2023-04-13 12:09:44 +08:00
Minglei Jin ef219095cf fix(tsdb/read): remove duplicat schema fetching 2023-04-13 10:06:49 +08:00
kailixu 85e11d8cbf Merge branch 'main' into enh/TD-22404-M 2023-04-12 18:30:43 +08:00
Xiaoyu Wang c35e6aa382
Merge pull request #20842 from taosdata/fix/hash-ref-count-high
add cancel in fetch cluster
2023-04-12 16:53:43 +08:00
Xiaoyu Wang 933660ae8d Merge remote-tracking branch 'origin/main' into fix/3.0_merge_main 2023-04-12 14:13:23 +08:00
Xiaoyu Wang 9c0027cb2a
Merge pull request #20880 from taosdata/FIX/TD-23509-main
enh: refactor some sync func names
2023-04-12 14:01:55 +08:00
wangmm0220 50022faf87 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3081 2023-04-12 13:57:37 +08:00
Xiaoyu Wang ff0697fa0a
Merge pull request #20879 from taosdata/fix/main_bugfix_wxy
fix: show user privileges invalid write
2023-04-12 11:05:38 +08:00
wangmm0220 bb22d9ee5e fix:open test cases for tmq & add log if rebalance error 2023-04-12 10:56:19 +08:00
Xiaoyu Wang 813591f993
Merge pull request #20872 from taosdata/fix/TD-23474
fix(tsdb/cache): skip schema updating for non ts row
2023-04-12 10:47:02 +08:00
Xiaoyu Wang 8b8ac0cd77 merge main 2023-04-12 10:43:28 +08:00
Xiaoyu Wang 19f09a10e6 fix: show user privileges invalid write 2023-04-12 10:14:45 +08:00
Benguang Zhao edc9fe9705 enh: change the error msg of INVALID_VGROUP_ID to Vnode is closed or removed 2023-04-12 10:12:41 +08:00
Haojun Liao f6315af0c9 other: merge main. 2023-04-11 19:41:17 +08:00
Xiaoyu Wang 9578c4538a Merge remote-tracking branch 'origin/3.0' into fix/3.0_merge_main 2023-04-11 19:33:23 +08:00
Haojun Liao 5ab54481f0 refactor: do some internal refactor. 2023-04-11 19:24:34 +08:00
Haojun Liao f083697dba refactor(tq): do some internal refactor. 2023-04-11 19:04:33 +08:00
Haojun Liao 24c9495772
Merge pull request #20857 from taosdata/fix/TS-3081
fix:optimize log & change the length of tag if tag is null in schemaless
2023-04-11 19:01:07 +08:00
Minglei Jin 3ac5b35f4b fix(tsdb/cache): skip schema updating for non ts row 2023-04-11 18:57:11 +08:00
Xiaoyu Wang 5ce6220106
Merge pull request #20781 from taosdata/szhou/replace-function
feature: udf replace function
2023-04-11 17:25:21 +08:00
Haojun Liao aae2758863 fix(stream): disable the deploy msg when restart taosd. 2023-04-11 16:58:51 +08:00
Xiaoyu Wang 4d696741b0
Merge pull request #20860 from taosdata/feat/table_level_privilege
feat: table level privilege
2023-04-11 15:56:36 +08:00
Xiaoyu Wang 4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
Haojun Liao 18479d8115 refactor: do some internall refactor. 2023-04-11 15:42:24 +08:00
Xiaoyu Wang 42a5a87e96 fix: table level privilege 2023-04-11 15:08:42 +08:00
wangmm0220 c40c695ea7 fix:optimize log & change the length of tag if tag is null in schemaless 2023-04-11 13:49:18 +08:00
Haojun Liao 15cceb5a5a refactor: do some internal refactors. 2023-04-11 11:53:10 +08:00
shenglian zhou 6b68a373e9 fix: when update func, set createdtime to original time 2023-04-11 11:37:41 +08:00
Xiaoyu Wang 40448c3e70
Merge pull request #20853 from taosdata/feat/table_level_privilege
feat: table level privilege
2023-04-11 11:01:51 +08:00
Xiaoyu Wang 416af9a58d feat: table level privilege 2023-04-11 10:11:25 +08:00
Haojun Liao a4ba5401f9 enh(stream): set the start version of all operators. 2023-04-11 10:01:36 +08:00
“happyguoxy” adf25d3300 null pointer 2023-04-10 19:12:13 +08:00
Haojun Liao 497c9ea9c8 Merge branch 'main' into feature/3_liaohj 2023-04-10 17:57:26 +08:00
Xiaoyu Wang 910aba27c0
Merge pull request #20831 from taosdata/feat/table_level_privilege
feat: table level privilege
2023-04-10 17:24:53 +08:00
Haojun Liao 7419c0bfe9 enh(stream): the stream will start after vnode restore being completed. 2023-04-10 16:56:14 +08:00
“happyguoxy” bfc279835c add cancel in fetch cluster 2023-04-10 16:52:41 +08:00
“happyguoxy” 765c09d59e update function 2023-04-10 16:40:16 +08:00
slzhou b2de711a84 fix: change orReplace logic in mnode 2023-04-10 11:33:25 +08:00
Xiaoyu Wang 4dff8950c2
Merge pull request #20812 from taosdata/fix/TS-3025
fix(tsdb/read): use the correct schema with multilevel merging
2023-04-10 10:30:37 +08:00
Xiaoyu Wang e2f82f4423 merge main 2023-04-10 09:56:03 +08:00
kailixu 7f6fdd4b6b Merge branch 'main' into enh/TD-22404-M 2023-04-09 13:26:56 +08:00
Haojun Liao f5b52749c2 refactor: do some internal refactor. 2023-04-09 01:39:09 +08:00
slzhou 55ffb0bc6d fix: correct udf body file name and correct createdtime 2023-04-08 11:36:09 +08:00
shenglian zhou 32523d72f9 fix: add created time to file name and keep file reuse 2023-04-08 10:11:57 +08:00
kailixu 3530ae0307 Merge branch 'main' into enh/TD-22404-M 2023-04-07 17:51:40 +08:00
Shuduo Sang 4fb5390c6f
chore: release script community main (#20808)
* chore: cus name support in script

* chore: merge with 3.0
2023-04-07 17:10:39 +08:00
Xiaoyu Wang 0f2c753103 feat: table level privilege 2023-04-07 16:39:40 +08:00
Haojun Liao 5de76e4b72
Merge pull request #20809 from taosdata/fix/TD-23517
fix:[TD-23517] set offset type to wal if only meta & check if tag is …
2023-04-07 16:35:08 +08:00
Minglei Jin 8ae43fe6cb fix(tsdb/read): use the correct schema for mem/imem rows 2023-04-07 15:28:23 +08:00
Minglei Jin f262ac8230 fix(tsdb/read): use irow's schema instead of NULL 2023-04-07 14:37:56 +08:00
wangmm0220 05ec2b0928 fix:[TD-23517] set offset type to wal if only meta & check if tag is the same type in schemaless 2023-04-07 14:24:29 +08:00
Minglei Jin 1ff8511eb3 tsdb/row merger: comment init out 2023-04-07 13:43:07 +08:00
Minglei Jin 55f7e41f3b tsdb/row merger: remove tsdbRowMerge 2023-04-07 13:31:33 +08:00
Minglei Jin 360113115f fix(tsdb/row merger): remove unused code 2023-04-07 09:49:48 +08:00