Commit Graph

4480 Commits

Author SHA1 Message Date
Haojun Liao 94f596c4ce refactor: remove the invalid return value. 2024-07-16 18:52:01 +08:00
Haojun Liao 691c1dfa7d fix(stream): check dst stable schema before generating auto create table. 2024-07-16 14:45:09 +08:00
dmchen 8d337e94ac fix/TD-30989 2024-07-16 01:34:38 +00:00
dapan1121 9ed56939df Merge remote-tracking branch 'origin/3.0' into fix/TD-30966.sch.0 2024-07-16 08:54:40 +08:00
54liuyao 29381075c5 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-30967 2024-07-16 08:54:12 +08:00
wangmm0220 aed8a75e35 feat:[TD-30975]process return value in schemaless 2024-07-15 19:07:20 +08:00
dapan1121 c10106a4da
Merge pull request #26512 from taosdata/enh/TD-29679
use regex cache
2024-07-15 19:01:50 +08:00
dapan1121 abe49ff61a enh: add scheduler return code processing 2024-07-15 17:11:36 +08:00
54liuyao 3cdb957f22 adj function of stream operator result 2024-07-15 15:32:11 +08:00
dapan1121 4951ed9fa7
Merge pull request #26552 from taosdata/fix/TD-30966.0
fix: validate function return value
2024-07-15 14:59:47 +08:00
Hongze Cheng dccbd4be99
Merge pull request #26545 from taosdata/enh/TD-30880-2
Enh/TD-30880-2
2024-07-15 14:15:48 +08:00
Hongze Cheng 77e2582cc1
Merge pull request #26536 from taosdata/enh/TD-30856-3.0
enh: 'create table' parses csv file per tsMaxInsertBatchRows
2024-07-15 13:54:48 +08:00
54liuyao 9b067d075f adj stream function return 2024-07-15 13:38:34 +08:00
dapan1121 4c2c9a71d5 fix: table info issue 2024-07-15 10:05:57 +08:00
54liuyao 5b982354e1 adj bloomfilter 2024-07-12 15:30:03 +08:00
factosea 57f826608a checkout regex pattern at client 2024-07-12 11:48:48 +08:00
Yihao Deng d37ac7935f Merge remote-tracking branch 'origin/3.0' into enh/TD-30880-2 2024-07-12 02:55:58 +00:00
Shungang Li 942599fe04 enh: 'create table' parses csv file per tsMaxInsertBatchRows 2024-07-11 16:14:31 +08:00
dapan1121 e4c624f286
Merge pull request #26489 from taosdata/fix/3.0/TD-30819
feat:[TD-30819] Reduce memory usage when use percentile with interval.
2024-07-11 13:35:39 +08:00
sima f17c535ca0 feat:[TD-30819] Reduce memory usage when using percentile with interval. 2024-07-10 19:43:19 +08:00
dapan1121 076fd07a26
Merge pull request #26492 from taosdata/enh/3.0/bigger_tsma_interval
Enh/3.0/bigger tsma interval
2024-07-10 18:30:40 +08:00
dapan1121 92089e2d86
Merge pull request #26417 from taosdata/enh/TD-29154/diff
Enh/td 29154/diff
2024-07-10 08:38:32 +08:00
Haojun Liao c71413c2aa fix(stream): discard the repeat send consensus-checkpointId msg. 2024-07-09 14:52:15 +08:00
factosea 163b31a4ee fix: type overflow 2024-07-09 14:48:21 +08:00
Haojun Liao acde36a25b Merge branch '3.0' into fix/3_liaohj 2024-07-09 14:43:35 +08:00
Yihao Deng b96e282aff refactor code 2024-07-09 03:28:27 +00:00
factosea 28dc3c85ea type overflow 2024-07-08 20:38:23 +08:00
Haojun Liao bdced636b3 fix(stream): free task state when stopping stream tasks. 2024-07-08 18:20:35 +08:00
Yihao Deng ef46c0c545 Merge remote-tracking branch 'origin/3.0' into enh/TD-30880 2024-07-08 07:34:39 +00:00
Haojun Liao 6e15c16cf7 fix(stream): check the set consensus-checkpointId ts. 2024-07-08 14:33:28 +08:00
Yihao Deng 1c4f354adf add http interface 2024-07-08 02:32:55 +00:00
Haojun Liao 647f9f47ef refactor: do some internal refactor. 2024-07-08 10:32:23 +08:00
Hongze Cheng c8aa963417
Merge pull request #26434 from xinjiempolde/enh/TD-21826-3.0
enh/td-21826-3.0 error handling for stmt
2024-07-08 10:21:14 +08:00
Haojun Liao ce4153b6fc fix(stream): use hb to send the consens-checkpointid req. 2024-07-08 09:05:33 +08:00
Hongze Cheng 9fd0132dee
Merge pull request #26435 from taosdata/fix/TD-30876-3.0
fix/TD-30876
2024-07-07 11:04:56 +08:00
wangjiaming0909 dbc2e9ec75 support bigger tsma interval 2024-07-05 18:21:48 +08:00
dapan1121 d544d3628d
Merge pull request #26411 from taosdata/fix/TS-4921
fix:[TS-4921] send data to queue error if monitor thread starts later or failed
2024-07-05 17:58:00 +08:00
Haojun Liao 8e6bb176c2 fix(stream): use trans to set the consensus-checkpoint id 2024-07-05 16:17:20 +08:00
wangmm0220 9d42b31d4a fix:[TS-4921]refactor code 2024-07-05 16:12:13 +08:00
dmchen 3a4412b282 fix/TD-30876 2024-07-05 06:24:53 +00:00
wangmm0220 6c5acdfc4b fix:[TS-4921]refactor code 2024-07-05 14:03:12 +08:00
Haojun Liao c35c634977 fix(stream): add flag to disable the concurrently started consensus-checkpointId procedure. 2024-07-04 17:08:32 +08:00
Haojun Liao 47b0a0464e fix(stream): send checkpoint-source-rsp to mnode before reset task status. 2024-07-04 15:21:16 +08:00
wangmm0220 64e7c4c842 fix:[TS-4921] send data to queue error if monitor thread starts later or failed 2024-07-04 14:56:56 +08:00
dapan1121 9493ad96b6
Merge pull request #26380 from taosdata/fix/TS-4921
fix:[TS-4921]refactor reporting logic for slow log
2024-07-04 14:45:13 +08:00
Haojun Liao 653f7a1a43 fix(stream): refactor the checkpoint consensus policy. 2024-07-04 13:55:50 +08:00
factosea 5f0ac46029 diff 2024-07-04 11:04:59 +08:00
wangmm0220 cfbd475fc2 fix:[TS-4921]refactor reporting logic for slow log 2024-07-03 15:21:56 +08:00
wangmm0220 f593b644fc fix:compile error in windows & modify the size of send max 2024-07-02 22:48:32 +08:00
wangmm0220 470796ae88 fix:[TS-4921]refactor reporting logic for slow log 2024-07-02 18:03:26 +08:00
wangmm0220 65696ce97f fix:[TS-4921]refactor reporting logic for slow log 2024-07-02 14:52:20 +08:00
xjzhou 88aa15e944 enh: Enhance error handling for stmt 2024-07-02 11:05:54 +08:00
Haojun Liao 420b59fea5
Merge pull request #26344 from taosdata/fix/3_liaohj
fix(stream): validate the stream hb msg, and discard the invalid hb msg.
2024-07-02 09:07:31 +08:00
wangmm0220 a17ff3dbf5 fix:[TS-4921]refactor reporting logic for slow log 2024-07-01 19:08:16 +08:00
Haojun Liao f09be802ea other: merge 3.0 2024-07-01 13:32:30 +08:00
54liuyao 8fdd64e92e limit the size of query queue 2024-07-01 11:08:39 +08:00
wangjiaming0909 11a98ffab2 QueryAutoQWorker 2024-07-01 11:08:39 +08:00
wangmm0220 328dfa3146 fix:remove using alarm when sending slow log & use one thread to send all slow log 2024-06-28 20:58:48 +08:00
Haojun Liao 025437df0c fix(stream): fix error in checkpoint consensus. 2024-06-27 19:25:18 +08:00
Haojun Liao 48bf5eb4d8 other: merge 3.0 2024-06-27 19:23:06 +08:00
xjzhou 12c64a1c45 Merge remote-tracking branch 'origin/3.0' into enh/TD-23926-3.0 2024-06-27 17:02:54 +08:00
dapan1121 7074260e75
Merge pull request #26307 from taosdata/fix/TS-4921
fix:[TS-4921] errors in test
2024-06-27 14:20:51 +08:00
wangmm0220 1ec867449e fix:[TS-4921] errors in test 2024-06-27 10:11:38 +08:00
wangmm0220 d4b31cfd8e fix:[TS-4921] errors in test 2024-06-26 18:32:09 +08:00
Haojun Liao a44e17d5ea fix(stream): enable to re-send hbmsg if mnode failed to recv this hbmsg. 2024-06-26 15:21:14 +08:00
xjzhou 1a32279f7f Merge remote-tracking branch 'origin/3.0' into enh/TS-23926-3.0 2024-06-26 14:21:15 +08:00
xjzhou 1c8110e7a4 Merge remote-tracking branch 'origin/3.0' into enh/TS-23926 2024-06-26 10:34:36 +08:00
Hongze Cheng b761bd2e38 enh: port main change to 3.0 2024-06-26 10:32:15 +08:00
Haojun Liao 1818edcb2b fix(stream): consensus the start checkpoint id, and extract the streamhb related functions into a new file. 2024-06-26 10:18:32 +08:00
Hongze Cheng 59c8656e61
Merge pull request #26275 from taosdata/feat/TS-4917-3.0
feat: 'create table' from csv file
2024-06-25 17:56:23 +08:00
xjzhou 3fb5f2b1d3 Merge remote-tracking branch 'origin/3.0' into enh/TS-23926 2024-06-25 16:16:56 +08:00
xjzhou b444e18d90 enh: stmt supports 'insert into db.?' 2024-06-25 16:16:32 +08:00
Shungang Li 17e84e1fca Merge branch '3.0' into feat/TS-4917-3.0 2024-06-25 10:33:12 +08:00
Shungang Li b3368f6472 feat: 'create table' from csv file 2024-06-24 22:13:03 +08:00
wangmm0220 ed16b1e8db fix:conflict from 3.0 2024-06-24 12:03:10 +08:00
wangmm0220 b5b43e1e9b fix:[TS-4921] stop timer in the end 2024-06-22 23:33:04 +08:00
wangmm0220 65fac20367 fix:[TS-4921] merge from 3.0 2024-06-22 15:02:34 +08:00
Haojun Liao 119001e30b fix(stream): update the retrieve checkpoint-trigger msg. 2024-06-21 15:11:48 +08:00
Haojun Liao 2cb9644471 fix(stream): update the checkpoint info only when the status is normal. 2024-06-21 09:23:29 +08:00
Hongze Cheng 9a97f976e9
Merge pull request #26178 from taosdata/feat/TS-4954-3.0
Feat/ts-4954-3.0-2
2024-06-20 15:07:13 +08:00
Haojun Liao 9c16549561
Merge pull request #26202 from taosdata/fix/TD-30558
fix(stream): adj stream tbname cache
2024-06-20 14:41:51 +08:00
54liuyao ecfb5e5f4c adj par name catch 2024-06-20 09:28:04 +08:00
wangmm0220 5dcfed2d51 feat:[TS-4921]add logic for slow log 2024-06-19 18:54:26 +08:00
dapan1121 0397826c68
Merge pull request #26139 from taosdata/feat/TD-30313
optimize show cluster alive stmt
2024-06-19 15:49:59 +08:00
Haojun Liao da63a40796
Merge pull request #26188 from taosdata/fix/3_liaohj
fix(stream): fix a typo.
2024-06-19 14:58:21 +08:00
Haojun Liao 2534ce5071 fix(stream): fix a typo. 2024-06-19 10:29:01 +08:00
Minglei Jin 356f6645ad
Merge branch '3.0' into fix/TD-30545 2024-06-18 11:28:29 +08:00
54liuyao e858dd5df0 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-30313 2024-06-18 10:28:01 +08:00
Haojun Liao c3ae66c95c
Merge pull request #26169 from taosdata/fix/3_liaohj
fix(stream): not revise the stream id for fill-history task.
2024-06-18 08:38:29 +08:00
Haojun Liao 985d619569 fix(stream): fix syntax error. 2024-06-17 23:14:33 +08:00
Haojun Liao c4a2756907 fix(stream): not revise the stream id for fill-history task. 2024-06-17 23:13:54 +08:00
dmchen 4c8ce7a14c feat/TS-4954 2024-06-17 06:31:39 +00:00
dapan1121 e34a8b48df
Merge pull request #26008 from taosdata/fix/TS-4833/dataloaded
partition interval and limimt, dataload error
2024-06-17 08:32:19 +08:00
Haojun Liao 42e0dff589 fix(stream): move the expansion of the stream task related fill-history task to the place where the fill-history task must have been deoployed already. 2024-06-14 17:03:04 +08:00
54liuyao 7620be6e28 optimize show cluster alive stmt 2024-06-13 16:23:50 +08:00
Haojun Liao 0f8c0fa8cb fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen. 2024-06-13 14:56:20 +08:00
Minglei Jin 568799a6a3 fix(wal/level): enable alter replica from fake walLevel 1 2024-06-12 15:16:58 +08:00
Haojun Liao 623a73f57b
Merge pull request #26089 from taosdata/fix/3_liaohj
fix(stream): init the node list and task list when starting mnode.
2024-06-12 11:34:10 +08:00
Haojun Liao a41a04dc37 fix(stream): remove the related history task correctly. 2024-06-11 18:35:59 +08:00
dapan1121 bee01f9dba
Merge pull request #26081 from taosdata/enh/stmtPerf.3
enh: optimize stmt performance
2024-06-11 16:12:58 +08:00
Hongze Cheng d321fbbc87
Merge pull request #26005 from taosdata/enh/TS-3737-3.0
enh: support createdb permission for user
2024-06-11 15:46:00 +08:00
Haojun Liao 20bade24c3
Merge branch '3.0' into fix/3_liaohj 2024-06-10 01:34:55 +08:00
Haojun Liao cbf8b363fc fix(stream): update checkpoint info by using trans. 2024-06-10 00:46:01 +08:00
Haojun Liao 895ee30cf3
Merge branch '3.0' into enh/opt_prj 2024-06-09 23:51:38 +08:00
dapan1121 0616d886cb enh: optimize table columns allocation 2024-06-07 13:50:57 +08:00
dapan1121 3f99e5e064 fix: memory issues 2024-06-07 09:25:17 +08:00
kailixu 2f5179cf44 Merge branch '3.0' into enh/TS-3737-3.0 2024-06-06 16:42:04 +08:00
Hongze Cheng 070ec1412e
Merge pull request #26048 from taosdata/enh/TS-4885
enh/wal_level: new level 0 to disable wal writing
2024-06-06 10:19:50 +08:00
dapan1121 ddf15fa55c Merge remote-tracking branch 'origin/3.0' into enh/stmtPerf.3 2024-06-05 17:13:48 +08:00
dapan1121 da8616d98a fix: add stbInterlace mode test cases 2024-06-05 17:12:15 +08:00
Minglei Jin d6b2bcba68 enh/wal_level: new level 0 to disable wal writing 2024-06-05 15:19:55 +08:00
kailixu c89f06eaf3 chore: adjust test case 2024-06-05 14:56:47 +08:00
Haojun Liao c529ecc7d2
Merge pull request #25734 from taosdata/fix/3_liaohj
fix(stream): update the checkpoint info for followers, and some internal refactor.
2024-06-05 13:38:51 +08:00
kailixu 2f222514dc chore: merge 3.0 2024-06-04 16:34:02 +08:00
Haojun Liao 6d7e1eb576 fix(query): check for the server ep and client ep to set the compress flag. 2024-06-04 15:07:02 +08:00
factosea c42e627a41 test 2024-06-04 11:39:47 +08:00
Haojun Liao 4fc21cc8b0 refactor: do some internal refactor. 2024-06-04 10:08:18 +08:00
dapan1121 91375c8ca1 fix: taosc exit issue 2024-06-03 19:13:14 +08:00
Haojun Liao 3b3ed1c30c fix(stream): add monitor for checkpoint-ready msg recv status. 2024-06-03 16:45:37 +08:00
Haojun Liao 927e2237de Merge branch '3.0' into fix/3_liaohj 2024-06-03 15:56:02 +08:00
dapan1121 affdeed944
Merge pull request #25909 from taosdata/feat/ly_tmq_batch_meta
optimize tmq snapshot meta
2024-06-03 10:19:57 +08:00
Haojun Liao 2a8270f9c8 fix(stream): track the checkpoint-ready msg on the upstream tasks. 2024-06-01 18:26:45 +08:00
kailixu 4ae8aeb909 Merge branch '3.0' into enh/TS-3737-3.0 2024-05-31 15:48:19 +08:00
Haojun Liao 76b43dc072 fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request. 2024-05-31 14:32:55 +08:00
Haojun Liao bef1953b24
Merge branch '3.0' into fix/3_liaohj 2024-05-31 14:27:46 +08:00
Haojun Liao ee4e4c0e6d refactor: do some internal refactor. 2024-05-31 09:17:20 +08:00
dapan1121 4f67ccc5d5
Merge pull request #25935 from taosdata/fix/3.0/TD-30188
fix select from union all caused crash
2024-05-30 15:45:44 +08:00
dapan1121 c0e4ab20a4 enh: optimize stmt performance 2024-05-30 13:26:17 +08:00
Yihao Deng 5a91039f04 TD-30340 2024-05-30 03:00:56 +00:00
Haojun Liao 27ac6ca16e fix(stream): desc the ref for checkpoint-trigger timer. 2024-05-29 14:12:14 +08:00
Haojun Liao d1d868f239 refactor: do some internal refactor and set the pActiveInfo for rsma. 2024-05-29 00:08:29 +08:00
Haojun Liao bd514fe4d3 other: merge rows. 2024-05-28 11:13:09 +08:00
Haojun Liao be107b204c enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes. 2024-05-28 09:54:22 +08:00
wangjiaming0909 fd34087b8c fix select from union all caused crash 2024-05-27 16:20:13 +08:00
dapan1121 6064ea0125 fix: support timeline query from union and order by 2024-05-24 11:24:19 +08:00
54liuyao 441a150d66 optimize tmq snapshot meta 2024-05-23 17:35:54 +08:00
kailixu 0ef202a56b enh: createdb permission for users 2024-05-22 19:00:47 +08:00
Haojun Liao be39044b66 fix(stream): add more info 2024-05-22 11:04:54 +08:00
Haojun Liao 3baa4169e6 Merge branch '3.0' into fix/3_liaohj 2024-05-20 10:31:53 +08:00
Haojun Liao 1e5098f676 fix(query): fix bugs caused by refactor. 2024-05-19 13:32:30 +08:00
Haojun Liao 217fb7551c fix(query): fix bugs caused by refactor. 2024-05-19 13:18:12 +08:00
Haojun Liao 93292d8149 other: merge 3.0 2024-05-18 09:58:36 +08:00
Haojun Liao 92b247e5b4 refactor: move compress data in query threads. 2024-05-16 15:55:48 +08:00
Haojun Liao abd90c733a fix(stream): remove backend files only after the in-memory task is dropped. 2024-05-15 14:24:35 +08:00
Haojun Liao 610aa80e65 fix(stream): init backend for fill-history task. 2024-05-15 00:08:38 +08:00
Haojun Liao 6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
Haojun Liao b7e7de0354 fix(stream): set the stream task load flag. 2024-05-13 16:45:38 +08:00
dmchen 7c31014c4d add sql 2024-05-13 08:20:27 +00:00
Haojun Liao 3dfffe9113 fix(stream): async load and start stream tasks. 2024-05-13 15:31:26 +08:00
t_max f030af3aab fix: build fails on macOS and Windows 2024-05-11 14:59:05 +08:00