Commit Graph

9588 Commits

Author SHA1 Message Date
Haojun Liao 0100bb51b9 other: merge 3.0 2024-07-17 17:36:49 +08:00
Haojun Liao 30186f466b refactor: check return value for each function. 2024-07-17 16:47:56 +08:00
wangmm0220 f078be357d opti:[TS-4593] transform offset from file to tdb in tmq 2024-07-17 16:25:51 +08:00
Hongze Cheng cb055eca80 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-30987-4 2024-07-17 16:16:15 +08:00
Hongze Cheng 931749dca6 refactor tsdb code 2024-07-17 16:15:19 +08:00
wangmm0220 646731b5dd opti:[TS-4593] transform offset from file to tdb in tmq 2024-07-17 15:58:37 +08:00
Haojun Liao 552e59f42b refactor: check return value for each function. 2024-07-17 15:40:00 +08:00
Shungang Li 394da5d8bf fix: (pk) load last cache from tsdb 2024-07-17 14:27:06 +08:00
Hongze Cheng fdd866737d fix more 2024-07-17 13:17:40 +08:00
Hongze Cheng 35606a5658 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-30987-3 2024-07-17 13:07:07 +08:00
Haojun Liao 14f149cdd3 refactor: check return value for each function. 2024-07-17 11:47:05 +08:00
wangmm0220 a61d5fa827 opti:[TS-4593] transform offset from file to tdb in tmq 2024-07-17 11:26:22 +08:00
Haojun Liao 53ed030967 Merge branch '3.0' into fix/3_liaohj 2024-07-17 11:25:19 +08:00
Haojun Liao 1ed620e702 fix(stream): return after get value. 2024-07-17 11:17:27 +08:00
Haojun Liao 395b437fec Merge branch '3.0' into fix/create_tb 2024-07-17 10:24:20 +08:00
Haojun Liao 103e9194b0
Merge pull request #26592 from taosdata/fix/syntax
fix(tsdb): check return value.
2024-07-17 09:08:22 +08:00
Hongze Cheng d8e3279ca6 fix: little fix 2024-07-17 08:58:59 +08:00
Haojun Liao 872cae1386 refactor: do some refactor. 2024-07-17 01:08:39 +08:00
Haojun Liao 749e7d6cf7 fix(stream): return after get value. 2024-07-17 00:49:53 +08:00
Haojun Liao f3cfd297b8 fix(stream): return after get value. 2024-07-16 19:42:29 +08:00
Haojun Liao b29e1c2b0d fix(stream):fix syntax error. 2024-07-16 19:13:14 +08:00
wangmm0220 0704dcf45d fix:[TS-4593] check info error 2024-07-16 18:56:20 +08:00
Haojun Liao 94f596c4ce refactor: remove the invalid return value. 2024-07-16 18:52:01 +08:00
Hongze Cheng 64363627fe enh: refact tqueue code 2024-07-16 17:30:32 +08:00
Haojun Liao 38ee5dc472 fix(stream):fix syntax error. 2024-07-16 16:04:51 +08:00
Haojun Liao 19ba5af5e7 refactor: remove the invalid return value. 2024-07-16 15:59:16 +08:00
Haojun Liao d2cb53ab3d refactor: remove the invalid return value. 2024-07-16 15:49:08 +08:00
Haojun Liao 691c1dfa7d fix(stream): check dst stable schema before generating auto create table. 2024-07-16 14:45:09 +08:00
Haojun Liao 8dde576c6f fix(stream): add explicit create table into sink cache. 2024-07-16 09:32:13 +08:00
Haojun Liao dd590f36e2 refactor: do some refactor. 2024-07-15 23:53:12 +08:00
Haojun Liao 25f5c9dc5e other: merge 3.0 2024-07-15 19:41:54 +08:00
Haojun Liao 51e9723d66 refactor: do some refactor. 2024-07-15 19:37:52 +08:00
Haojun Liao 14a7cebc56 fix(stream): add explicit create table into sink cache. 2024-07-15 18:51:58 +08:00
Haojun Liao 019a1eb76b fix(tsdb): check return value. 2024-07-15 15:28:32 +08:00
wangmm0220 1e1612a5fa opti:[TS-4593] transform offset from file to tdb in tmq 2024-07-15 10:19:03 +08:00
wangmm0220 e78a75d183 opti:[TS-4593] transform offset from file to tdb in tmq 2024-07-15 09:48:04 +08:00
Yihao Deng 142f9132a5 fix failed to load task 2024-07-12 12:08:57 +00:00
dapan1121 e527f2fd0b fix: validate function return value 2024-07-12 15:22:39 +08:00
Shungang Li 3cc926d597 fix: tsdbCacheUpdate incorrect filling cache 2024-07-10 17:52:13 +08:00
Hongze Cheng 0fcc57b52a
Merge pull request #26439 from taosdata/enh/TD-30442
Enh/TD-30442
2024-07-09 18:04:34 +08:00
Haojun Liao c71413c2aa fix(stream): discard the repeat send consensus-checkpointId msg. 2024-07-09 14:52:15 +08:00
Haojun Liao acde36a25b Merge branch '3.0' into fix/3_liaohj 2024-07-09 14:43:35 +08:00
Hongze Cheng b3be47fdbb cancel bg tasks when alter stt_trigger 2024-07-08 15:39:25 +08:00
Haojun Liao 6e15c16cf7 fix(stream): check the set consensus-checkpointId ts. 2024-07-08 14:33:28 +08:00
Haojun Liao 647f9f47ef refactor: do some internal refactor. 2024-07-08 10:32:23 +08:00
Haojun Liao ce4153b6fc fix(stream): use hb to send the consens-checkpointid req. 2024-07-08 09:05:33 +08:00
Haojun Liao 8e6bb176c2 fix(stream): use trans to set the consensus-checkpoint id 2024-07-05 16:17:20 +08:00
Haojun Liao db4a00c74e fix(stream): not restart for reset task status. 2024-07-05 08:55:40 +08:00
Yihao Deng 94a480292f Merge remote-tracking branch 'origin/3.0' into enh/TD-30442 2024-07-05 00:48:41 +00:00
Yihao Deng 0cdfae3a2c refactor backend 2024-07-04 12:13:17 +00:00
Haojun Liao 4cfecfcf28 other: fix coverity issue. 2024-07-04 19:23:58 +08:00
Yihao Deng 8428a5be37 refactor backend 2024-07-04 10:25:37 +00:00
Haojun Liao 47b0a0464e fix(stream): send checkpoint-source-rsp to mnode before reset task status. 2024-07-04 15:21:16 +08:00
Yihao Deng 0bd51f2133 fix comment 2024-07-04 06:36:36 +00:00
Haojun Liao 653f7a1a43 fix(stream): refactor the checkpoint consensus policy. 2024-07-04 13:55:50 +08:00
Minglei Jin 0fa44fe8cf fix(tsdb/commit): make commit failing core in release buildings 2024-07-03 16:40:54 +08:00
dapan1121 56689cf97a
Merge pull request #26360 from taosdata/fix/3.0/TD-30305
fix coverity issues
2024-07-03 08:50:11 +08:00
Hongze Cheng 991d43b610
Merge pull request #26314 from taosdata/fix/TS-2518-3.0
fix/TS-2518
2024-07-02 18:52:02 +08:00
Haojun Liao 0a9bcc0870
Merge pull request #26370 from taosdata/fix/3_liaohj
fix(stream): remove invalid assert.
2024-07-02 18:41:45 +08:00
Yihao Deng 471580ec5e Merge remote-tracking branch 'origin/3.0' into enh/TD-30442 2024-07-02 08:26:10 +00:00
Haojun Liao c7d4f45b7f fix(stream): remove invalid assert. 2024-07-02 15:33:25 +08:00
Haojun Liao 279bfb4de0
Merge pull request #26364 from taosdata/fix/3_liaohj
fix(stream): fix error in pause/resume procedure.
2024-07-02 15:32:43 +08:00
Haojun Liao 4e56b6f9eb fix(stream): fix error in pause/resume procedure. 2024-07-02 13:33:31 +08:00
wangjiaming0909 024422bfd7 fix coverity issues 2024-07-02 09:27:14 +08:00
Haojun Liao 420b59fea5
Merge pull request #26344 from taosdata/fix/3_liaohj
fix(stream): validate the stream hb msg, and discard the invalid hb msg.
2024-07-02 09:07:31 +08:00
dapan1121 6d0b8eeed4
Merge pull request #26302 from taosdata/TD-26483
feat(query):add thread pool
2024-07-01 19:04:52 +08:00
Hongze Cheng 88a24c5457
Merge pull request #26345 from taosdata/fix/TD-30843
fix(tsdb/retention): fix null pointer crash (uaf)
2024-07-01 15:50:27 +08:00
Minglei Jin 299cf3a00b fix(tsdb/retention): fix null pointer crash (uaf) 2024-07-01 14:20:48 +08:00
Haojun Liao f09be802ea other: merge 3.0 2024-07-01 13:32:30 +08:00
wangjiaming0909 5040ff5bd9 mnode/qnode support QueryAutoQWorkerPool 2024-07-01 11:08:40 +08:00
wangjiaming0909 11a98ffab2 QueryAutoQWorker 2024-07-01 11:08:39 +08:00
Yihao Deng 6c6bff611a add self check 2024-06-29 12:56:36 +00:00
Yihao Deng 7290920c6f add self check 2024-06-29 04:35:54 +00:00
Haojun Liao 79085015d6 fix(stream): set correct msg start position. 2024-06-29 00:49:37 +08:00
Haojun Liao 707fe02885 fix(stream):set the initial transId 2024-06-28 16:30:12 +08:00
Haojun Liao f6e32529fc fix(stream): set initial update ep transId. 2024-06-28 14:13:16 +08:00
Haojun Liao 025437df0c fix(stream): fix error in checkpoint consensus. 2024-06-27 19:25:18 +08:00
Haojun Liao 48bf5eb4d8 other: merge 3.0 2024-06-27 19:23:06 +08:00
Haojun Liao b5661752aa fix(tsdb):check the result of the binary search for the end position in data file block. 2024-06-27 14:32:18 +08:00
Haojun Liao dc78cf32cb fix(tsdb):check the result of the binary search for the end position in data file block. 2024-06-27 14:29:29 +08:00
dmchen 5001cab278 fix/TS-2518 2024-06-27 04:38:17 +00:00
Haojun Liao a44e17d5ea fix(stream): enable to re-send hbmsg if mnode failed to recv this hbmsg. 2024-06-26 15:21:14 +08:00
Hongze Cheng b761bd2e38 enh: port main change to 3.0 2024-06-26 10:32:15 +08:00
Haojun Liao 1818edcb2b fix(stream): consensus the start checkpoint id, and extract the streamhb related functions into a new file. 2024-06-26 10:18:32 +08:00
Haojun Liao bd8c7d8c93 fix(stream): pause not stop the start procedure of stream tasks. 2024-06-24 13:25:48 +08:00
Haojun Liao 119001e30b fix(stream): update the retrieve checkpoint-trigger msg. 2024-06-21 15:11:48 +08:00
Haojun Liao e7105edaa4 fix(stream): disable pause if task is un-init. 2024-06-21 14:14:44 +08:00
Haojun Liao aea4254d40 fix(stream): async start task. 2024-06-21 10:37:06 +08:00
Haojun Liao 2cb9644471 fix(stream): update the checkpoint info only when the status is normal. 2024-06-21 09:23:29 +08:00
Haojun Liao ece139d921 fix(stream): initialize the sink stream task. 2024-06-21 09:22:09 +08:00
Hongze Cheng 70851f6bed
Merge pull request #26160 from taosdata/enh/TD-30554-3.0
tfs: support disable create new file
2024-06-20 16:46:00 +08:00
kailixu cefff2bfee Merge branch '3.0' into enh/TD-30554-3.0 2024-12-31 08:35:03 +08:00
Yihao Deng 639df3dfad update case 2024-06-20 00:14:26 +00:00
Yihao Deng 01ee8b36a4 update case 2024-06-19 12:36:13 +00:00
Haojun Liao da63a40796
Merge pull request #26188 from taosdata/fix/3_liaohj
fix(stream): fix a typo.
2024-06-19 14:58:21 +08:00
Haojun Liao 2534ce5071 fix(stream): fix a typo. 2024-06-19 10:29:01 +08:00
kailixu 809c691b22 Merge branch '3.0' into enh/TD-30554-3.0 2024-06-18 16:47:51 +08:00
Minglei Jin 356f6645ad
Merge branch '3.0' into fix/TD-30545 2024-06-18 11:28:29 +08:00
kailixu d87a7d2809 Merge branch '3.0' into enh/TD-30554-3.0 2024-06-18 08:51:53 +08:00
Haojun Liao c3ae66c95c
Merge pull request #26169 from taosdata/fix/3_liaohj
fix(stream): not revise the stream id for fill-history task.
2024-06-18 08:38:29 +08:00
Haojun Liao c4a2756907 fix(stream): not revise the stream id for fill-history task. 2024-06-17 23:13:54 +08:00
Haojun Liao 60fac80345 fix(stream): add some logs. 2024-06-17 19:34:09 +08:00
Haojun Liao 3aa6e00bee fix(stream): fix some typo. 2024-06-17 15:58:59 +08:00
Haojun Liao 848b1e19b5 fix(stream): fix some typo. 2024-06-17 14:39:46 +08:00
Hongze Cheng 3645bce918
Merge pull request #26127 from taosdata/fix/TD-30567
add compress to child table
2024-06-17 13:18:51 +08:00
kailixu e1f5e6d533 Merge branch '3.0' into enh/TD-30554-3.0 2024-06-17 10:44:11 +08:00
dapan1121 e34a8b48df
Merge pull request #26008 from taosdata/fix/TS-4833/dataloaded
partition interval and limimt, dataload error
2024-06-17 08:32:19 +08:00
kailixu 4ed3b30352 tfs: support disable create new file 2024-06-17 06:14:49 +08:00
kailixu e3645def98 Merge branch '3.0' into enh/TD-30554-3.0 2024-06-17 05:52:15 +08:00
factosea 19f6766c9a fix: blockAgg 2024-06-15 18:08:25 +08:00
Haojun Liao 62b69932b2
Merge pull request #26150 from taosdata/fix/3_liaohj
fix(stream): move the expansion of the stream task related task to right place.
2024-06-15 17:37:39 +08:00
Haojun Liao 42e0dff589 fix(stream): move the expansion of the stream task related fill-history task to the place where the fill-history task must have been deoployed already. 2024-06-14 17:03:04 +08:00
Haojun Liao 85baf2b3e1
Merge pull request #26147 from taosdata/fix/3_liaohj
fix(test): wait for a little bit more time.
2024-06-14 16:34:40 +08:00
Haojun Liao b25e6d3250 fix(stream): always return 0 for enqueuing retrieve block. 2024-06-14 14:43:27 +08:00
Haojun Liao 5f4b506777
Merge pull request #26131 from taosdata/fix/3_liaohj
fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen.
2024-06-13 17:38:28 +08:00
Haojun Liao 0f8c0fa8cb fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen. 2024-06-13 14:56:20 +08:00
Haojun Liao 6f32a617f7 fix(tsdb): check for malloc failure. 2024-06-13 13:45:42 +08:00
Haojun Liao 5d2d5c3eee fix(tsdb): check for null ptr for block load info when retrieving block distribution. 2024-06-13 13:43:57 +08:00
Haojun Liao 849f64d557 fix(tsdb): check null for tsdb block load info 2024-06-13 13:25:29 +08:00
kailixu 50d163f10d Merge branch '3.0' into enh/TD-30554-3.0 2024-06-13 11:11:29 +08:00
kailixu cdc7083b09 Merge branch '3.0' into enh/TD-30554-3.0 2024-06-13 11:11:01 +08:00
Yihao Deng b7ef054b38 add compress to child table 2024-06-13 02:11:41 +00:00
Hongze Cheng 470b0e6730
Merge pull request #26119 from taosdata/feat/TS-4724-3.0
feat: data migration speed limit
2024-06-13 09:59:53 +08:00
dapan1121 d21e2f52de
Merge pull request #26054 from taosdata/fix/TD-30365
fix:[TD-30365] ci case error & drop topic error if vnode is splitted
2024-06-13 09:55:34 +08:00
Haojun Liao 9c42c90209
Merge pull request #26118 from taosdata/fix/3_liaohj
fix(stream): add fill-history task id in msg.
2024-06-12 18:03:43 +08:00
Hongze Cheng e060535c13 feat: data migration speed limit 2024-06-12 17:23:57 +08:00
kailixu e7754a0b3e Merge branch '3.0' into enh/TD-30554-3.0 2024-06-12 15:40:01 +08:00
Haojun Liao d06e1549f1 fix(stream): add fill-history task id in msg. 2024-06-12 15:27:19 +08:00
Minglei Jin 568799a6a3 fix(wal/level): enable alter replica from fake walLevel 1 2024-06-12 15:16:58 +08:00
kailixu f2401f32a2 enh: support enable/disable tfs config entries 2024-06-12 15:14:38 +08:00
Haojun Liao 623a73f57b
Merge pull request #26089 from taosdata/fix/3_liaohj
fix(stream): init the node list and task list when starting mnode.
2024-06-12 11:34:10 +08:00
Haojun Liao 9406be9aa6 fix(stream): remove invalid reset. 2024-06-11 18:58:16 +08:00
Haojun Liao a41a04dc37 fix(stream): remove the related history task correctly. 2024-06-11 18:35:59 +08:00
wangmm0220 70db803aec fix:[TD-30365] ci case error & drop topic error if vnode is splitted 2024-06-11 17:24:29 +08:00
Haojun Liao 539543b011
Merge pull request #25846 from taosdata/enh/opt_prj
enh(query): optimize the project query performance
2024-06-11 14:35:27 +08:00
Hongze Cheng 5c1c65751a
Merge pull request #26083 from taosdata/fix/TD-30200-3.0
fix: last cache rebuild from multi brinBlk
2024-06-11 13:46:55 +08:00
Haojun Liao 20bade24c3
Merge branch '3.0' into fix/3_liaohj 2024-06-10 01:34:55 +08:00
Haojun Liao cbf8b363fc fix(stream): update checkpoint info by using trans. 2024-06-10 00:46:01 +08:00
Haojun Liao 895ee30cf3
Merge branch '3.0' into enh/opt_prj 2024-06-09 23:51:38 +08:00
Shungang Li f9950d5fa3 fix: last cache rebuild from multi brinBlk 2024-06-07 14:47:02 +08:00
Minglei Jin 01e5e124fb fix(last_row): fix empty table condition 2024-06-07 13:47:04 +08:00
Haojun Liao 6ef3c02717 fix(tsdb): remove invalid assert. 2024-06-06 19:09:54 +08:00
wangmm0220 0e337d3418 fix:[TD-30365] ci case error & drop topic error if vnode is splitted 2024-06-06 17:26:20 +08:00
wangmm0220 697b81aa8a fix:[TD-30365] ci case error & drop topic error if vnode is splitted 2024-06-06 11:15:23 +08:00
wangmm0220 48ecba95da fix:[TD-30365] ci case error & drop topic error if vnode is splitted 2024-06-05 18:02:57 +08:00
Haojun Liao 29d34200b5 other: fix coverity issues. 2024-06-05 13:39:46 +08:00
Haojun Liao c529ecc7d2
Merge pull request #25734 from taosdata/fix/3_liaohj
fix(stream): update the checkpoint info for followers, and some internal refactor.
2024-06-05 13:38:51 +08:00
Hongze Cheng 4490cd7db3
Merge pull request #26040 from taosdata/enh/lsg-restore-3.0
enh: add more log for restore
2024-06-05 09:11:42 +08:00
Shungang Li 1f73bb106e enh: add more log for restore 2024-06-04 17:14:59 +08:00
factosea c42e627a41 test 2024-06-04 11:39:47 +08:00
Haojun Liao 3b3ed1c30c fix(stream): add monitor for checkpoint-ready msg recv status. 2024-06-03 16:45:37 +08:00
Haojun Liao 927e2237de Merge branch '3.0' into fix/3_liaohj 2024-06-03 15:56:02 +08:00
Hongze Cheng 6f72fd4170
Merge pull request #25996 from taosdata/feat/TD-30006-3
Feat/TD-30006-3
2024-06-03 15:41:47 +08:00
dapan1121 affdeed944
Merge pull request #25909 from taosdata/feat/ly_tmq_batch_meta
optimize tmq snapshot meta
2024-06-03 10:19:57 +08:00
Hongze Cheng c8f13874a7
Merge pull request #25984 from taosdata/fix/TD-30309-3.0
fix: coverity scan problem
2024-06-03 08:58:48 +08:00
Haojun Liao 2a8270f9c8 fix(stream): track the checkpoint-ready msg on the upstream tasks. 2024-06-01 18:26:45 +08:00
54liuyao e0167511c1 use tDeleteSVCreateTbBatchReq free mem 2024-05-31 17:18:25 +08:00
Haojun Liao 76b43dc072 fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request. 2024-05-31 14:32:55 +08:00
Yihao Deng 5293c4a1dd Merge branch '3.0' into feat/TD-30006 2024-05-31 02:49:58 +00:00
Yihao Deng a1ccf91298 support add column compress 2024-05-31 02:47:57 +00:00
Yihao Deng b364379671 add compress 2024-05-31 02:31:29 +00:00
Haojun Liao ee4e4c0e6d refactor: do some internal refactor. 2024-05-31 09:17:20 +08:00
Yihao Deng c6407277dc support add column compress 2024-05-30 11:41:22 +00:00
Haojun Liao 815a9e953b fix(stream): desc the ref for checkpoint-trigger timer. 2024-05-30 18:41:56 +08:00
Haojun Liao e66283d99c fix(stream): remove table meta in table-meta cache. 2024-05-30 18:41:17 +08:00
Hongze Cheng d28abdf837 fix coverity scan problem 2024-05-30 16:11:53 +08:00
Haojun Liao b4956392d9 fix(stream): return in_progress code if not send retrieve rsp to downstream. 2024-05-30 15:54:08 +08:00
Haojun Liao 5768cc94a1 Merge branch '3.0' into fix/3_liaohj 2024-05-30 15:35:00 +08:00
Haojun Liao cff5e753ef fix(stream): discard the result data block if the primary timestamp of results is expired. 2024-05-30 14:16:49 +08:00
Hongze Cheng 91394f2e6d fix more 2024-05-30 11:01:44 +08:00
Hongze Cheng 88a2c373b3 more fix 2024-05-30 10:22:26 +08:00
54liuyao 129d04a449 adj tmq param 2024-05-29 16:29:04 +08:00
Hongze Cheng e75ab5b298 fix more 2024-05-29 14:10:34 +08:00
Hongze Cheng bb83ed2469 fix: compact and commit concurrency problem 2024-05-29 11:33:17 +08:00
Haojun Liao d1d868f239 refactor: do some internal refactor and set the pActiveInfo for rsma. 2024-05-29 00:08:29 +08:00
54liuyao a2255ca355 add tmq param 2024-05-28 18:34:37 +08:00
Haojun Liao 8d54d45054 fix(stream): fix error found by CI. 2024-05-28 17:30:14 +08:00
Haojun Liao c3c6b680fb Merge branch '3.0' into fix/3_liaohj 2024-05-28 17:29:22 +08:00
Hongze Cheng 242b836eca compile error 2024-05-28 14:35:58 +08:00
Hongze Cheng 913612e4a6
Merge pull request #25913 from taosdata/enh/TS-4723-3.0
enh: reduce compact block write time
2024-05-28 13:18:57 +08:00
Haojun Liao cc318d7e2d enh(stream): sink task does not initialize the backend. 2024-05-28 11:34:04 +08:00
Haojun Liao bd514fe4d3 other: merge rows. 2024-05-28 11:13:09 +08:00
54liuyao 57bf9d1048 adj log 2024-05-28 10:56:43 +08:00
54liuyao 7fc2e8cc26 batch meta 2024-05-28 10:17:20 +08:00
Haojun Liao be107b204c enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes. 2024-05-28 09:54:22 +08:00
Shungang Li 9947d8ec42 fix: last cache memory leak 2024-05-24 12:57:49 +08:00
Haojun Liao 89fb56e77d other: merge 3.0 2024-05-24 11:41:51 +08:00
Hongze Cheng 21ea1e3735 fix memory leak 2024-05-23 19:05:11 +08:00
Hongze Cheng 9531cba834 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-4723-3.0 2024-05-23 18:02:26 +08:00
Hongze Cheng f729072044 enh: reduce compact block write time 2024-05-23 17:57:07 +08:00
54liuyao 441a150d66 optimize tmq snapshot meta 2024-05-23 17:35:54 +08:00
Shungang Li 0e76ba4034 fix: last cache update ts for col format 2024-05-22 15:15:41 +08:00
wangmm0220 f21eeae56c fix:[TD-30180]error in judging if groupId already added to the end of table name 2024-05-21 16:57:00 +08:00
Haojun Liao f6af165d9a refactor(stream): add more info in info-meta 2024-05-21 10:09:55 +08:00
Haojun Liao 3baa4169e6 Merge branch '3.0' into fix/3_liaohj 2024-05-20 10:31:53 +08:00
dapan1121 68640f52be
Merge pull request #25833 from taosdata/fix/TS-4716-3.0
fix:[TS-4716]wait too long if change system time
2024-05-20 09:47:06 +08:00
Haojun Liao 93292d8149 other: merge 3.0 2024-05-18 09:58:36 +08:00
Haojun Liao 27c4e3634c refactor: do some internal refactor. 2024-05-17 17:04:05 +08:00
Shungang Li bf40585f6c fix: cache update for last key 2024-05-17 16:41:26 +08:00
wangmm0220 3c0dbacf37 fix:[TS-4716]wait too long if change system time 2024-05-17 16:37:40 +08:00
Minglei Jin 7292d7a0ff fix(tsdb/cache): update array reference to fix missing tables/groupby 2024-05-17 14:59:20 +08:00
wangmm0220 b0cdf887b4 fix:[TS-4716]wait too long if change system time 2024-05-17 14:27:09 +08:00
Shungang Li b79dda6689 enh: adjust order for row format cache update 2024-05-17 11:31:09 +08:00
Minglei Jin 3b8c27764d Merge branch '3.0' into fix/TD-29995-3.0 2024-05-17 10:17:33 +08:00
Haojun Liao 15181eb14b enh(tsdb): increase the capacity for return data. 2024-05-17 09:51:56 +08:00
Shungang Li 5c952fc922 enh: cleanup 2024-05-17 09:10:35 +08:00
Haojun Liao 5307f15766 refactor: do some internal refactor. 2024-05-16 19:54:29 +08:00
Haojun Liao 41b55cf4d6
Merge pull request #25792 from taosdata/fix/TD-29745-1
adj code
2024-05-16 13:56:31 +08:00
Shungang Li fc047ddafc fix: last cache update rule 2024-05-16 09:30:27 +08:00
Hongze Cheng 9dd3f326ea
Merge pull request #25731 from taosdata/enh/TD-29968-3.0
enh: grant support s3/active-active/dual-replica/db_encryption
2024-05-15 15:52:28 +08:00
Haojun Liao abd90c733a fix(stream): remove backend files only after the in-memory task is dropped. 2024-05-15 14:24:35 +08:00
54liuyao 2a67b83a27 adj code 2024-05-15 14:11:55 +08:00
Haojun Liao 43e018e210
Merge pull request #25733 from taosdata/fix/TD-29745
optimize scan data
2024-05-15 13:41:08 +08:00
54liuyao 167cdc79c5 format code 2024-05-15 10:54:53 +08:00
54liuyao 4c603fee55 format code 2024-05-15 10:54:24 +08:00
54liuyao 3c56f623ed adj inline func 2024-05-15 10:46:19 +08:00
54liuyao ab3ba3f2e4 optimize scan tsdb 2024-05-15 09:09:20 +08:00
Haojun Liao a3bd3a4c76
Merge pull request #25769 from taosdata/fix/TS-4791
fix(tsdb): fix the length of column type overflow.
2024-05-15 00:44:59 +08:00
Haojun Liao 610aa80e65 fix(stream): init backend for fill-history task. 2024-05-15 00:08:38 +08:00
Haojun Liao 9300b7a401 fix(tsdb): fix the length of column type overflow. 2024-05-14 16:22:11 +08:00
Haojun Liao 6898eba6ed fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks. 2024-05-14 14:34:31 +08:00
Minglei Jin b6eec20dfb fix(s3/grant): checking grant when doing migrate 2024-05-14 11:01:06 +08:00
Shungang Li 694680600e fix: tsdbCache vartype of zero size 2024-05-14 09:23:32 +08:00
Haojun Liao b7e7de0354 fix(stream): set the stream task load flag. 2024-05-13 16:45:38 +08:00
Haojun Liao 3dfffe9113 fix(stream): async load and start stream tasks. 2024-05-13 15:31:26 +08:00
t_max f030af3aab fix: build fails on macOS and Windows 2024-05-11 14:59:05 +08:00
Haojun Liao d7e1f37cd4 Merge branch '3.0' into fix/3_liaohj 2024-05-11 10:28:12 +08:00
Haojun Liao 7f93ec2c53 fix(stream): update the checkpoint info for followers, and some internal refactor. 2024-05-11 09:37:02 +08:00
Hongze Cheng 4d4fa9ea94
Merge pull request #25703 from taosdata/fix/TD-29912
fix: handle memleak in vnodeSnapWriterOpen, add log for abort_edit
2024-05-10 15:29:44 +08:00
Hongze Cheng db68b9a1f0
Merge pull request #25707 from taosdata/fix/TD-29981
fix: refactor lastcache ser/des for compatibility
2024-05-10 09:15:29 +08:00
Shungang Li 0ac5d393e6 fix: tsdbcache last disk data format change 2024-05-09 23:37:28 +08:00
Shungang Li 544999c01b fix: tsdbCacheSerialize copy from null ptr 2024-05-09 22:55:29 +08:00
Shungang Li 457b98fee8 fix: adjust SValueV0 data order 2024-05-09 21:52:43 +08:00
Shungang Li 7ae4415890 fix: refactor lastcache ser/des for compatibility 2024-05-09 19:04:11 +08:00
Shungang Li 6895bb121f fix: handle memleak in vnodeSnapWriterOpen, add log for abort_edit 2024-05-09 14:55:48 +08:00
dmchen 454b4047cb fix/audit-memory-leak 2024-05-09 10:19:14 +08:00
Hongze Cheng e76d15e33f
Merge pull request #25690 from taosdata/fix/TD-29962
enh: refactor tsdbCache ser/des
2024-05-09 09:04:09 +08:00
Shungang Li 70598a3038 enh: refactor tsdbCache ser/des 2024-05-09 00:13:19 +08:00
Hongze Cheng 9e21eacf26
Merge pull request #25687 from taosdata/fix/TD-29934-3.0
fix(tsdb/cache-update): compare when rocks's colVal not null
2024-05-08 21:48:01 +08:00
Minglei Jin 3d1612e44b fix(tsdb/cache-update): compare when rocks's colVal not null 2024-05-08 19:27:43 +08:00
Hongze Cheng 431c3c0066
Merge pull request #25675 from taosdata/fix/TD-29934-3.0
fix(tsdb/cache-update): discard none colVals for same timestamp
2024-05-08 18:54:17 +08:00
Minglei Jin bb227a9798 fix(tsdb/cache-update): discard none colVals for same timestamp 2024-05-08 17:29:07 +08:00
Shungang Li 733c8f8f9a fix: (compatibility) SLastCol field change cause 'last' crash 2024-05-08 16:12:43 +08:00
Haojun Liao b26656fd1c
Merge pull request #25661 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-08 13:03:13 +08:00
Haojun Liao cdeb4462fb refactor: do some internal refactor. 2024-05-07 23:43:21 +08:00
Haojun Liao 55a630911d
Merge pull request #25653 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-05-07 23:12:30 +08:00
Haojun Liao b6debd985b fix(stream): always return success if repeatly recv checkpoint source msg. 2024-05-07 16:33:08 +08:00
Hongze Cheng c4b2f5681c
Merge pull request #25654 from taosdata/fix/TD-29845
fix: fix last col version when updating rocks
2024-05-07 11:33:51 +08:00
Haojun Liao 0e0f98eb8d refactor: do some internal refactor. 2024-05-07 10:50:44 +08:00
Minglei Jin 562bf0fe1e tsdb/cache: fix last col version when updating rocks 2024-05-07 10:24:07 +08:00
Shungang Li b979c584fb fix: tsdbCacheGetBatch ref of tmp memory 2024-05-07 10:22:58 +08:00
Haojun Liao 18c66a5491 refactor: do some internal refactor. 2024-05-06 18:17:38 +08:00
Haojun Liao 7ad7ef7cfc refactor: do some internal refactor. 2024-05-06 17:03:41 +08:00
Haojun Liao cdc7b03ac6 fix(stream): fix syntax error. 2024-04-30 22:44:32 +08:00
Haojun Liao 732e52d64d refactor: do some internal refactor, and add some logs. 2024-04-30 19:11:58 +08:00
Haojun Liao 94a0f9ab8f other: merge 3.0 2024-04-30 17:12:46 +08:00
Haojun Liao 629502e12e refactor: do some internal refactor. 2024-04-30 17:00:51 +08:00
Haojun Liao f2bc93b78d
Merge pull request #25598 from taosdata/fix/3_liaohj
refactor(stream): opt stream sink perf.
2024-04-30 16:59:22 +08:00
dapan1121 f54dd2b818
Merge pull request #25602 from taosdata/fix/TS-4728-3.0
fix:use path of SStreamMeta
2024-04-30 16:12:50 +08:00
Haojun Liao cb5a0563e6 fix(stream): fix error caused by merge. 2024-04-30 15:43:12 +08:00
wangmm0220 35003cbb34 fix:use path of SStreamMeta 2024-04-30 14:36:16 +08:00
Haojun Liao 4c27af9b13 refactor: do some internal refactor. 2024-04-30 13:25:39 +08:00
wangmm0220 3a1c210601 fix:use path of SStreamMeta 2024-04-30 11:06:03 +08:00
Haojun Liao 54e9522c62 refactor(stream): opt stream sink perf. 2024-04-30 09:41:29 +08:00
dapan1121 6187bf4e06
Merge pull request #25584 from taosdata/fix/TS-4728-3.0
fix:[TS-4728]transform store data if data is too big
2024-04-30 09:02:40 +08:00
wangmm0220 cd3f3046f7 fix:memory leak 2024-04-29 19:36:41 +08:00
wangmm0220 1f85cb42e6 fix:[TS-4728]transform strore data if data is too big 2024-04-29 17:22:40 +08:00
Haojun Liao b0ef022e87 fix(tsdb): set the correct start pos for binary search. 2024-04-29 15:13:52 +08:00
Haojun Liao 7a5cdb81d5 fix(tsdb): set the correct start pos for binary search. 2024-04-29 14:40:49 +08:00
Haojun Liao bf5d523116 fix(stream): disable the exec of complete check status in timer thread. 2024-04-28 17:57:34 +08:00
Haojun Liao 324072fed8
Merge pull request #25525 from taosdata/fix/3_liaohj
fix(stream): update stream task meta info.
2024-04-26 18:15:09 +08:00
Haojun Liao 6d06188b9f fix(stream): fix memory leak. 2024-04-26 17:06:15 +08:00
Haojun Liao b1b3246066 fix(stream): update the checkpoint executed transId range. 2024-04-26 17:03:01 +08:00
Haojun Liao 5f5595a6ab
Merge pull request #25517 from taosdata/fix/3_liaohj
fix(stream): add task node into update list if it is timeout for more than 100sec.
2024-04-26 17:00:23 +08:00
Haojun Liao 8b53f76691 fix(stream): discard the repeatly recv checkpoint-source msg. 2024-04-26 15:56:34 +08:00
Hongze Cheng efdc943a3d Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-4706-3.0 2024-04-26 14:57:58 +08:00
Haojun Liao c565e31638
Merge pull request #25510 from taosdata/fix/3_liaohj
fix(stream): handle disorder node Update trans Id.
2024-04-26 12:44:00 +08:00
Haojun Liao 815489d20a fix(tsdb): set the pk info when converting fileblockinfo to binrecord. 2024-04-26 11:10:20 +08:00
Haojun Liao 77961ea791 fix(stream): handle disorder node Update trans Id. 2024-04-26 09:45:42 +08:00
Haojun Liao feb176149e
Merge pull request #25507 from taosdata/fix/3_liaohj
fix(tsdb): overlap check take pk into consideration.
2024-04-26 09:06:38 +08:00
Hongze Cheng f500762af7 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-4706-3.0 2024-04-26 09:00:09 +08:00
Haojun Liao 59a3e8ca40 fix(tsdb): overlap check take pk into consideration. 2024-04-25 23:25:24 +08:00
Haojun Liao b3d2ccec83
Merge pull request #25483 from taosdata/fix/3_liaohj
fix(query): add ts in cache_scan_operator if pk exists and only retri…
2024-04-25 22:32:26 +08:00
Haojun Liao eef5e6e409 fix(stream): fix syntax error. 2024-04-25 18:30:33 +08:00
Haojun Liao 3b932599ab fix(stream): fix syntax error. 2024-04-25 17:47:03 +08:00
Minglei Jin eaa1e7a775 tsdb/writer: use latest version of data for writing 2024-04-25 16:40:58 +08:00
Haojun Liao cd8baa7ba0 fix(stream): add log for update task epset, set correct update flag if epset updated. 2024-04-25 16:39:11 +08:00
Minglei Jin a9094d7602 fix(cos/multi-writing): use lasted version of data 2024-04-25 16:37:24 +08:00
Hongze Cheng 10d82a3acf
Merge pull request #25476 from taosdata/enh/TS-4710-3.0
enh: recover file
2024-04-25 11:15:02 +08:00
Hongze Cheng ca9aebc5ff
Merge pull request #25473 from taosdata/fix/TD-29773
Fix/TD-29773
2024-04-25 09:45:47 +08:00
Haojun Liao ac860f7fe8 fix(query): add ts in cache_scan_operator if pk exists and only retrieve ts column. 2024-04-25 09:29:42 +08:00
Haojun Liao 3b08ee3d16
Merge pull request #25458 from taosdata/fix/3_liaohj
fix(stream): add task update trans conflict level.
2024-04-24 18:54:06 +08:00
Hongze Cheng 2cac0d5691 enh: recover file 2024-04-24 18:04:10 +08:00
dapan1121 ab2c9aaf5b
Merge pull request #25466 from taosdata/enh/TD-29758
enh:[TD-29758]optimize log in tmq
2024-04-24 17:47:28 +08:00
Yihao Deng 1181f9de28 Fix metaGetColCmpr function and remove commented code 2024-04-24 08:22:54 +00:00
Hongze Cheng b1fb14e49e
Merge pull request #25465 from taosdata/fix/TD-29759
fix(s3migrate/datas3): init fd of from & to early
2024-04-24 11:29:47 +08:00
Hongze Cheng c3275dc61c
Merge pull request #25459 from taosdata/fix/TD-29750-3.0
fix: if not exists logic for topic/stream/table
2024-04-24 10:52:53 +08:00
Hongze Cheng 0eae851257
Merge pull request #25425 from taosdata/fix/ci_monitor_memory
fix ci monitor memory
2024-04-24 10:35:04 +08:00
wangmm0220 20cedc3339 enh:[TD-29758]optimize log in tmq 2024-04-24 10:02:58 +08:00
Minglei Jin c76f886c91 fix(s3migrate/datas3): init fd of from & to early 2024-04-24 09:36:44 +08:00
kailixu c173be667c Merge branch '3.0' into fix/TD-29750-3.0 2024-04-24 08:44:43 +08:00
Haojun Liao ace5e12e65 fix(tsdb): set the correct lflag when creating tsdbCache reader. 2024-04-23 19:25:51 +08:00
Cary Xu 44b4580bd5
Update metaTable.c 2024-04-23 18:37:40 +08:00
kailixu 89ee62ac09 fix: if not exists logic for topic/stream/table 2024-04-23 18:19:16 +08:00
Haojun Liao 0f8ff48c6b fix(stream): fix double free 2024-04-23 18:18:01 +08:00
Haojun Liao 0c7373509e fix(stream): add task update trans conflict level. 2024-04-23 18:07:00 +08:00
Hongze Cheng 328f95f7cb fix: possible write block when error occurs 2024-04-23 16:48:49 +08:00
Haojun Liao 7fda9d9fcb Merge branch '3.0' into fix/3_liaohj 2024-04-23 15:08:43 +08:00
Haojun Liao b0f68a9147 refactor: do some internal refactor. 2024-04-23 14:58:51 +08:00
Haojun Liao 1adf59e7d8 fix(stream): do check when task is paused, and do some internal refactor. 2024-04-23 13:53:23 +08:00
Haojun Liao d7a08909dd
Merge pull request #25442 from taosdata/fix/3_liaohj
fix(stream): save the epset if task epset updated.
2024-04-23 09:10:45 +08:00
Haojun Liao 315b86cf66 fix(stream): save the epset if task epset updated. 2024-04-22 23:52:45 +08:00
Haojun Liao ada1c6d4c0
Merge pull request #25434 from taosdata/fix/3_liaohj
fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure.
2024-04-22 22:13:19 +08:00
Haojun Liao a8fac441be fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure. 2024-04-22 14:02:31 +08:00
Yihao Deng 541b070765 Remove commented out code in metaCreateSTable function 2024-04-20 07:45:39 +00:00
Yihao Deng ba30339d4e Refactor meteDecodeColCmprEntry function to return -1 on error 2024-04-20 03:07:12 +00:00
Yihao Deng 517365467d Merge branch '3.0' into fix/compatibleWithVeryOldMeta 2024-04-20 01:54:02 +00:00
Haojun Liao e5dddc4abf Merge branch '3.0' into fix/3_liaohj 2024-04-19 19:13:28 +08:00
Haojun Liao ea527b19b8 fix(stream): set correct start version if no checkpoint exist. 2024-04-19 19:12:23 +08:00
dmchen 62bc1074c0 fix monitor memory 2024-04-19 10:44:08 +00:00
dapan1121 a46b7cca3d
Merge pull request #25413 from taosdata/feat/TS-4243-tmq
opti:raw data from tmq
2024-04-19 18:22:21 +08:00
Yihao Deng 18cdeaf960 compatible with older meta 2024-04-19 07:37:43 +00:00
Hongze Cheng 69222543a2
Merge pull request #25401 from taosdata/fix/TD-29562
Fix/td 29562
2024-04-19 13:57:19 +08:00
wangmm0220 1695824c73 fix:merge from 3.0 2024-04-19 13:52:57 +08:00
wangmm0220 42467c0e00 opti:raw data from tmq 2024-04-19 13:48:17 +08:00
Hongze Cheng fc5c84422e
Merge pull request #25256 from taosdata/feat/TD-24834
Feat/td 24834
2024-04-19 13:34:37 +08:00
Haojun Liao 62260bff79
Merge pull request #25389 from taosdata/fix/3_liaohj
fix(stream): reset checkpoint info after receiving task-reset info.
2024-04-19 11:23:55 +08:00
Hongze Cheng e4e00c8953
Merge pull request #25403 from taosdata/fix/TD-29621
fix: geometry crash in stream & tmq
2024-04-19 11:15:26 +08:00
Yihao Deng 2314771209 fix TD-29562 2024-04-19 02:09:40 +00:00
Yihao Deng ee8a96fb42 fix TD-29562 2024-04-19 02:04:32 +00:00
Haojun Liao 34f7dc4782
Merge pull request #25404 from taosdata/feat/TS-4243-3.0
fix(tsdb): set correct compare func for merge tree.
2024-04-19 09:10:03 +08:00
Haojun Liao eb1fed177f fix(tsdb): set correct compare func for merge tree. 2024-04-19 00:32:41 +08:00
Haojun Liao 525b574c85
Merge pull request #25402 from taosdata/feat/TS-4243-3.0
fix(tsdb): update the initial value of pk for varchar type.
2024-04-18 19:49:05 +08:00
Shungang Li f3438ce04e fix: geometry crash in stream & tmq 2024-04-18 19:27:02 +08:00
Haojun Liao 815d12fd77 fix(stream): set check downstream completed for sink task. 2024-04-18 18:36:02 +08:00
Haojun Liao 4802cd1ddf Merge branch '3.0' into fix/3_liaohj 2024-04-18 17:53:30 +08:00
Hongze Cheng 05d853bd9e
Merge pull request #25383 from taosdata/fix/dropStreamData
Fix/drop stream data
2024-04-18 17:10:57 +08:00
Hongze Cheng 874b4b1911
Merge pull request #25400 from taosdata/enh/TD-28945-pk
fix(vnode): encode the missing tsdbPageSize
2024-04-18 17:04:29 +08:00
Haojun Liao 8962010caf other: merge 3.0 2024-04-18 16:31:15 +08:00
Haojun Liao c94c9a900c fix(tsdb): update the initial value of pk for varchar type. 2024-04-18 16:17:29 +08:00
Yihao Deng d21341c943 fix TD-29562 2024-04-18 08:16:40 +00:00
kailixu 20c4385d27 Merge branch '3.0' into feat/TD-24834 2024-04-18 15:54:01 +08:00
Yihao Deng 3f4fa8b74e fix TD-29562 2024-04-18 07:03:18 +00:00
Minglei Jin eb51a7c5b5 vnode: encode the missing tsdbPageSize 2024-04-18 14:48:05 +08:00
Hongze Cheng a4edab720c
Merge pull request #25391 from taosdata/enh/TD-28945-pk
cos/multi-writing: init fid & cid for s3 page cache
2024-04-18 14:05:28 +08:00
Haojun Liao deee0c3793 refactor: do some internal refactor. 2024-04-18 13:05:45 +08:00
Haojun Liao d5d23b0434 fix(tsdb): set reader status normal once successful taking snapshot. 2024-04-18 13:05:44 +08:00
Minglei Jin 8ca2b08d5c cos/multi-writing: fix remove_file with -1 lcn 2024-04-18 08:48:44 +08:00
Haojun Liao 9056a48efd refactor: do some internal refactor. 2024-04-17 21:58:02 +08:00
Haojun Liao ac84a5f82b refactor: do some internal refactor. 2024-04-17 21:57:09 +08:00