xxq250
/
homework-jianmu
1
0
Fork 0
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
63,621 Commits 3 Branches 0 Tags 479 MiB
Commit Graph

8965 Commits

Author SHA1 Message Date
wangmm0220 a74f12e2e1 opti:consume performance if all data is in format of "insert into using" 2024-02-19 15:50:43 +08:00
Haojun Liao a3b04c3c58 fix(stream): set the processVer for streamTask when initializing the task object. 2024-02-19 14:50:09 +08:00
Hongze Cheng ad0c91e6c3 fix: invalid memory access during meta snapshot transfer 2024-02-19 14:06:45 +08:00
wangmm0220 ac9582b24a fix:[TD-28567] do not add md5 to the end of subtable if create stream by sma 2024-02-19 13:58:58 +08:00
Haojun Liao d3e8adf2eb enh(stream): async handle pause event 2024-02-19 13:36:57 +08:00
Haojun Liao 7e866c5527 refactor: do some internal refactor. 2024-02-19 11:32:04 +08:00
54liuyao b53dc5602e Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-02-19 10:58:20 +08:00
Haojun Liao cf571e4f1f refactor: do some internal refactor. 2024-02-19 09:52:22 +08:00
Hongze Cheng 45684e49c7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-19 09:08:58 +08:00
54liuyao 05eaa90c11 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-19 08:59:15 +08:00
Alex Duan b3a6fa9c12 coverage: add explain.c 2024-02-18 19:36:35 +08:00
wangmm0220 a8e45440c0 fix:conflicts from 3.0 2024-02-18 18:02:14 +08:00
Haojun Liao 245f0ef806 fix(stream): fix deadlock. 2024-02-18 17:05:00 +08:00
Haojun Liao 472020a2b9 enh(stream): handle event async function. 2024-02-18 14:07:15 +08:00
Hongze Cheng 8f1fa68994 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4478-3.0 2024-02-18 10:53:51 +08:00
dapan1121 8f63952ad5
Merge pull request #24750 from taosdata/mark/3.0 
fix:[TD-28590]add logic for consume excluded
 2024-02-18 10:13:25 +08:00
Hongze Cheng 52ed1ec5f7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-18 09:52:53 +08:00
Alex Duan f5e0563891 coverage: tsdbCache.c 2024-02-17 12:12:37 +08:00
Alex Duan 8852beb2cc coverage: tsdbUtil.c 2024-02-16 15:17:15 +08:00
dm chen 6d2d37d964
Merge pull request #24751 from taosdata/3.0 
merge 3.0
 2024-02-06 19:16:53 +08:00
dmchen e5dcef0794 forward client directly 2024-02-06 08:29:09 +00:00
wangmm0220 871ebfa7ba Merge branch '3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-02-06 14:02:46 +08:00
Haojun Liao 2bba011e4e Merge remote-tracking branch 'origin/feat/TD-22023' into feat/TD-22023 2024-02-05 17:51:23 +08:00
Haojun Liao 7a18e5910c enh(stream): halt the initial stream tasks when fill-history is set for count window agg 2024-02-05 17:51:09 +08:00
wangmm0220 5796f411e4 Merge branch 'mark/3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-02-05 17:08:05 +08:00
wangmm0220 a656d75ca7 opti:consume data excluded from some source 2024-02-05 17:07:50 +08:00
54liuyao c588770699 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-05 15:10:34 +08:00
wade zhang 0ebd7d2527
Merge pull request #24737 from taosdata/feat/TD-27463-3.0 
feat: support uniq grant
 2024-02-05 10:32:34 +08:00
54liuyao b16fc7d9df Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-05 10:15:59 +08:00
dmchen 16aef66260 ci case fail 2024-02-05 01:34:20 +00:00
Haojun Liao 2e79c766fa
Merge pull request #24731 from taosdata/fix/3_liaohj 
fix(tsdb): check and return if the rows in stt are before the data rows in data files.
 2024-02-05 09:00:32 +08:00
54liuyao ea9353b9fd merge 3.0 2024-02-04 16:04:23 +08:00
Haojun Liao 6736fd1615 fix(tsdb): check and return if the rows in stt are before the data rows in data files. 2024-02-04 14:11:17 +08:00
kailixu f53d0bce5d feat: support uniq grant 2024-02-04 00:24:42 +08:00
Hongze Cheng 89f0aa4bc4 more code 2024-02-02 12:45:01 +08:00
Hongze Cheng b79859d2a3 more code 2024-02-02 12:26:05 +08:00
slzhou 4a6317a047 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4243-3.0 2024-02-02 11:29:04 +08:00
Haojun Liao 3236ef7bae feat(stream): return the stream source task exec delay, and do some internal refactor. 2024-02-02 11:26:47 +08:00
Alex Duan 035f7d096c
Merge pull request #24715 from taosdata/coverage/TD-28550-3.0 
coverage: metaIdx.c comment no use function
 2024-02-02 09:05:51 +08:00
Alex Duan 963bb20ce3 coverage: metaIdx.c comment no use funciton 2024-02-01 19:11:50 +08:00
Minglei Jin d59b767af3 enh(tsdb/cache): flag empty table when creating 2024-02-01 17:40:32 +08:00
Haojun Liao cb2ea4a721 fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened. 2024-02-01 11:37:57 +08:00
wangmm0220 a9fcc67321 fix:conflicts from 3.0 2024-02-01 11:13:03 +08:00
Haojun Liao 556baed25d other: merge 3.0 2024-01-30 18:35:59 +08:00
Haojun Liao 4970040459 refactor: do some internal refactor. 2024-01-30 15:22:49 +08:00
dmchen 8d683983e0 interface name 2024-01-29 10:11:17 +00:00
54liuyao d7fb8db086 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-29 16:13:39 +08:00
Haojun Liao bfbd61a02f
Merge pull request #24634 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-26 18:08:54 +08:00
Hongze Cheng e7177dae57 more code 2024-01-26 17:14:00 +08:00
Hongze Cheng 09a65e5992 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4478-3.0 2024-01-26 16:51:47 +08:00
Haojun Liao ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
54liuyao bc4f3d1296 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-26 15:55:06 +08:00
Haojun Liao 649d26ce72 fix(stream): seek to right place to start wal read. 2024-01-26 14:14:04 +08:00
Haojun Liao 49aff4571b fix(stream): fix memory leak. 2024-01-26 11:33:07 +08:00
Haojun Liao db117a3ac7
Merge pull request #24628 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-26 09:09:44 +08:00
Haojun Liao d4bab8c09b refactor: do some internal refactor. 2024-01-25 16:53:30 +08:00
Haojun Liao 834f08a2e0
Merge pull request #24552 from taosdata/fix/3_liaohj 
fix(stream): do checkpoint after fill-history task completed.
 2024-01-25 16:53:11 +08:00
Hongze Cheng e8a8748dc9 more fix 2024-01-25 15:48:45 +08:00
Hongze Cheng 7d27c3902a feat: avoid meta rwlock starvation 2024-01-25 15:45:09 +08:00
54liuyao 7105b0ffe3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-25 10:12:13 +08:00
dmchen d9af07de6f new table structure 2024-01-24 09:44:44 +00:00
Hongze Cheng 82f3b3a931
Merge pull request #24589 from taosdata/fix/ttlnoretry-3.0 
fix: no retry for ttl drop table
 2024-01-24 14:03:18 +08:00
Haojun Liao 8a7e38ad15 fix(stream): fix checkpoint failure check. 2024-01-24 13:10:53 +08:00
Shungang Li 5bd14b4866 enh: errcode for message has been processed in preprocess 2024-01-23 13:53:51 +08:00
Benguang Zhao 192bb179e7 enh: trigger vnodeCommit at exit even if no data changed 2024-01-23 10:15:00 +08:00
54liuyao 0975e37845 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-23 10:07:50 +08:00
Haojun Liao ecd51e366f
Merge pull request #24512 from taosdata/opti/TD-28118 
opti:[TD-28118] raw block data for tmq
 2024-01-22 11:47:13 +08:00
Haojun Liao d973f66cea fix(stream): do checkpoint after fill-history task completed. 2024-01-19 16:18:02 +08:00
54liuyao 5a7d72d6ef Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-19 10:39:11 +08:00
wangmm0220 7246fedfef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2024-01-18 19:08:35 +08:00
factosea b83bb8c150 fix: last_row error 2024-01-18 17:20:31 +08:00
Haojun Liao 76e6c453e7 enh(stream): send msg to mnode when the transferring state completed. 2024-01-18 15:43:36 +08:00
Haojun Liao 719d1d1b90 refactor: do some internal refactor. 2024-01-18 14:34:18 +08:00
Haojun Liao f8d0c52483 fix(stream): remove this unused drop history task msg and corresponding functions. 2024-01-18 14:32:48 +08:00
wangmm0220 d5d1dd9127 opti:[TD-28118] raw block data for tmq 2024-01-17 20:08:26 +08:00
Haojun Liao d1dbd03341 fix(tsdb): fix invalid set. 2024-01-17 17:29:00 +08:00
Haojun Liao d44dc5bbb2 fix(tsdb): fix race condition. 2024-01-17 15:20:17 +08:00
Haojun Liao 56eac88349 Merge branch '3.0' into fix/3_liaohj 2024-01-17 15:14:52 +08:00
Haojun Liao 1ea671e373 enh(stream): remove time controller. 2024-01-17 14:55:15 +08:00
Haojun Liao fc16d26da2
Merge pull request #24488 from taosdata/fix/3_liaohj 
fix(stream): fix some errors and do some internal refactor.
 2024-01-17 14:25:32 +08:00
54liuyao 3bbfb26e09 stream count window 2024-01-17 14:22:19 +08:00
dapan1121 66c9c076e8
Merge pull request #24469 from taosdata/fix/xsren/TD-28204/whereOptimizeConditional 
Fix/xsren/td 28204/where optimize conditional
 2024-01-17 10:20:51 +08:00
Haojun Liao a56e589048
Merge pull request #24490 from taosdata/fix/TD-28338 
fix:[TD-28338]empty varchar value return NULL in tmq
 2024-01-17 10:09:40 +08:00
yihaoDeng 0d4cc6b8e2 fix:[TD-28338]empty varchar value return NULL in tmq 2024-01-16 18:46:37 +08:00
Haojun Liao 3d98fc6a67 other: merge 3.0 2024-01-16 18:29:33 +08:00
jiajingbin d59ede5196 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28032 2024-01-16 15:05:13 +08:00
Haojun Liao 9a4b7a6d82 fix(stream): remove invalid lock, and fix a typo. 2024-01-16 14:52:27 +08:00
Haojun Liao 80793c94c2 fix(stream): reset the tasks status before start all tasks, and do some other internal refactor. 2024-01-16 14:32:45 +08:00
xinsheng Ren ae5f540692
Merge branch '3.0' into fix/xsren/TD-28204/whereOptimizeConditional 2024-01-16 14:28:37 +08:00
Haojun Liao dfe959eb28
Merge pull request #24468 from taosdata/fix/3_liaohj 
fix(stream): fix deadlock in pause.
 2024-01-16 12:58:27 +08:00
Haojun Liao 63494de7f9 refactor: do some internal refactor. 2024-01-16 10:28:07 +08:00
dapan1121 53094f62d8
Merge pull request #24359 from taosdata/FIX/TD-27003 
Fix : use last row scan when select last_row, last
 2024-01-16 08:50:23 +08:00
fullhonest fafb5b1f03 Fix TD-28018: last row num error where partition by null column 2024-01-15 18:29:41 +08:00
wangmm0220 2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
factosea 2c0dd3db03 fix: memory leak 2024-01-15 16:41:52 +08:00
Haojun Liao 43081b540b fix(stream): reset restart counter to be 0 if all tasks are ready. 2024-01-15 16:16:28 +08:00
fullhonest cb2ab749b5 Fix TD-27003: use last row scan when select last_row, last 2024-01-15 15:22:29 +08:00
Haojun Liao 143e6a13af fix(stream): fix deadlock in pause. 2024-01-15 14:37:24 +08:00
Haojun Liao e012bc4bde refactor: do some internal refactor. 2024-01-15 11:28:36 +08:00
Haojun Liao c710718f9e
Merge pull request #24457 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2024-01-15 10:58:45 +08:00
Haojun Liao 00e2bdec23 refactor: do some internal refactor. 2024-01-12 19:08:46 +08:00
wangmm0220 00e0da15a3 fix:[TD-28032]groupid = 0 & modify test case in sim 2024-01-12 17:37:22 +08:00
Haojun Liao ee24bb9b03
Merge pull request #24444 from taosdata/fix/3_liaohj 
fix(stream): close the inputQ of the related stream task.
 2024-01-12 13:41:30 +08:00
Haojun Liao cf941f7488 fix(stream): check status when resume to run. 2024-01-12 11:12:23 +08:00
Haojun Liao b36cc97236 fix(stream): close the inputQ of the related stream task when the fill-history task recv the trans-state msg from upstream. 2024-01-12 10:44:49 +08:00
Hongze Cheng 8399f5253f
Merge pull request #24439 from taosdata/fix/TD-28285-30 
fix(tsdb/cache): clear fs state before next open
 2024-01-12 10:38:43 +08:00
dapan1121 3b928237d7
Merge pull request #24419 from wangjiaming0909/draft/fix/TD-28182 
fix: table merge scan return disordered rows
 2024-01-12 10:16:21 +08:00
Haojun Liao ea0ea09b0f
Merge pull request #24409 from taosdata/opt/optMsgOnMnode 
opt msg on mnd
 2024-01-12 09:36:37 +08:00
Minglei Jin aa410a6deb fix(tsdb/cache): clear fs state before next open 2024-01-12 09:32:40 +08:00
wangjiaming0909 686108050b fix: table merge scan return disordered rows 2024-01-11 09:57:35 +08:00
Haojun Liao f6c0649108 fix(stream): fix syntax error. 2024-01-11 09:53:19 +08:00
Haojun Liao bff0ad89a4 other: merge 3.0 2024-01-11 09:51:12 +08:00
Haojun Liao 1c562bd535 refactor: enable the restart of stream tasks. 2024-01-11 09:41:40 +08:00
wangmm0220 216830f8b4 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 20:33:13 +08:00
wangmm0220 df69a89da2 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 18:46:10 +08:00
Yihao Deng b5e5167b8f split sync/status channel 2024-01-10 09:57:08 +00:00
wangmm0220 02c7bdd4f0 fix:[TD-28032]fsdfasd 2024-01-10 14:57:16 +08:00
Haojun Liao b0202bb853 fix(tsdb): open reader during resume task for main reader after suspending reader. 2024-01-10 13:44:21 +08:00
Haojun Liao e8aea42498 fix(tsdb): open reader during resume task for main reader after suspending reader. 2024-01-10 13:42:36 +08:00
Haojun Liao 1b6d55616f fix(stream): fix syntax error. 2024-01-10 11:28:06 +08:00
Haojun Liao eac0d14868 fix(stream): add check when merging rows from files and buffer. 2024-01-10 11:02:44 +08:00
Haojun Liao 9d0d0d9ddc Merge branch '3.0' into fix/3_liaohj 2024-01-10 09:57:46 +08:00
Haojun Liao 2b3ad002f5
Merge pull request #24401 from taosdata/fix/TD-28142-3.0 
opti:[TD-28142]memory size if block num is too large
 2024-01-10 09:40:07 +08:00
Haojun Liao dc0c5539a0 fix(stream): remove invalid timer controllers. 2024-01-10 08:48:49 +08:00
Hongze Cheng 7fa06df958
Merge pull request #24395 from taosdata/fix/TD-28208 
fix(tsdb/cache): destory brin block with fs loading
 2024-01-09 16:31:41 +08:00
wangmm0220 6444af84e4 opti:[TD-28142]memory size if block num is too large 2024-01-09 16:28:58 +08:00
Minglei Jin d93b4f88b3 fix(tsdb/cache): destory brin block with fs loading 2024-01-09 15:23:15 +08:00
Haojun Liao f9d5c0d403 fix(stream): fix error in tq timer. 2024-01-09 09:13:53 +08:00
Haojun Liao af9dc441b2 fix(stream): reset the saved value for fill-history task. 2024-01-08 18:40:06 +08:00
Hongze Cheng 5e45ecd3fd fix: possible race condition 2024-01-08 16:46:07 +08:00
Haojun Liao 3bcd038b7d refactor: not reload info from disk when trying to restart stream tasks. 2024-01-08 14:04:36 +08:00
Haojun Liao 275e2d6f94 refactor: do some internal refactor. 2024-01-08 11:34:47 +08:00
Haojun Liao bb9edde79e fix(stream): add some logs. 2024-01-08 11:33:54 +08:00
Haojun Liao a024fe960c fix(stream): fix deadlock. 2024-01-07 14:53:17 +08:00
Haojun Liao 29219ba9f4 fix(stream): add task number check. 2024-01-07 01:32:50 +08:00
Haojun Liao 02f6c971fd fix(stream): check for not ready task when rsp returned. 2024-01-06 19:43:39 +08:00
Haojun Liao cfda97beef refactor: disable commit temp 2024-01-06 15:27:48 +08:00
Haojun Liao 23341e1bdf refactor: opt perf by avoid save tasks during restoring 2024-01-05 22:58:43 +08:00
Haojun Liao 445605ed22 refactor: do some internal refactor. 2024-01-05 22:35:56 +08:00
Haojun Liao 522e688387 fix(stream): check if in restart procedure in call back. 2024-01-05 22:16:58 +08:00
Haojun Liao 2386f842fb enh(stream): remove sleep to opt perf. 2024-01-05 18:46:15 +08:00
Haojun Liao 0c4b91dc72 enh(stream): start task async. 2024-01-05 17:55:39 +08:00
Haojun Liao 1912de9b49 enh(stream): scan wal by using timer to trigger it. 2024-01-05 14:49:33 +08:00
Haojun Liao 33f698e926 fix(stream): remove invalid assert and add check for task status before launching related fill-history task. 2024-01-04 19:09:45 +08:00
Hongze Cheng df74b2d755
Merge pull request #24284 from taosdata/fix/TD-27988 
fix: remove useless code
 2024-01-04 19:03:45 +08:00
Haojun Liao 6d37e596ec refactor: do some internal refactor. 2024-01-04 18:47:49 +08:00
Haojun Liao c494252002 fix(stream): record the related fill-history task failure. 2024-01-04 17:44:05 +08:00
dm chen 39f2e75a9e
Merge branch '3.0' into feat/TD-26529-3.0 2024-01-04 15:46:23 +08:00
Hongze Cheng 13834802ef
Merge pull request #24269 from taosdata/FIX/TD-28101-3.0 
enh: send rsp msg on rejecting snap replication due to smaller term
 2024-01-04 10:15:09 +08:00
dapan1121 670317ccd7
Merge pull request #24053 from taosdata/enh/3.0/TD-26813 
enh: support group by tag/tbname to list empty groups
 2024-01-04 09:08:03 +08:00
Haojun Liao 1e3aad8883 refactor: do some internal refactor. 2024-01-03 23:57:33 +08:00
wangmm0220 b200e6807f fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 19:44:30 +08:00
wangmm0220 317f0c6a39 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 18:48:54 +08:00
Haojun Liao 4399867e14 fix(stream): fix the not running bug. 2024-01-03 18:28:23 +08:00
Haojun Liao 4138692cea fix(stream): scan wal data files. 2024-01-03 18:16:18 +08:00
Haojun Liao 185fa75376 enh(stream): add task into timer to be idle during exec when the corresponding output queue is full. 2024-01-03 17:59:42 +08:00
dapan1121 f0fbffa772
Merge pull request #24301 from taosdata/fix/3.0/TD-28104 
fix: last table scan reported invalid param when col was dropped which
 2024-01-03 15:47:33 +08:00
Haojun Liao a2e85c44c2
Merge pull request #24228 from taosdata/fix/3_liaohj 
refactor: remove stream-scan-history event for stream task.
 2024-01-03 14:43:20 +08:00
Haojun Liao 453d3e8a30 fix(stream): fix dead lock on windows. 2024-01-03 10:50:38 +08:00
wangmm0220 ab262550d1 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 10:37:05 +08:00
wangmm0220 9ba2f71487 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 10:16:43 +08:00
Haojun Liao 6c7683dba6
Merge pull request #24310 from taosdata/fix/crash_stream 
fix(tsdb): check if stt blocks are clean before building data blocks.
 2024-01-02 21:30:28 +08:00
wangmm0220 8add4dc177 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-02 18:37:29 +08:00
Haojun Liao 5bbf12c2c9 fix(tsdb): check if stt blocks are clean before building composed data blocks. 2024-01-02 18:35:17 +08:00
Haojun Liao 29afc2ad6a fix(stream):add jump condition for loop. 2024-01-02 15:48:08 +08:00
Haojun Liao e7a0044502 Merge branch '3.0' into fix/3_liaohj 2024-01-02 13:02:55 +08:00
Haojun Liao 4368bfb20a fix(stream): fix dead lock. 2024-01-02 11:40:29 +08:00
Haojun Liao b3d8f4e9d6 fix(stream): fix a typo. 2024-01-02 10:39:01 +08:00
Haojun Liao d217412691 fix(stream): avoid race condition in starting threads. 2024-01-02 10:33:25 +08:00
wangjiaming0909 be0d35a5af fix: last table scan reported invalid param when col was dropped which 
should report invalid col
 2024-01-02 10:20:04 +08:00
Haojun Liao 8ac02adc0b refactor: do some internal refactor. 2023-12-29 17:42:23 +08:00
Hongze Cheng 7cb12db8ce remove more useless code 2023-12-29 15:20:27 +08:00
Benguang Zhao 68cb86602e fix: reuse cid with fs eid updated in tsdbFSetRAWWriteFileDataBegin 2023-12-29 11:49:57 +08:00
Benguang Zhao baa7f9c895 enh: adjust error msg as warn for not ready to propose etc 2023-12-28 17:29:49 +08:00
Haojun Liao 1659164926 fix(stream): remove invalid checkpoint id check. 2023-12-27 23:00:18 +08:00
Haojun Liao 7eb0e42bb9 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-27 22:57:58 +08:00
Hongze Cheng 90645cbc77
Merge pull request #24220 from taosdata/fix/TD-27988 
fix: remove useless code
 2023-12-27 21:23:26 +08:00
Hongze Cheng 2ada7d455e
Merge pull request #24236 from taosdata/fix/TD-28061 
fix(tsdb/cache): erase entry from lru if deleted
 2023-12-27 18:13:16 +08:00
Haojun Liao 5592e11235 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-26 19:02:52 +08:00
54liuyao ccf861dec8 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/3_liaohj 2023-12-26 18:36:18 +08:00
Minglei Jin 2ba586513f fix(tsdb/cache): erase entry from lru if deleted 2023-12-26 16:41:33 +08:00
Yihao Deng 40aa5f697f fix tag index double free 2023-12-26 07:21:02 +00:00
Yihao Deng dc01625ea1 fix tag index double free 2023-12-26 06:52:33 +00:00
Haojun Liao 62cfcefbb0 refactor: remove stream-scan-history event for stream task. 2023-12-26 00:34:04 +08:00
Hongze Cheng a7c8563c06 fix: remove useless code 2023-12-25 16:13:30 +08:00
Haojun Liao e5087f6e23 fix(tsdb): fix invalid delete check. 2023-12-25 10:40:36 +08:00
Haojun Liao 00fac852e8 fix(tsdb): fix invalid delete check. 2023-12-25 09:55:24 +08:00
Haojun Liao 0877e0bfad other: merge 3.0 2023-12-25 09:13:31 +08:00
Haojun Liao 30498a4028 refactor: do some internal refactor. 2023-12-24 02:24:46 +08:00
Haojun Liao 25f798e42f fix(stream): record the start failure tasks 2023-12-23 23:29:30 +08:00
Bob Liu e3098accc4 support count empty table 2023-12-22 18:14:26 +08:00
Haojun Liao b175a4b7b3 refactor(stream): async stop tasks, and do some internal refactor. 2023-12-22 17:56:16 +08:00
Haojun Liao 7ce545bcd4 refactor: refactor the lock type. 2023-12-22 16:14:49 +08:00
Haojun Liao e91afa7df2 fix(stream): fix deadlock. 2023-12-22 14:51:04 +08:00
Haojun Liao 90898a16e0 refactor: do some internal refactor. 2023-12-22 13:57:15 +08:00
Hongze Cheng 02bb9e90d2
Merge pull request #24189 from taosdata/fix/TD-27974 
fix(tsdb/cache): prepend ts col to load stt
 2023-12-22 13:53:15 +08:00
Minglei Jin 16ad59fb18 fix(tsdb/cache): prepend ts col to load stt 2023-12-22 12:14:27 +08:00
Hongze Cheng 46211258b3
Merge pull request #24173 from taosdata/fix/TD-27974 
fix(tsdb/cache): plus 1 to nCols to load stt data
 2023-12-22 09:43:20 +08:00
Haojun Liao c9475060de fix(stream): fix race condition. 2023-12-22 09:34:49 +08:00
Minglei Jin 9d3eb02f3c fix(tsdb/cache): plus 1 to nCols to load stt data 2023-12-21 17:53:44 +08:00
Haojun Liao 2acc8423c5 fix(stream): send msg to mnode before closing all tasks. 2023-12-21 16:00:50 +08:00
Alex Duan 9d4a75b0be coverage: vnodeSrv.c tmsg.c trow.c 2023-12-21 14:22:22 +08:00
Haojun Liao 71f6d9f06f fix(stream): handle the case that recvs drop msg twice. 2023-12-21 11:52:45 +08:00
wangmm0220 de8ce3f7ec fix:send stream retrieve msg to source task 2023-12-20 16:01:17 +08:00
Haojun Liao 1a8583887f fix(stream): remove clear backendcache. 2023-12-20 15:35:43 +08:00
Haojun Liao d25a323a4c fix(stream): record the launch failure. 2023-12-20 13:55:12 +08:00
Haojun Liao 81d8b2434f refactor: do some internal refactor. 2023-12-20 10:25:31 +08:00
Haojun Liao 541967e99e refactor: do some internal refactor. 2023-12-20 10:24:03 +08:00
Haojun Liao 2de0f6e971 test(stream): lock the update procedure. 2023-12-19 18:56:15 +08:00
Haojun Liao 92045f5485 fix(stream): add snode check, and handle the task status reset from checkpoint when it is in the snode. 2023-12-19 18:34:30 +08:00
Haojun Liao 17e9e84aa9 Merge branch '3.0' into fix/3_liaohj 2023-12-19 16:43:08 +08:00
Haojun Liao fee198f9ad refactor: do some internal refactor. 2023-12-19 16:21:11 +08:00
Haojun Liao ec3183b6a8 other: merge 3.0 2023-12-18 23:16:37 +08:00
Haojun Liao 579366ec00
Merge pull request #24121 from taosdata/fix/liaohj 
other: merge main into 3.0
 2023-12-18 23:11:36 +08:00
Haojun Liao e734569de0 fix(stream): fix dead lock. 2023-12-18 18:42:57 +08:00
Haojun Liao bba5a4f08b other: merge main into 3.0 2023-12-18 18:26:42 +08:00
Minglei Jin 64378be7f4 fix(tsdb/cache): fix buffer-overflow with column adding 2023-12-18 18:06:40 +08:00
Haojun Liao ea6e78cbaa fix(stream): add async call restart, instead of sync wait. 2023-12-18 16:33:44 +08:00
wade zhang 4cac96d2df
Merge pull request #24111 from taosdata/fix/TD-27845 
fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange
 2023-12-18 16:27:18 +08:00
Haojun Liao 79672f8e5f
Merge pull request #24107 from taosdata/fix/3_liaohj 
fix(stream): add check for null ptr and leader .
 2023-12-18 16:24:07 +08:00
Minglei Jin 5dd9ce8ceb fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange 2023-12-18 15:02:34 +08:00
Haojun Liao b4a1907fb7 fix(stream): add check for null ptr and leader . 2023-12-18 11:52:59 +08:00
Haojun Liao ef0cab18cb
Merge pull request #24098 from taosdata/fix/3_liaohj 
fix(stream): send checkpoint complete msg to mnode when dropping it.
 2023-12-17 11:03:04 +08:00
Haojun Liao 4f852704f5 fix(stream): send checkpoint complete msg to mnode when dropping it. 2023-12-17 02:06:01 +08:00
Haojun Liao 0526e619ad
Merge pull request #24095 from taosdata/fix/3_liaohj 
fix(tsdb): add desc check for clean file block.
 2023-12-16 18:10:15 +08:00
Haojun Liao 4cc0f5be59 fix(tsdb): add desc check for clean file block. 2023-12-16 15:37:17 +08:00
Haojun Liao 1a9701d401
Merge pull request #23946 from taosdata/fix/snodeBackendCrash 
Fix/snode backend crash
 2023-12-16 13:13:28 +08:00
Haojun Liao f9a5485d52 fix(stream): refactor the stream trans conflict detection strategy. 2023-12-16 01:46:29 +08:00
slzhou 8a6317b76a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fix-tms-duration 2023-12-15 22:09:43 +08:00
Haojun Liao a847bf468a
Merge pull request #24088 from taosdata/fix/3_liaohj 
fix(query): add rows info if blocks exist.
 2023-12-15 18:24:45 +08:00
yihaoDeng bb5f0d9112 Merge branch 'fix/snodeBackendCrash' of https://github.com/taosdata/TDengine into fix/snodeBackendCrash 2023-12-15 18:16:38 +08:00
yihaoDeng 7ab7a64eb3 Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 18:16:14 +08:00
Hongze Cheng 4ae13f411e
Merge pull request #24010 from taosdata/feat/TS-4229 
feat: compact monitor and kill
 2023-12-15 16:20:13 +08:00
Haojun Liao e2fa4cba8c refactor: do some internal refactor. 2023-12-15 15:28:01 +08:00
shenglian zhou cc4a6c6d55 fix: add new duration block event 2023-12-15 15:04:47 +08:00
Haojun Liao 556eaa22ac
Merge pull request #24074 from taosdata/mark/3.0 
fix:core dump if tqOpen error in vnodeOpen
 2023-12-15 13:55:10 +08:00
wangmm0220 812f0f97a7 fix:rollback size to old logic 2023-12-15 10:09:18 +08:00
slzhou d3146a5bec fix: when no file block, no proc mem before fileset 2023-12-15 09:51:06 +08:00
Yihao Deng 5f2d93d62c
Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 09:22:33 +08:00
wangmm0220 740228a653 fix:core dump if tqOpen error in vnodeOpen 2023-12-15 09:07:35 +08:00
slzhou 5bf364cc0a enhance: refactor code 2023-12-15 08:23:25 +08:00
dmchen d7ac3558f8 fix wrong merge 2023-12-14 11:21:41 +00:00
dm chen 81767dfa32
Merge branch '3.0' into feat/TS-4229 2023-12-14 17:02:51 +08:00
slzhou 4dc39e74c5 fix: the block return from buildBlockFromFiles should be of new fileset 2023-12-14 16:57:04 +08:00
wade zhang c95c567376
Merge pull request #24046 from taosdata/fix/TS-4251-3.0 
revert dependency
 2023-12-14 14:03:04 +08:00
Haojun Liao 05ca8f1784
Merge pull request #24056 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-12-14 13:52:04 +08:00
Haojun Liao 7cf0add513 fix(stream): fix error caused by refactor. 2023-12-14 11:28:03 +08:00
Haojun Liao f0d63a977a refactor: do some internal refactor. 2023-12-14 10:01:57 +08:00
Haojun Liao 8e042e34cb refactor: do some internal refactor. 2023-12-14 09:48:14 +08:00
Haojun Liao 81f96603b0 refactor: do some internal refactor. 2023-12-14 09:33:51 +08:00
Haojun Liao 26af397431
Merge pull request #24052 from taosdata/fix/3_liaohj 
fix(tsdb): fix error in tsdb read.
 2023-12-13 22:35:08 +08:00
Haojun Liao 88a8e4e9f0 fix(tsdb): fix syntax error. 2023-12-13 17:01:55 +08:00
Haojun Liao 840b457308 fix(tsdb): fix error in tsdb read. 2023-12-13 17:00:39 +08:00
dmchen 04366f2e68 revert dependency 2023-12-13 15:29:32 +08:00
Benguang Zhao b1dd76b924 fix: assert on offset leq file.size in tsdbDataFileRAWWriterCloseCommit 2023-12-12 18:33:42 +08:00
Hongze Cheng 613ca2c370
Merge pull request #23982 from taosdata/fix/PI-30-3.0 
fix(tsdb/cache): remove malloc zero bytes
 2023-12-12 15:22:38 +08:00
dmchen 1547d95742 break dependency 2023-12-12 12:19:12 +08:00
dmchen 67e9f695c9 debug info and default setting 2023-12-12 12:18:35 +08:00
dmchen daa2c2238a fix/TS-4251 2023-12-12 12:17:49 +08:00
Minglei Jin c4bf9a92bc Merge branch '3.0' into enh/TD-27119 2023-12-11 19:38:04 +08:00
Minglei Jin fe824c51e2 tsdb/cos: not remove cp files 2023-12-11 19:36:06 +08:00
dmchen a861e55764 revert dependency 2023-12-11 11:24:31 +00:00
slzhou 2743228217 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4229 2023-12-11 14:15:17 +08:00
Haojun Liao 39ea7d7567
Merge pull request #23980 from taosdata/fix/3_liaohj 
fix(tsdb): opt read stt file
 2023-12-09 21:28:52 +08:00
Haojun Liao 9acd4af1f9 fix(tsdb):fix capacity rows value. 2023-12-09 01:49:55 +08:00
Haojun Liao 5528c2bf67 fix(tsdb): do some internal refactor. 2023-12-08 23:47:49 +08:00
Haojun Liao f2592f7399 fix(tsdb): prepare the memory buffer. 2023-12-08 23:44:05 +08:00
Haojun Liao da636ab527 fix(tsdb): add null check. 2023-12-08 18:55:20 +08:00
Haojun Liao 67d967e22f fix(tsdb): check the overlap between stt blocks and data file blocks. 2023-12-08 18:48:00 +08:00
Hongze Cheng 853fb6f119
Merge pull request #23987 from taosdata/fix/little_fix_3.0 
fix: little fix
 2023-12-08 17:29:24 +08:00
Hongze Cheng f830fc2f4c more dev 2023-12-08 17:26:44 +08:00
Haojun Liao 63b34c7acf fix(tsdb): add check for not load stt file blocks. 2023-12-08 16:09:58 +08:00
Minglei Jin 2dbb718101 Merge branch '3.0' into enh/TD-27119 2023-12-08 14:48:17 +08:00
Hongze Cheng a0487529d0 more fix 2023-12-08 14:37:21 +08:00
wade zhang 638e4c1f00
Merge pull request #23568 from taosdata/FEAT/TD-27125-3.0 
feat: support tsdb snap replication of raw data mode
 2023-12-08 14:36:16 +08:00
Haojun Liao 9c72ce846e fix(tsdb): add more condition for not load data. 2023-12-08 14:23:37 +08:00
Hongze Cheng 16068bab41
Merge pull request #23964 from taosdata/fix/TD-27707 
fix(tsdb/cache): del from mem with time range
 2023-12-08 14:22:08 +08:00
Hongze Cheng b9d056c6a8 fix: little fix 2023-12-08 14:11:36 +08:00
dmchen 18dbc47949 break dependency 2023-12-08 04:24:33 +00:00
Haojun Liao da1207ef74 fix(tsdb): add return flag for stt files. 2023-12-08 11:07:45 +08:00
Minglei Jin d4dbb55669 fix(tsdb/cache): remove malloc zero bytes 2023-12-08 11:04:04 +08:00
Haojun Liao 2e13b0b97d refactor: do some internal refactor. 2023-12-08 10:43:17 +08:00
Haojun Liao 9477146b30 fix(tsdb): fix syntax error. 2023-12-08 10:29:38 +08:00
Haojun Liao 4ffaff4d50 other: merge 3.0 2023-12-08 10:14:42 +08:00
Haojun Liao 446c14da72 fix(tsdb): opt read stt file 2023-12-08 10:03:36 +08:00
dapan1121 a2ee41233e
Merge pull request #23835 from taosdata/szhou/tms-duration 
feat: tsdb output in duration order
 2023-12-08 09:07:41 +08:00
Haojun Liao 7c17d6f313 fix(tsdb): opt read performance by check clean stt block if only row number required. 2023-12-07 23:12:54 +08:00
dmchen 348bef49ec message handle 2023-12-07 11:42:32 +00:00
Hongze Cheng aee070918b more dev 2023-12-07 17:37:47 +08:00
Benguang Zhao 1255b46469 fix: destroy dataReaderArr properly in tsdbSnapRAWReaderClose 2023-12-07 15:29:42 +08:00
Benguang Zhao ebd3b69745 enh: control playload size of tsdb snap replication with TSDB_SNAP_DATA_PAYLOAD_SIZE 2023-12-07 15:29:42 +08:00
Benguang Zhao 5cdf2b0b04 fixup: remove call to obsolete funcs of BgTask in tsdbSnapRAWWriter open and close 2023-12-07 15:29:42 +08:00
Benguang Zhao 28e1d83662 fix: adjust tsdbReadFile call in tsdbDataFileRAWReadBlockData 2023-12-07 15:29:42 +08:00
Benguang Zhao 52672657c1 feat: toggle tsdb snap replication mode by snap info handshake ahead of time 2023-12-07 15:29:42 +08:00
Benguang Zhao ef34176e37 fix: close data file readers in tsbSnapRAWReaderClose 2023-12-07 15:29:42 +08:00
Benguang Zhao 6c4c0242fd refact: adjust logging format in tsdbSnapRAWReaderOpen 2023-12-07 15:29:42 +08:00
Benguang Zhao f136266972 feat: support snap replication by file blocks 2023-12-07 15:29:42 +08:00
Benguang Zhao 1dc9019baa feat: add tsdbSnapRAWRead into vnodeSnapRead 2023-12-07 15:29:42 +08:00
Benguang Zhao ae60e1f810 refact: add tsdbSnapRAWReaderIterNext 2023-12-07 15:29:42 +08:00
Benguang Zhao a504007ade refact: alloc just enough memory for snap data in tsdbSnapRAWReadData 2023-12-07 15:29:42 +08:00
Benguang Zhao 6c419423de feat: impl tsdb snapshot reader and writer for raw files 2023-12-07 15:29:42 +08:00
Benguang Zhao a4c504169d feat: add file tsdbFSetRAW.c 2023-12-07 15:29:42 +08:00
Benguang Zhao da646b5a5b feat: add file tsdbDataFileRAW.c 2023-12-07 15:29:42 +08:00
Benguang Zhao e05914119e feat: add file tsdbSnapshotRAW.c 2023-12-07 15:29:42 +08:00
Benguang Zhao fe258e226d feat: add data type of SNAP_DATA_RAW for snap replication 2023-12-07 15:29:42 +08:00
Benguang Zhao de9c9d4f20 refact: improve code of tsdbPartitionInfoSerialize 2023-12-07 15:28:14 +08:00
Benguang Zhao 1a9b08fa08 refact: relocate func syncSnapInfoDataRealloc 2023-12-07 15:28:14 +08:00
Benguang Zhao f68804322c refact: improve code of tsdbSnapGetDetails as tsdbSnapPrepDescription 2023-12-07 15:28:14 +08:00
Benguang Zhao ed39c9a572 refact: rename snap range to fset range in tsdbSnapInfo.c 2023-12-07 15:28:14 +08:00
Benguang Zhao 3550347f0c refact: use tsdbFSDestroyCopyRangedSnapshot and tsdbFSDestroyRefRangedSnapshot 2023-12-07 15:28:14 +08:00
Benguang Zhao 962febef02 refact: rename tsdb snap range to tsdb fset range 2023-12-07 15:28:14 +08:00
Benguang Zhao ed916b1a80 refact: rename tsdb snap partition to fset partition 2023-12-07 15:28:14 +08:00
Benguang Zhao 20b5cf8d49 refact: remove redundent includes from tsdbSnapInfo.c 2023-12-07 15:28:14 +08:00
Benguang Zhao 4487eeacb5 refact: improve funcs dealing with SnapInfo for vnode snap reader and writer 2023-12-07 15:28:14 +08:00
Benguang Zhao b8b53a4b0e refact: put source code of snap info into tsdbSnapInfo.c 2023-12-07 15:28:06 +08:00
Benguang Zhao 3ad68bdfea enh: add tsdbSnapInfo.c 2023-12-07 15:20:55 +08:00
Benguang Zhao ddcabcfa4a refact: remove unused fn tSerializeSnapRangeArray 2023-12-07 15:20:55 +08:00
Benguang Zhao e429526789 refact: rename STSnapRange to STFileSetRange 2023-12-07 15:20:55 +08:00
dmchen 27a86a6faa debug info and default setting 2023-12-07 03:13:23 +00:00
dapan1121 30eb035447
Merge pull request #23940 from taosdata/fix/TS-4327 
fix: last/last_row crash with dropped column
 2023-12-06 17:57:24 +08:00
Minglei Jin a9309cb295 fix(tsdb/cache): del from mem with time range 2023-12-06 17:52:15 +08:00
Hongze Cheng 04e84ba152 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4229 2023-12-06 16:43:00 +08:00
dmchen dc9408ed5f fix/TS-4251 2023-12-06 07:48:40 +00:00
shenglian zhou a2e7c78d27 refactor: rename variables 2023-12-06 09:39:38 +08:00
Haojun Liao 85c7dc76e9
Merge pull request #23948 from taosdata/mark/3.0 
fix:offset out of range if poll offset is read from offsetRestored wh…
 2023-12-06 09:12:38 +08:00
wangmm0220 cc51fd47d0 fix:offset out of range if poll offset is read from offsetRestored while wal is deleted 2023-12-05 19:09:29 +08:00
yihaoDeng 87c78919a9 add stream backend copy 2023-12-05 17:09:03 +08:00
Minglei Jin e9cc54d87b cos_cp/load: load checkpoint from json 2023-12-05 16:37:28 +08:00
wangjiaming0909 a6c876bbc1 fix: last/last_row crash with dropped column 2023-12-05 14:16:01 +08:00
Minglei Jin e0a14bd359 fix(tsdb/cache): remove debug log 2023-12-05 14:05:16 +08:00
Haojun Liao 9d451ab56e
Merge pull request #23934 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-12-05 12:58:18 +08:00
Haojun Liao cb8dfae0cc refactor: do some internal refactor. 2023-12-05 10:47:19 +08:00
slzhou e690076331 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms-duration 2023-12-05 09:53:29 +08:00
Haojun Liao cc5890d56a
Merge pull request #23924 from taosdata/fix/3_liaohj 
enh(tsdb): extract rows for the given tables in all stt files.
 2023-12-04 19:21:19 +08:00
Hongze Cheng 26774f87c9
Merge pull request #23920 from taosdata/fix/TD-27619 
fix: bg task memory waste
 2023-12-04 18:10:30 +08:00
Haojun Liao 7145a7b8a1 fix(tsdb): calculate the rows in next fileset. 2023-12-04 18:03:32 +08:00
Haojun Liao 6d82900a32 fix(tsdb): fix error in block dist. 2023-12-04 18:00:41 +08:00
Hongze Cheng ac2d9ebc27 fix: memory leak 2023-12-04 16:48:43 +08:00
slzhou 8c290587b7 fix: typo error 2023-12-04 16:19:07 +08:00
Haojun Liao 24d9337632 enh(tsdb): extract rows for the given tables in all stt files. 2023-12-04 15:38:24 +08:00
slzhou a517271f39 Merge branch 'szhou/tms-duration-2' into szhou/tms-duration 2023-12-04 14:56:19 +08:00
slzhou 07e43fe56b fix: two intervals are intesected or not 2023-12-04 14:54:15 +08:00
Hongze Cheng cea4be6f3c fix: bg task memory waste 2023-12-04 13:40:28 +08:00
54liuyao 38900d672e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-12-04 09:12:53 +08:00
Haojun Liao 48af3a9559
Merge pull request #23909 from taosdata/fix/TD-27455 
fix:[TD-27644]heartbeat closed before snode close leading to snode is…
 2023-12-04 09:10:00 +08:00
Haojun Liao 5467bba86b fix(tsdb): do some internal refactor. 2023-12-04 09:03:40 +08:00
Haojun Liao 7b0cf47fd6 fix(tsdb): do some internal refactor. 2023-12-04 08:58:10 +08:00
Haojun Liao 29a1c6d518 fix(tsdb): do some internal refactor. 2023-12-04 08:55:53 +08:00
wangmm0220 f06117dbc9 fix:[TD-27644]heartbeat closed before snode close leading to snode is hanged 2023-12-01 17:32:29 +08:00
Haojun Liao 3194ff41aa
Merge pull request #23900 from taosdata/fix/3_liaohj 
fix(stream): merge fix from main to 3.0
 2023-12-01 16:39:38 +08:00
shenglian zhou bff88e0639 fix: set duration order api 2023-12-01 16:27:36 +08:00
slzhou 82629c2658 fix: notify when there are no memory pre fileset 2023-12-01 15:11:43 +08:00
Haojun Liao 7e63943c4e
Merge pull request #23860 from taosdata/fix/TD-27455 
fix:tmqVnodeSplit-column.py failed in arm64 because of rebalance after unsubscribe while split vnode
 2023-12-01 14:18:58 +08:00
wade zhang 041add545c
Merge pull request #23844 from taosdata/FIX/TS-4306-3.0 
enh: limit size of snap replication msg by data length
 2023-12-01 14:06:36 +08:00
slzhou 4d755562af fix: resolve conflicts 2023-12-01 13:02:14 +08:00
Haojun Liao eac3cbf564 fix(stream): merge 3.0 2023-12-01 11:12:57 +08:00
Haojun Liao e008d0f440 fix(tsdb): fix invalid read. 2023-12-01 10:20:45 +08:00
Haojun Liao fbb604d1f5 fix(tsdb): fix bugs in suspend/resume. adjust code to conduct the test more easily. td-27579 2023-12-01 10:20:44 +08:00
Haojun Liao 1c9ff8030b fix(tsdb):clear the tsdb stt file reader flag when suspending the tsdbReader 2023-12-01 10:20:39 +08:00
Haojun Liao 17d4a22e47 fix(stream): add logs. 2023-12-01 10:19:54 +08:00
Haojun Liao b9c727575d fix(stream): reset the scheduler status. 2023-12-01 10:19:54 +08:00
Haojun Liao 2b03d64850 fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-12-01 10:18:15 +08:00
Minglei Jin 49ecb1093f cos/put: new arg withcp to control resumable uploading 2023-11-30 17:20:21 +08:00
wangmm0220 4fc19a6343 fix:snode can only be created 1 2023-11-30 15:49:31 +08:00
54liuyao 271311a770 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-11-30 14:33:48 +08:00
Hongze Cheng 0bfa86f188
Merge pull request #23864 from taosdata/feat/TD-27461-3.0 
feat: backgroud task priority
 2023-11-30 13:51:57 +08:00
Haojun Liao e9ead3bd28
Merge pull request #23341 from taosdata/enh/refactorBackend 
Enh/refactor backend
 2023-11-30 13:48:18 +08:00
Hongze Cheng 8ee4e2c1fe
Merge pull request #23862 from taosdata/fix/TD-27571 
fix(tsdb/cache): flush dirty lru entries before del
 2023-11-30 13:46:50 +08:00
slzhou 80ee5bfb3e fix: the initial value of first fileset start / end key 2023-11-30 11:08:18 +08:00
yihaoDeng 5c32680cd8 Merge branch '3.0' into enh/refactorBackend 2023-11-30 10:31:27 +08:00
WANG MINGMING 9b72d890c8
Merge branch '3.0' into fix/TD-27455 2023-11-30 09:37:23 +08:00
Hongze Cheng 547e673955 fix: coredump caused by typo 2023-11-30 09:20:18 +08:00
Haojun Liao 130614c938
Merge pull request #23831 from taosdata/fix/3_liaohj 
enh(stream/tsdb): do multiple optimization and fix some bugs.
 2023-11-30 09:20:15 +08:00
Minglei Jin ab2c7abca1 tsdb/cache-del: commit before get from rocks 2023-11-30 09:15:58 +08:00
Haojun Liao 28e17a61b9 fix(tsdb): fix invalid read. 2023-11-29 19:28:53 +08:00
Haojun Liao 66f25712fd fix(tsdb): fix bugs in suspend/resume. adjust code to conduct the test more easily. td-27579 2023-11-29 18:07:15 +08:00
Hongze Cheng 65ccc4aa48 feat: backgroud task priority 2023-11-29 18:01:31 +08:00
Minglei Jin 2c9c117529 fix(tsdb/cache): flush dirty lru entries before del 2023-11-29 17:37:40 +08:00
wangmm0220 4f168b4b2d fix:tmqVnodeSplit-column.py failed in arm64 because of rebalance after unsubscribe while split vnode 2023-11-29 17:22:43 +08:00
Benguang Zhao e66a1d6c9a enh: limit snap replication msg by size of block data in tsdbSnapReadTimeSeriesData 2023-11-29 16:01:11 +08:00
slzhou 1a3e280ea8 fix: use imem maxKey/minKey 2023-11-29 13:50:53 +08:00
slzhou 09e314c3ae fix: pStatus->pTableIter is set to null when getting mem table time range 2023-11-29 12:26:32 +08:00
54liuyao ae386c6e34 opt expired data 2023-11-29 11:16:56 +08:00
shenglian zhou 4691a7767a restore buildBlockFromBufferSequentially back 2023-11-29 10:29:40 +08:00
shenglian zhou 8a79df1113 enhance: prepare duration for next fileset 2023-11-29 10:15:43 +08:00
shenglian zhou 765b8384c0 Merge branch 'szhou/tms-duration' of github.com:taosdata/TDengine into szhou/tms-duration-2 2023-11-29 08:18:27 +08:00
slzhou b2fa6209d9 fix: descending traverse wrong endkey 2023-11-29 08:09:00 +08:00
Haojun Liao a5c8eaacaa fix(tsdb):clear the tsdb stt file reader flag when suspending the tsdbReader 2023-11-28 23:52:19 +08:00
shenglian zhou 5a75d74421 fix:mem table has data in the fileset duration 2023-11-28 15:58:33 +08:00
slzhou 4fb0f83f07 fix: core dump without resetTableListIndex 2023-11-28 14:50:50 +08:00
shenglian zhou 89cd2b6f17 enhance: tsdb output duration order 2023-11-28 14:39:08 +08:00
yihaoDeng 08eeee0794 Merge branch '3.0' into enh/refactorBackend 2023-11-28 11:52:49 +08:00
shenglian zhou cdb7eb462d Revert "Revert "fix: pass compilation"" 
This reverts commit 644dbad920.
 2023-11-28 10:31:18 +08:00
shenglian zhou df4f7d6956 Revert "Revert "enhance: duration notification"" 
This reverts commit 3331e25aaf.
 2023-11-28 10:31:18 +08:00
shenglian zhou 3331e25aaf Revert "enhance: duration notification" 
This reverts commit 9dd306e1ef.
 2023-11-28 08:29:05 +08:00
shenglian zhou 644dbad920 Revert "fix: pass compilation" 
This reverts commit 1a7ee3643e.
 2023-11-28 08:28:49 +08:00
yihaoDeng a4d475b582 fix rsma 2023-11-27 20:27:53 +08:00
wangmm0220 06e2fbfb1c fix:conflicts from 3.0 2023-11-27 17:53:53 +08:00
wangmm0220 70c5d36103 opti:extract common logic from snode & vnode to tqCommon 2023-11-27 17:49:09 +08:00
yihaoDeng e9bec34c44 Merge branch '3.0' into enh/refactorBackend 2023-11-27 10:01:12 +08:00
dapan1121 d3ac79aeb7
Merge pull request #23808 from taosdata/fix/PI-23-3.0 
fix: add check in mnode/vnode when alter table col/tag
 2023-11-26 17:31:38 +08:00
Haojun Liao 9194c0c0cd fix(stream): add logs. 2023-11-25 00:56:18 +08:00
Haojun Liao 30c776cc0a fix(stream): reset the scheduler status. 2023-11-25 00:54:32 +08:00
Haojun Liao d5e123db78
Merge pull request #23791 from taosdata/fix/3_liaohj 
refactor: do some internal refactor.
 2023-11-24 14:42:43 +08:00
Hongze Cheng 24932d2d41
Merge pull request #23799 from taosdata/fix/TD-27423 
fix(tsdb/skip-row): remove s3 size condition
 2023-11-24 10:48:03 +08:00
Minglei Jin b1841ee97b tsdb/reader-writer: fix pgno iteration with cache setting 2023-11-24 09:06:43 +08:00
kailixu ac47d3ea7d enh: more check for column bytes 2023-11-24 06:51:57 +08:00
kailixu c4f1babdcf enh: naming optimize 2023-11-24 06:42:30 +08:00
kailixu dc977ca200 fix: stash drop column 2023-11-23 23:09:49 +08:00
kailixu 9ce28483a0 fix: add check in mnode/vnode when alter table col/tag 2023-11-23 21:22:41 +08:00
wangmm0220 d249892b2a fix:conflicts from 3.0 2023-11-23 20:29:46 +08:00
yihaoDeng 6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
Minglei Jin 3c3763a774 tsdb/read-by-column: fix last column index 2023-11-23 17:30:49 +08:00
Minglei Jin 9334fbcb06 tsdb/read-by-column: zero hint size when i's nonzero 2023-11-23 17:14:26 +08:00
Benguang Zhao f7f9546d1e enh: trigger vnode commit at exit if meta changed, for dbs of single replica 2023-11-23 16:32:57 +08:00
Minglei Jin 3034ca2875 tsdb/open-file: log not exist file path 2023-11-23 16:25:39 +08:00
Minglei Jin f076bfdfca fix(tsdb/skip-row): remove s3 size condition 2023-11-23 16:19:26 +08:00
Minglei Jin 460638d294 enh(tsdb/open-file): new s3 failed to connect error code 2023-11-23 16:09:02 +08:00
Minglei Jin c6721be112 fix stt read compilation 2023-11-23 15:49:42 +08:00
Haojun Liao 0a90c33b4d fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-11-23 15:49:07 +08:00
Minglei Jin 08e5525012 tsdb/read-file-page: new arg for hint size 2023-11-23 15:37:26 +08:00
Minglei Jin 023821a80b enh(tsdb/read-by-column): calc hint size for preloading 2023-11-23 15:16:36 +08:00
yihaoDeng 6a0501967d Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-23 14:06:04 +08:00
Haojun Liao 8ad071e69a other: merge main. 2023-11-23 10:25:51 +08:00
Haojun Liao f3355000a3 refactor: do some internal refactor. 2023-11-23 09:34:20 +08:00
Haojun Liao 3edb25a49e fix(stream): add check for assert. 2023-11-23 09:33:40 +08:00
Haojun Liao 7b1f586d4f
Merge pull request #23762 from taosdata/fix/3_liaohj 
fix(stream): fix error in generating token in bucket.
 2023-11-23 09:32:14 +08:00
wangmm0220 15d75a0497 fix:spelling errors 2023-11-23 09:17:54 +08:00
Hongze Cheng 44866b7b12 fix: possible race condition coredump 2023-11-22 20:35:18 +08:00
wangmm0220 cfab06239b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-22 19:37:44 +08:00
wangmm0220 9a09e318ca opti:common message process logic in vnode and snode 2023-11-22 16:53:33 +08:00
Haojun Liao 91e7000433 Merge branch 'enh/refactorBackend' of github.com:taosdata/tdengine into enh/refactorBackend 2023-11-22 15:29:31 +08:00
Haojun Liao c96f7cf182 fix(stream): scheduler the checkpoint generating. 2023-11-22 15:17:21 +08:00
slzhou 1a7ee3643e fix: pass compilation 2023-11-22 14:09:09 +08:00
shenglian zhou 9dd306e1ef enhance: duration notification 2023-11-22 13:56:16 +08:00
dapan1121 1b6a3c2069
Merge pull request #23771 from taosdata/enh/xsren/TD-27022/windows 
Enh/xsren/td 27022/windows
 2023-11-22 10:58:39 +08:00
yihaoDeng 0eba15b4a4 Merge branch '3.0' into enh/refactorBackend 2023-11-22 10:57:41 +08:00
yihaoDeng 0c0d9cdd2c Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-22 10:42:30 +08:00
Haojun Liao b712f5e7dc refactor: do some internal refactor. 2023-11-22 08:41:17 +08:00
Haojun Liao 7a0dfdb0cc fix(tsdb): fix invalid read. 2023-11-22 08:40:10 +08:00
yihaoDeng 947775155b fix transfer crash 2023-11-21 20:51:11 +08:00
Haojun Liao 785d91c17b
Merge pull request #23661 from taosdata/feat/TD-26060 
fix: errors in snode in conditions like fill history/checkpoint/restart
 2023-11-21 19:02:38 +08:00
facetosea 845493294d osfile 2023-11-21 16:31:31 +08:00
yihaoDeng a92602b667 fix mem leak 2023-11-21 15:23:28 +08:00
Haojun Liao 2b099b11dd refactor: do some internal refactor. 2023-11-21 10:09:59 +08:00
yihaoDeng 939aa7a3cc Merge branch '3.0' into enh/refactorBackend 2023-11-20 17:33:30 +08:00
Minglei Jin d12bc41236 tsdb/merge: clear file set before return 0 2023-11-20 14:30:25 +08:00
Haojun Liao 1b4f187ded
Merge pull request #23743 from taosdata/fix/pause_stream 
fix(stream): remove invalid assert
 2023-11-17 23:48:47 +08:00
Haojun Liao 709502ba9e fix(stream): record the check downstream failure. 2023-11-17 22:05:36 +08:00
wangmm0220 3241f9bda5 fix:memory leak 2023-11-17 17:26:52 +08:00