Commit Graph

8965 Commits

Author SHA1 Message Date
Hongze Cheng 4dbdd2e35b more code 2024-03-07 10:42:20 +08:00
Hongze Cheng fea538b4c9 remove useless code 2024-03-07 10:02:15 +08:00
yihaoDeng 63d3671f42 add new msg 2024-03-06 12:06:26 +00:00
Hongze Cheng b6c71d8a43 more code 2024-03-06 17:56:35 +08:00
Hongze Cheng 3cb2838202 more code 2024-03-06 17:53:49 +08:00
Hongze Cheng a705ee476c more change 2024-03-06 17:23:51 +08:00
Hongze Cheng c941ad58ee more code 2024-03-06 17:06:39 +08:00
Hongze Cheng 28d83d6ab6 more code 2024-03-06 16:42:54 +08:00
Hongze Cheng f05fe86ef0 more code 2024-03-06 16:23:02 +08:00
Hongze Cheng 5ed903dd01 more code 2024-03-06 15:52:34 +08:00
Hongze Cheng dfd725fbdb more code 2024-03-06 15:37:57 +08:00
Minglei Jin 60ef86da6d vnd/clusterId: new interface to get cluster id for vnode 2024-03-06 14:35:44 +08:00
Hongze Cheng b06e1b8236 refact more code 2024-03-06 13:30:23 +08:00
Hongze Cheng 050d1bc002 more code 2024-03-05 17:25:02 +08:00
Hongze Cheng b33074dcbb &&&b/github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-05 17:06:45 +08:00
Hongze Cheng fb4e17a0cb more code 2024-03-05 17:06:14 +08:00
Hongze Cheng a728f2b5c9 more code 2024-03-05 16:47:59 +08:00
Hongze Cheng 1440c1b942 more code 2024-03-05 16:13:14 +08:00
dapan1121 19b51ec02c
Merge pull request #24994 from taosdata/mark/3.0
fix:add excluded msg for delete in tmq
2024-03-05 15:46:49 +08:00
Hongze Cheng 8aadc70b06 more code 2024-03-05 15:43:46 +08:00
Minglei Jin d2ae4a6e26 enh(s3/writing): enable writing to s3 always 2024-03-05 09:52:26 +08:00
Hongze Cheng b0d9c2632f Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-05 09:27:32 +08:00
Haojun Liao 4d10f28a00
Merge pull request #24999 from taosdata/fix/nullcheck
fix(stream): remove related fill-history if task in stop status.
2024-03-05 09:15:21 +08:00
Haojun Liao 2ac803bf3c fix(stream): clear and set task status. 2024-03-04 22:16:41 +08:00
Haojun Liao 80fd3e0445 fix(stream): remove related fill-history if task in stop status. 2024-03-04 19:31:47 +08:00
Hongze Cheng 40a2b06451 more code 2024-03-04 19:25:20 +08:00
wangmm0220 c7d115d8aa fix:add excluded msg for delete in tmq 2024-03-04 14:58:13 +08:00
Hongze Cheng e9371a1eab Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-04 09:16:08 +08:00
Haojun Liao 0d82ea9e62
Merge pull request #24966 from taosdata/fix/3_liaohj
enh(stream): async handle pause event
2024-03-04 09:10:10 +08:00
Hongze Cheng c8280e05dd Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-03-03 16:01:34 +08:00
Hongze Cheng 9b8dec7691 more code 2024-03-03 16:01:12 +08:00
Hongze Cheng 818b9d1564
Merge pull request #24943 from taosdata/ENH/TD-28888-3.0
enh: adjust an error logging msg in process sync msg
2024-03-01 10:00:31 +08:00
Haojun Liao 8791a163f8 other: merge 3.0 2024-02-29 22:31:52 +08:00
Haojun Liao db92bf84d8 other: merge 3.0 2024-02-29 22:21:50 +08:00
Hongze Cheng c353f6b350
Merge pull request #24963 from taosdata/fix/TD-28329-2
fix(tsdb/cache): new case for column changing
2024-02-29 21:01:12 +08:00
Minglei Jin 3c80f171ef fix(tsdb/cache): new case for column changing 2024-02-29 18:56:14 +08:00
Hongze Cheng d7a44a22f4 more change 2024-02-29 17:24:31 +08:00
Hongze Cheng 2de7f87c74 more code 2024-02-29 17:06:53 +08:00
Hongze Cheng b8754b4209 more code 2024-02-29 16:32:11 +08:00
Hongze Cheng f6fd32a0c2 more 2024-02-29 16:21:56 +08:00
Benguang Zhao d5eda8c0a9 enh: adjust an error logging msg in process sync msg 2024-02-29 10:42:27 +08:00
Hongze Cheng a8f95f53b7 more code 2024-02-28 16:49:44 +08:00
Hongze Cheng 81d6a1479d more code 2024-02-28 14:34:37 +08:00
Hongze Cheng 1903a7a981 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-28 13:23:02 +08:00
Hongze Cheng d9a4e5ed0f more code 2024-02-28 10:58:42 +08:00
dmchen 34cda13494 enable switch 2024-02-27 10:57:32 +00:00
dmchen cf753cf2e0 fix/TD-28860 2024-02-27 09:24:23 +00:00
Haojun Liao 9762c53cf9
Merge pull request #24895 from taosdata/fix/nullcheck
enh(stream):rsp the checkpoint ready msg.
2024-02-27 14:42:00 +08:00
Haojun Liao d05c55f3fe fix(stream): update the msg struct. 2024-02-27 12:59:08 +08:00
Haojun Liao de1c67f773 fix(stream): rsp the checkpoint ready msg. 2024-02-27 12:57:43 +08:00
Haojun Liao 402a43bf67 fix(stream): disable halt. 2024-02-27 11:25:32 +08:00
Haojun Liao 80d027da19 fix(stream): restore from the crash. 2024-02-27 11:22:58 +08:00
Haojun Liao aee0460daf enh(stream):rsp the checkpoint ready msg. 2024-02-27 11:15:09 +08:00
Haojun Liao dafac591f7 enh(stream): add rsp for req-checkpoint 2024-02-27 10:53:25 +08:00
Hongze Cheng 793ee02cbc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-27 09:56:25 +08:00
Hongze Cheng 2c1f978fd2 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-27 09:26:37 +08:00
Benguang Zhao bbe6fe02d2 enh: use optimistic locking to protect snapshot reader open against vnode commit 2024-02-26 20:21:53 +08:00
Hongze Cheng 048f8ee7c5
Merge pull request #24879 from taosdata/fix/TD-28765
fix(meta/table): remove cache table dropping
2024-02-26 18:03:51 +08:00
Hongze Cheng 98eeef9d07 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-26 16:40:05 +08:00
Hongze Cheng 2ea5903132
Merge pull request #23373 from taosdata/feat/TD-26529-3.0
TD-26529
2024-02-26 13:22:56 +08:00
Minglei Jin 323938df36 fix(meta/table): remove cache table dropping 2024-02-26 12:29:33 +08:00
Hongze Cheng 8a669d3adc Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-26 10:48:14 +08:00
Haojun Liao 59ad27fcae other(stream): comment some logs. 2024-02-24 22:50:17 +08:00
Haojun Liao bb31b0c121 fix(stream): add logs. 2024-02-24 02:08:49 +08:00
Haojun Liao 2800454c35 Merge branch '3.0' into fix/nullcheck 2024-02-24 01:46:15 +08:00
Haojun Liao df2488431e fix(stream): add logs. 2024-02-24 00:40:26 +08:00
chenhaoran ab07900895 Merge branch '3.0' into feat/TD-26529-3.0 2024-02-23 20:54:19 +08:00
Hongze Cheng 78da82784c more code 2024-02-23 17:27:03 +08:00
Hongze Cheng a6423b7816 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-23 14:47:10 +08:00
Hongze Cheng aaa36b580e more code 2024-02-23 14:44:46 +08:00
Minglei Jin e80ac5a4a6 fix(vnd/query): not release reader if not initialized 2024-02-23 10:14:59 +08:00
dapan1121 794d4a931c
Merge pull request #24820 from taosdata/mark/3.0
fix:add excluded msg for meta in tmq
2024-02-23 09:41:39 +08:00
Haojun Liao da0265ddde fix(tsdb): set correct error code info extract method. 2024-02-22 15:52:47 +08:00
dm chen 271e997438
Merge pull request #24823 from taosdata/3.0
merge 3.0
2024-02-22 12:47:42 +08:00
wangmm0220 6e13e4aa63 fix:add excluded msg for meta in tmq 2024-02-22 10:58:32 +08:00
Hongze Cheng 665cc2c2c4 more code change 2024-02-22 10:13:35 +08:00
Hongze Cheng a9e3ca41a9 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-22 09:39:48 +08:00
Haojun Liao 6f8a54f27b fix(stream): free dummy rsp msg. 2024-02-21 16:27:52 +08:00
dmchen 606aa61c4f remove errors and delete 2024-02-21 08:06:45 +00:00
Hongze Cheng b0b71bc3c2 more code 2024-02-21 15:21:46 +08:00
Haojun Liao b361eb4a7c fix(stream): add hb rsp handle function for vnode and snode. 2024-02-21 15:16:07 +08:00
Hongze Cheng 4b71031014 more code 2024-02-21 14:29:10 +08:00
Hongze Cheng b7b9c02694 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-21 13:18:56 +08:00
slzhou 87c8f1aa82 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4243-3.0 2024-02-21 13:09:36 +08:00
dmchen c55e9b1877 insert user empty 2024-02-21 04:12:45 +00:00
Haojun Liao d6f5ae226b refactor: do some internal refactor. 2024-02-21 09:42:23 +08:00
Hongze Cheng fca1c077fe
Merge pull request #24790 from taosdata/fix/TD-28329
fix(tsdb/cache): remove unused block index cache
2024-02-21 09:03:54 +08:00
Minglei Jin efd2bc6bac fix(tsdb/cache): remove unused block index cache 2024-02-20 17:12:55 +08:00
Hongze Cheng 6cdef62f92
Merge pull request #24772 from taosdata/fix/TD-28539-3.0
fix: invalid memory access during meta snapshot transfer
2024-02-20 17:01:46 +08:00
Hongze Cheng 261d38d4a7
Merge pull request #24710 from taosdata/fix/TD-24422-2
enh(tsdb/cache): flag empty table when creating
2024-02-20 16:17:18 +08:00
Hongze Cheng cb0a5b4725 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28539-3.0 2024-02-20 14:20:48 +08:00
Haojun Liao 13c3654bf5 other: merge 3.0 2024-02-20 10:51:04 +08:00
Alex Duan 2eb33b6ee6
Merge pull request #24759 from taosdata/coverage/TD-28602-3.0
coverage: add schUtil.c and schedulerTest
2024-02-20 09:14:03 +08:00
dapan1121 980e1b83be
Merge pull request #24775 from taosdata/opti/TS-4480
opti:consume performance if all data is in format of "insert into using"
2024-02-20 09:07:59 +08:00
Haojun Liao 46b1fe520f
Merge pull request #24538 from taosdata/feat/TD-22023
stream count window
2024-02-20 08:50:25 +08:00
wangmm0220 77e2500a81 fix:conflicts from 3.0 2024-02-19 18:46:31 +08:00
54liuyao af1893d109 merge 3.0 2024-02-19 18:30:12 +08:00
Haojun Liao 931b9f0b51 other: merge 3.0 2024-02-19 18:27:18 +08:00
Alex Duan ba306043bb Merge branch '3.0' into coverage/TD-28602-3.0 2024-02-19 16:06:57 +08:00
Haojun Liao bf242a4f64 fix(stream): handle pause event in waiting list. 2024-02-19 15:57:21 +08:00
wangmm0220 a74f12e2e1 opti:consume performance if all data is in format of "insert into using" 2024-02-19 15:50:43 +08:00
Haojun Liao a3b04c3c58 fix(stream): set the processVer for streamTask when initializing the task object. 2024-02-19 14:50:09 +08:00
Hongze Cheng ad0c91e6c3 fix: invalid memory access during meta snapshot transfer 2024-02-19 14:06:45 +08:00
wangmm0220 ac9582b24a fix:[TD-28567] do not add md5 to the end of subtable if create stream by sma 2024-02-19 13:58:58 +08:00
Haojun Liao d3e8adf2eb enh(stream): async handle pause event 2024-02-19 13:36:57 +08:00
Haojun Liao 7e866c5527 refactor: do some internal refactor. 2024-02-19 11:32:04 +08:00
54liuyao b53dc5602e Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-02-19 10:58:20 +08:00
Haojun Liao cf571e4f1f refactor: do some internal refactor. 2024-02-19 09:52:22 +08:00
Hongze Cheng 45684e49c7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-19 09:08:58 +08:00
54liuyao 05eaa90c11 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-19 08:59:15 +08:00
Alex Duan b3a6fa9c12 coverage: add explain.c 2024-02-18 19:36:35 +08:00
wangmm0220 a8e45440c0 fix:conflicts from 3.0 2024-02-18 18:02:14 +08:00
Haojun Liao 245f0ef806 fix(stream): fix deadlock. 2024-02-18 17:05:00 +08:00
Haojun Liao 472020a2b9 enh(stream): handle event async function. 2024-02-18 14:07:15 +08:00
Hongze Cheng 8f1fa68994 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4478-3.0 2024-02-18 10:53:51 +08:00
dapan1121 8f63952ad5
Merge pull request #24750 from taosdata/mark/3.0
fix:[TD-28590]add logic for consume excluded
2024-02-18 10:13:25 +08:00
Hongze Cheng 52ed1ec5f7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-18 09:52:53 +08:00
Alex Duan f5e0563891 coverage: tsdbCache.c 2024-02-17 12:12:37 +08:00
Alex Duan 8852beb2cc coverage: tsdbUtil.c 2024-02-16 15:17:15 +08:00
dm chen 6d2d37d964
Merge pull request #24751 from taosdata/3.0
merge 3.0
2024-02-06 19:16:53 +08:00
dmchen e5dcef0794 forward client directly 2024-02-06 08:29:09 +00:00
wangmm0220 871ebfa7ba Merge branch '3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-02-06 14:02:46 +08:00
Haojun Liao 2bba011e4e Merge remote-tracking branch 'origin/feat/TD-22023' into feat/TD-22023 2024-02-05 17:51:23 +08:00
Haojun Liao 7a18e5910c enh(stream): halt the initial stream tasks when fill-history is set for count window agg 2024-02-05 17:51:09 +08:00
wangmm0220 5796f411e4 Merge branch 'mark/3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-02-05 17:08:05 +08:00
wangmm0220 a656d75ca7 opti:consume data excluded from some source 2024-02-05 17:07:50 +08:00
54liuyao c588770699 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-05 15:10:34 +08:00
wade zhang 0ebd7d2527
Merge pull request #24737 from taosdata/feat/TD-27463-3.0
feat: support uniq grant
2024-02-05 10:32:34 +08:00
54liuyao b16fc7d9df Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-05 10:15:59 +08:00
dmchen 16aef66260 ci case fail 2024-02-05 01:34:20 +00:00
Haojun Liao 2e79c766fa
Merge pull request #24731 from taosdata/fix/3_liaohj
fix(tsdb): check and return if the rows in stt are before the data rows in data files.
2024-02-05 09:00:32 +08:00
54liuyao ea9353b9fd merge 3.0 2024-02-04 16:04:23 +08:00
Haojun Liao 6736fd1615 fix(tsdb): check and return if the rows in stt are before the data rows in data files. 2024-02-04 14:11:17 +08:00
kailixu f53d0bce5d feat: support uniq grant 2024-02-04 00:24:42 +08:00
Hongze Cheng 89f0aa4bc4 more code 2024-02-02 12:45:01 +08:00
Hongze Cheng b79859d2a3 more code 2024-02-02 12:26:05 +08:00
slzhou 4a6317a047 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4243-3.0 2024-02-02 11:29:04 +08:00
Haojun Liao 3236ef7bae feat(stream): return the stream source task exec delay, and do some internal refactor. 2024-02-02 11:26:47 +08:00
Alex Duan 035f7d096c
Merge pull request #24715 from taosdata/coverage/TD-28550-3.0
coverage: metaIdx.c comment no use function
2024-02-02 09:05:51 +08:00
Alex Duan 963bb20ce3 coverage: metaIdx.c comment no use funciton 2024-02-01 19:11:50 +08:00
Minglei Jin d59b767af3 enh(tsdb/cache): flag empty table when creating 2024-02-01 17:40:32 +08:00
Haojun Liao cb2ea4a721 fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened. 2024-02-01 11:37:57 +08:00
wangmm0220 a9fcc67321 fix:conflicts from 3.0 2024-02-01 11:13:03 +08:00
Haojun Liao 556baed25d other: merge 3.0 2024-01-30 18:35:59 +08:00
Haojun Liao 4970040459 refactor: do some internal refactor. 2024-01-30 15:22:49 +08:00
dmchen 8d683983e0 interface name 2024-01-29 10:11:17 +00:00
54liuyao d7fb8db086 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-29 16:13:39 +08:00
Haojun Liao bfbd61a02f
Merge pull request #24634 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-26 18:08:54 +08:00
Hongze Cheng e7177dae57 more code 2024-01-26 17:14:00 +08:00
Hongze Cheng 09a65e5992 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4478-3.0 2024-01-26 16:51:47 +08:00
Haojun Liao ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
54liuyao bc4f3d1296 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-26 15:55:06 +08:00
Haojun Liao 649d26ce72 fix(stream): seek to right place to start wal read. 2024-01-26 14:14:04 +08:00
Haojun Liao 49aff4571b fix(stream): fix memory leak. 2024-01-26 11:33:07 +08:00
Haojun Liao db117a3ac7
Merge pull request #24628 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-26 09:09:44 +08:00
Haojun Liao d4bab8c09b refactor: do some internal refactor. 2024-01-25 16:53:30 +08:00
Haojun Liao 834f08a2e0
Merge pull request #24552 from taosdata/fix/3_liaohj
fix(stream): do checkpoint after fill-history task completed.
2024-01-25 16:53:11 +08:00
Hongze Cheng e8a8748dc9 more fix 2024-01-25 15:48:45 +08:00
Hongze Cheng 7d27c3902a feat: avoid meta rwlock starvation 2024-01-25 15:45:09 +08:00
54liuyao 7105b0ffe3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-25 10:12:13 +08:00
dmchen d9af07de6f new table structure 2024-01-24 09:44:44 +00:00
Hongze Cheng 82f3b3a931
Merge pull request #24589 from taosdata/fix/ttlnoretry-3.0
fix: no retry for ttl drop table
2024-01-24 14:03:18 +08:00
Haojun Liao 8a7e38ad15 fix(stream): fix checkpoint failure check. 2024-01-24 13:10:53 +08:00
Shungang Li 5bd14b4866 enh: errcode for message has been processed in preprocess 2024-01-23 13:53:51 +08:00
Benguang Zhao 192bb179e7 enh: trigger vnodeCommit at exit even if no data changed 2024-01-23 10:15:00 +08:00
54liuyao 0975e37845 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-23 10:07:50 +08:00
Haojun Liao ecd51e366f
Merge pull request #24512 from taosdata/opti/TD-28118
opti:[TD-28118] raw block data for tmq
2024-01-22 11:47:13 +08:00
Haojun Liao d973f66cea fix(stream): do checkpoint after fill-history task completed. 2024-01-19 16:18:02 +08:00
54liuyao 5a7d72d6ef Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-19 10:39:11 +08:00
wangmm0220 7246fedfef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2024-01-18 19:08:35 +08:00
factosea b83bb8c150 fix: last_row error 2024-01-18 17:20:31 +08:00
Haojun Liao 76e6c453e7 enh(stream): send msg to mnode when the transferring state completed. 2024-01-18 15:43:36 +08:00
Haojun Liao 719d1d1b90 refactor: do some internal refactor. 2024-01-18 14:34:18 +08:00
Haojun Liao f8d0c52483 fix(stream): remove this unused drop history task msg and corresponding functions. 2024-01-18 14:32:48 +08:00
wangmm0220 d5d1dd9127 opti:[TD-28118] raw block data for tmq 2024-01-17 20:08:26 +08:00
Haojun Liao d1dbd03341 fix(tsdb): fix invalid set. 2024-01-17 17:29:00 +08:00
Haojun Liao d44dc5bbb2 fix(tsdb): fix race condition. 2024-01-17 15:20:17 +08:00
Haojun Liao 56eac88349 Merge branch '3.0' into fix/3_liaohj 2024-01-17 15:14:52 +08:00
Haojun Liao 1ea671e373 enh(stream): remove time controller. 2024-01-17 14:55:15 +08:00
Haojun Liao fc16d26da2
Merge pull request #24488 from taosdata/fix/3_liaohj
fix(stream): fix some errors and do some internal refactor.
2024-01-17 14:25:32 +08:00
54liuyao 3bbfb26e09 stream count window 2024-01-17 14:22:19 +08:00
dapan1121 66c9c076e8
Merge pull request #24469 from taosdata/fix/xsren/TD-28204/whereOptimizeConditional
Fix/xsren/td 28204/where optimize conditional
2024-01-17 10:20:51 +08:00
Haojun Liao a56e589048
Merge pull request #24490 from taosdata/fix/TD-28338
fix:[TD-28338]empty varchar value return NULL in tmq
2024-01-17 10:09:40 +08:00
yihaoDeng 0d4cc6b8e2 fix:[TD-28338]empty varchar value return NULL in tmq 2024-01-16 18:46:37 +08:00
Haojun Liao 3d98fc6a67 other: merge 3.0 2024-01-16 18:29:33 +08:00
jiajingbin d59ede5196 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28032 2024-01-16 15:05:13 +08:00
Haojun Liao 9a4b7a6d82 fix(stream): remove invalid lock, and fix a typo. 2024-01-16 14:52:27 +08:00
Haojun Liao 80793c94c2 fix(stream): reset the tasks status before start all tasks, and do some other internal refactor. 2024-01-16 14:32:45 +08:00
xinsheng Ren ae5f540692
Merge branch '3.0' into fix/xsren/TD-28204/whereOptimizeConditional 2024-01-16 14:28:37 +08:00
Haojun Liao dfe959eb28
Merge pull request #24468 from taosdata/fix/3_liaohj
fix(stream): fix deadlock in pause.
2024-01-16 12:58:27 +08:00
Haojun Liao 63494de7f9 refactor: do some internal refactor. 2024-01-16 10:28:07 +08:00
dapan1121 53094f62d8
Merge pull request #24359 from taosdata/FIX/TD-27003
Fix : use last row scan when select last_row, last
2024-01-16 08:50:23 +08:00
fullhonest fafb5b1f03 Fix TD-28018: last row num error where partition by null column 2024-01-15 18:29:41 +08:00
wangmm0220 2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
factosea 2c0dd3db03 fix: memory leak 2024-01-15 16:41:52 +08:00
Haojun Liao 43081b540b fix(stream): reset restart counter to be 0 if all tasks are ready. 2024-01-15 16:16:28 +08:00
fullhonest cb2ab749b5 Fix TD-27003: use last row scan when select last_row, last 2024-01-15 15:22:29 +08:00
Haojun Liao 143e6a13af fix(stream): fix deadlock in pause. 2024-01-15 14:37:24 +08:00
Haojun Liao e012bc4bde refactor: do some internal refactor. 2024-01-15 11:28:36 +08:00
Haojun Liao c710718f9e
Merge pull request #24457 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-15 10:58:45 +08:00
Haojun Liao 00e2bdec23 refactor: do some internal refactor. 2024-01-12 19:08:46 +08:00
wangmm0220 00e0da15a3 fix:[TD-28032]groupid = 0 & modify test case in sim 2024-01-12 17:37:22 +08:00
Haojun Liao ee24bb9b03
Merge pull request #24444 from taosdata/fix/3_liaohj
fix(stream): close the inputQ of the related stream task.
2024-01-12 13:41:30 +08:00
Haojun Liao cf941f7488 fix(stream): check status when resume to run. 2024-01-12 11:12:23 +08:00
Haojun Liao b36cc97236 fix(stream): close the inputQ of the related stream task when the fill-history task recv the trans-state msg from upstream. 2024-01-12 10:44:49 +08:00
Hongze Cheng 8399f5253f
Merge pull request #24439 from taosdata/fix/TD-28285-30
fix(tsdb/cache): clear fs state before next open
2024-01-12 10:38:43 +08:00
dapan1121 3b928237d7
Merge pull request #24419 from wangjiaming0909/draft/fix/TD-28182
fix: table merge scan return disordered rows
2024-01-12 10:16:21 +08:00
Haojun Liao ea0ea09b0f
Merge pull request #24409 from taosdata/opt/optMsgOnMnode
opt msg on mnd
2024-01-12 09:36:37 +08:00
Minglei Jin aa410a6deb fix(tsdb/cache): clear fs state before next open 2024-01-12 09:32:40 +08:00
wangjiaming0909 686108050b fix: table merge scan return disordered rows 2024-01-11 09:57:35 +08:00
Haojun Liao f6c0649108 fix(stream): fix syntax error. 2024-01-11 09:53:19 +08:00
Haojun Liao bff0ad89a4 other: merge 3.0 2024-01-11 09:51:12 +08:00
Haojun Liao 1c562bd535 refactor: enable the restart of stream tasks. 2024-01-11 09:41:40 +08:00
wangmm0220 216830f8b4 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 20:33:13 +08:00
wangmm0220 df69a89da2 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 18:46:10 +08:00
Yihao Deng b5e5167b8f split sync/status channel 2024-01-10 09:57:08 +00:00
wangmm0220 02c7bdd4f0 fix:[TD-28032]fsdfasd 2024-01-10 14:57:16 +08:00
Haojun Liao b0202bb853 fix(tsdb): open reader during resume task for main reader after suspending reader. 2024-01-10 13:44:21 +08:00
Haojun Liao e8aea42498 fix(tsdb): open reader during resume task for main reader after suspending reader. 2024-01-10 13:42:36 +08:00
Haojun Liao 1b6d55616f fix(stream): fix syntax error. 2024-01-10 11:28:06 +08:00
Haojun Liao eac0d14868 fix(stream): add check when merging rows from files and buffer. 2024-01-10 11:02:44 +08:00
Haojun Liao 9d0d0d9ddc Merge branch '3.0' into fix/3_liaohj 2024-01-10 09:57:46 +08:00
Haojun Liao 2b3ad002f5
Merge pull request #24401 from taosdata/fix/TD-28142-3.0
opti:[TD-28142]memory size if block num is too large
2024-01-10 09:40:07 +08:00
Haojun Liao dc0c5539a0 fix(stream): remove invalid timer controllers. 2024-01-10 08:48:49 +08:00
Hongze Cheng 7fa06df958
Merge pull request #24395 from taosdata/fix/TD-28208
fix(tsdb/cache): destory brin block with fs loading
2024-01-09 16:31:41 +08:00
wangmm0220 6444af84e4 opti:[TD-28142]memory size if block num is too large 2024-01-09 16:28:58 +08:00
Minglei Jin d93b4f88b3 fix(tsdb/cache): destory brin block with fs loading 2024-01-09 15:23:15 +08:00
Haojun Liao f9d5c0d403 fix(stream): fix error in tq timer. 2024-01-09 09:13:53 +08:00
Haojun Liao af9dc441b2 fix(stream): reset the saved value for fill-history task. 2024-01-08 18:40:06 +08:00
Hongze Cheng 5e45ecd3fd fix: possible race condition 2024-01-08 16:46:07 +08:00
Haojun Liao 3bcd038b7d refactor: not reload info from disk when trying to restart stream tasks. 2024-01-08 14:04:36 +08:00
Haojun Liao 275e2d6f94 refactor: do some internal refactor. 2024-01-08 11:34:47 +08:00
Haojun Liao bb9edde79e fix(stream): add some logs. 2024-01-08 11:33:54 +08:00
Haojun Liao a024fe960c fix(stream): fix deadlock. 2024-01-07 14:53:17 +08:00
Haojun Liao 29219ba9f4 fix(stream): add task number check. 2024-01-07 01:32:50 +08:00
Haojun Liao 02f6c971fd fix(stream): check for not ready task when rsp returned. 2024-01-06 19:43:39 +08:00
Haojun Liao cfda97beef refactor: disable commit temp 2024-01-06 15:27:48 +08:00
Haojun Liao 23341e1bdf refactor: opt perf by avoid save tasks during restoring 2024-01-05 22:58:43 +08:00
Haojun Liao 445605ed22 refactor: do some internal refactor. 2024-01-05 22:35:56 +08:00
Haojun Liao 522e688387 fix(stream): check if in restart procedure in call back. 2024-01-05 22:16:58 +08:00
Haojun Liao 2386f842fb enh(stream): remove sleep to opt perf. 2024-01-05 18:46:15 +08:00
Haojun Liao 0c4b91dc72 enh(stream): start task async. 2024-01-05 17:55:39 +08:00
Haojun Liao 1912de9b49 enh(stream): scan wal by using timer to trigger it. 2024-01-05 14:49:33 +08:00
Haojun Liao 33f698e926 fix(stream): remove invalid assert and add check for task status before launching related fill-history task. 2024-01-04 19:09:45 +08:00
Hongze Cheng df74b2d755
Merge pull request #24284 from taosdata/fix/TD-27988
fix: remove useless code
2024-01-04 19:03:45 +08:00
Haojun Liao 6d37e596ec refactor: do some internal refactor. 2024-01-04 18:47:49 +08:00
Haojun Liao c494252002 fix(stream): record the related fill-history task failure. 2024-01-04 17:44:05 +08:00
dm chen 39f2e75a9e
Merge branch '3.0' into feat/TD-26529-3.0 2024-01-04 15:46:23 +08:00
Hongze Cheng 13834802ef
Merge pull request #24269 from taosdata/FIX/TD-28101-3.0
enh: send rsp msg on rejecting snap replication due to smaller term
2024-01-04 10:15:09 +08:00
dapan1121 670317ccd7
Merge pull request #24053 from taosdata/enh/3.0/TD-26813
enh: support group by tag/tbname to list empty groups
2024-01-04 09:08:03 +08:00
Haojun Liao 1e3aad8883 refactor: do some internal refactor. 2024-01-03 23:57:33 +08:00
wangmm0220 b200e6807f fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 19:44:30 +08:00
wangmm0220 317f0c6a39 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 18:48:54 +08:00
Haojun Liao 4399867e14 fix(stream): fix the not running bug. 2024-01-03 18:28:23 +08:00
Haojun Liao 4138692cea fix(stream): scan wal data files. 2024-01-03 18:16:18 +08:00
Haojun Liao 185fa75376 enh(stream): add task into timer to be idle during exec when the corresponding output queue is full. 2024-01-03 17:59:42 +08:00
dapan1121 f0fbffa772
Merge pull request #24301 from taosdata/fix/3.0/TD-28104
fix: last table scan reported invalid param when col was dropped which
2024-01-03 15:47:33 +08:00
Haojun Liao a2e85c44c2
Merge pull request #24228 from taosdata/fix/3_liaohj
refactor: remove stream-scan-history event for stream task.
2024-01-03 14:43:20 +08:00
Haojun Liao 453d3e8a30 fix(stream): fix dead lock on windows. 2024-01-03 10:50:38 +08:00
wangmm0220 ab262550d1 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 10:37:05 +08:00
wangmm0220 9ba2f71487 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-03 10:16:43 +08:00
Haojun Liao 6c7683dba6
Merge pull request #24310 from taosdata/fix/crash_stream
fix(tsdb): check if stt blocks are clean before building data blocks.
2024-01-02 21:30:28 +08:00
wangmm0220 8add4dc177 fix:[TD-28032]concat subtable and hash val as new subtable name to avoid data from multi time line write to one time line 2024-01-02 18:37:29 +08:00
Haojun Liao 5bbf12c2c9 fix(tsdb): check if stt blocks are clean before building composed data blocks. 2024-01-02 18:35:17 +08:00
Haojun Liao 29afc2ad6a fix(stream):add jump condition for loop. 2024-01-02 15:48:08 +08:00
Haojun Liao e7a0044502 Merge branch '3.0' into fix/3_liaohj 2024-01-02 13:02:55 +08:00
Haojun Liao 4368bfb20a fix(stream): fix dead lock. 2024-01-02 11:40:29 +08:00
Haojun Liao b3d8f4e9d6 fix(stream): fix a typo. 2024-01-02 10:39:01 +08:00
Haojun Liao d217412691 fix(stream): avoid race condition in starting threads. 2024-01-02 10:33:25 +08:00
wangjiaming0909 be0d35a5af fix: last table scan reported invalid param when col was dropped which
should report invalid col
2024-01-02 10:20:04 +08:00
Haojun Liao 8ac02adc0b refactor: do some internal refactor. 2023-12-29 17:42:23 +08:00
Hongze Cheng 7cb12db8ce remove more useless code 2023-12-29 15:20:27 +08:00
Benguang Zhao 68cb86602e fix: reuse cid with fs eid updated in tsdbFSetRAWWriteFileDataBegin 2023-12-29 11:49:57 +08:00
Benguang Zhao baa7f9c895 enh: adjust error msg as warn for not ready to propose etc 2023-12-28 17:29:49 +08:00
Haojun Liao 1659164926 fix(stream): remove invalid checkpoint id check. 2023-12-27 23:00:18 +08:00
Haojun Liao 7eb0e42bb9 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-27 22:57:58 +08:00
Hongze Cheng 90645cbc77
Merge pull request #24220 from taosdata/fix/TD-27988
fix: remove useless code
2023-12-27 21:23:26 +08:00
Hongze Cheng 2ada7d455e
Merge pull request #24236 from taosdata/fix/TD-28061
fix(tsdb/cache): erase entry from lru if deleted
2023-12-27 18:13:16 +08:00
Haojun Liao 5592e11235 fix(stream): handle error when checkpoint is interrupted by nodeUpdate. 2023-12-26 19:02:52 +08:00
54liuyao ccf861dec8 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/3_liaohj 2023-12-26 18:36:18 +08:00
Minglei Jin 2ba586513f fix(tsdb/cache): erase entry from lru if deleted 2023-12-26 16:41:33 +08:00
Yihao Deng 40aa5f697f fix tag index double free 2023-12-26 07:21:02 +00:00
Yihao Deng dc01625ea1 fix tag index double free 2023-12-26 06:52:33 +00:00
Haojun Liao 62cfcefbb0 refactor: remove stream-scan-history event for stream task. 2023-12-26 00:34:04 +08:00
Hongze Cheng a7c8563c06 fix: remove useless code 2023-12-25 16:13:30 +08:00
Haojun Liao e5087f6e23 fix(tsdb): fix invalid delete check. 2023-12-25 10:40:36 +08:00
Haojun Liao 00fac852e8 fix(tsdb): fix invalid delete check. 2023-12-25 09:55:24 +08:00
Haojun Liao 0877e0bfad other: merge 3.0 2023-12-25 09:13:31 +08:00
Haojun Liao 30498a4028 refactor: do some internal refactor. 2023-12-24 02:24:46 +08:00
Haojun Liao 25f798e42f fix(stream): record the start failure tasks 2023-12-23 23:29:30 +08:00
Bob Liu e3098accc4 support count empty table 2023-12-22 18:14:26 +08:00
Haojun Liao b175a4b7b3 refactor(stream): async stop tasks, and do some internal refactor. 2023-12-22 17:56:16 +08:00
Haojun Liao 7ce545bcd4 refactor: refactor the lock type. 2023-12-22 16:14:49 +08:00
Haojun Liao e91afa7df2 fix(stream): fix deadlock. 2023-12-22 14:51:04 +08:00
Haojun Liao 90898a16e0 refactor: do some internal refactor. 2023-12-22 13:57:15 +08:00
Hongze Cheng 02bb9e90d2
Merge pull request #24189 from taosdata/fix/TD-27974
fix(tsdb/cache): prepend ts col to load stt
2023-12-22 13:53:15 +08:00
Minglei Jin 16ad59fb18 fix(tsdb/cache): prepend ts col to load stt 2023-12-22 12:14:27 +08:00
Hongze Cheng 46211258b3
Merge pull request #24173 from taosdata/fix/TD-27974
fix(tsdb/cache): plus 1 to nCols to load stt data
2023-12-22 09:43:20 +08:00
Haojun Liao c9475060de fix(stream): fix race condition. 2023-12-22 09:34:49 +08:00
Minglei Jin 9d3eb02f3c fix(tsdb/cache): plus 1 to nCols to load stt data 2023-12-21 17:53:44 +08:00
Haojun Liao 2acc8423c5 fix(stream): send msg to mnode before closing all tasks. 2023-12-21 16:00:50 +08:00
Alex Duan 9d4a75b0be coverage: vnodeSrv.c tmsg.c trow.c 2023-12-21 14:22:22 +08:00
Haojun Liao 71f6d9f06f fix(stream): handle the case that recvs drop msg twice. 2023-12-21 11:52:45 +08:00
wangmm0220 de8ce3f7ec fix:send stream retrieve msg to source task 2023-12-20 16:01:17 +08:00
Haojun Liao 1a8583887f fix(stream): remove clear backendcache. 2023-12-20 15:35:43 +08:00
Haojun Liao d25a323a4c fix(stream): record the launch failure. 2023-12-20 13:55:12 +08:00
Haojun Liao 81d8b2434f refactor: do some internal refactor. 2023-12-20 10:25:31 +08:00
Haojun Liao 541967e99e refactor: do some internal refactor. 2023-12-20 10:24:03 +08:00
Haojun Liao 2de0f6e971 test(stream): lock the update procedure. 2023-12-19 18:56:15 +08:00
Haojun Liao 92045f5485 fix(stream): add snode check, and handle the task status reset from checkpoint when it is in the snode. 2023-12-19 18:34:30 +08:00
Haojun Liao 17e9e84aa9 Merge branch '3.0' into fix/3_liaohj 2023-12-19 16:43:08 +08:00
Haojun Liao fee198f9ad refactor: do some internal refactor. 2023-12-19 16:21:11 +08:00
Haojun Liao ec3183b6a8 other: merge 3.0 2023-12-18 23:16:37 +08:00
Haojun Liao 579366ec00
Merge pull request #24121 from taosdata/fix/liaohj
other: merge main into 3.0
2023-12-18 23:11:36 +08:00
Haojun Liao e734569de0 fix(stream): fix dead lock. 2023-12-18 18:42:57 +08:00
Haojun Liao bba5a4f08b other: merge main into 3.0 2023-12-18 18:26:42 +08:00
Minglei Jin 64378be7f4 fix(tsdb/cache): fix buffer-overflow with column adding 2023-12-18 18:06:40 +08:00
Haojun Liao ea6e78cbaa fix(stream): add async call restart, instead of sync wait. 2023-12-18 16:33:44 +08:00
wade zhang 4cac96d2df
Merge pull request #24111 from taosdata/fix/TD-27845
fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange
2023-12-18 16:27:18 +08:00
Haojun Liao 79672f8e5f
Merge pull request #24107 from taosdata/fix/3_liaohj
fix(stream): add check for null ptr and leader .
2023-12-18 16:24:07 +08:00
Minglei Jin 5dd9ce8ceb fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange 2023-12-18 15:02:34 +08:00
Haojun Liao b4a1907fb7 fix(stream): add check for null ptr and leader . 2023-12-18 11:52:59 +08:00
Haojun Liao ef0cab18cb
Merge pull request #24098 from taosdata/fix/3_liaohj
fix(stream): send checkpoint complete msg to mnode when dropping it.
2023-12-17 11:03:04 +08:00
Haojun Liao 4f852704f5 fix(stream): send checkpoint complete msg to mnode when dropping it. 2023-12-17 02:06:01 +08:00
Haojun Liao 0526e619ad
Merge pull request #24095 from taosdata/fix/3_liaohj
fix(tsdb): add desc check for clean file block.
2023-12-16 18:10:15 +08:00
Haojun Liao 4cc0f5be59 fix(tsdb): add desc check for clean file block. 2023-12-16 15:37:17 +08:00
Haojun Liao 1a9701d401
Merge pull request #23946 from taosdata/fix/snodeBackendCrash
Fix/snode backend crash
2023-12-16 13:13:28 +08:00
Haojun Liao f9a5485d52 fix(stream): refactor the stream trans conflict detection strategy. 2023-12-16 01:46:29 +08:00
slzhou 8a6317b76a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fix-tms-duration 2023-12-15 22:09:43 +08:00
Haojun Liao a847bf468a
Merge pull request #24088 from taosdata/fix/3_liaohj
fix(query): add rows info if blocks exist.
2023-12-15 18:24:45 +08:00
yihaoDeng bb5f0d9112 Merge branch 'fix/snodeBackendCrash' of https://github.com/taosdata/TDengine into fix/snodeBackendCrash 2023-12-15 18:16:38 +08:00
yihaoDeng 7ab7a64eb3 Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 18:16:14 +08:00
Hongze Cheng 4ae13f411e
Merge pull request #24010 from taosdata/feat/TS-4229
feat: compact monitor and kill
2023-12-15 16:20:13 +08:00
Haojun Liao e2fa4cba8c refactor: do some internal refactor. 2023-12-15 15:28:01 +08:00
shenglian zhou cc4a6c6d55 fix: add new duration block event 2023-12-15 15:04:47 +08:00
Haojun Liao 556eaa22ac
Merge pull request #24074 from taosdata/mark/3.0
fix:core dump if tqOpen error in vnodeOpen
2023-12-15 13:55:10 +08:00
wangmm0220 812f0f97a7 fix:rollback size to old logic 2023-12-15 10:09:18 +08:00
slzhou d3146a5bec fix: when no file block, no proc mem before fileset 2023-12-15 09:51:06 +08:00
Yihao Deng 5f2d93d62c
Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 09:22:33 +08:00
wangmm0220 740228a653 fix:core dump if tqOpen error in vnodeOpen 2023-12-15 09:07:35 +08:00
slzhou 5bf364cc0a enhance: refactor code 2023-12-15 08:23:25 +08:00
dmchen d7ac3558f8 fix wrong merge 2023-12-14 11:21:41 +00:00
dm chen 81767dfa32
Merge branch '3.0' into feat/TS-4229 2023-12-14 17:02:51 +08:00
slzhou 4dc39e74c5 fix: the block return from buildBlockFromFiles should be of new fileset 2023-12-14 16:57:04 +08:00
wade zhang c95c567376
Merge pull request #24046 from taosdata/fix/TS-4251-3.0
revert dependency
2023-12-14 14:03:04 +08:00
Haojun Liao 05ca8f1784
Merge pull request #24056 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-12-14 13:52:04 +08:00
Haojun Liao 7cf0add513 fix(stream): fix error caused by refactor. 2023-12-14 11:28:03 +08:00
Haojun Liao f0d63a977a refactor: do some internal refactor. 2023-12-14 10:01:57 +08:00
Haojun Liao 8e042e34cb refactor: do some internal refactor. 2023-12-14 09:48:14 +08:00
Haojun Liao 81f96603b0 refactor: do some internal refactor. 2023-12-14 09:33:51 +08:00