Commit Graph

8691 Commits

Author SHA1 Message Date
wangmm0220 6e13e4aa63 fix:add excluded msg for meta in tmq 2024-02-22 10:58:32 +08:00
Hongze Cheng 665cc2c2c4 more code change 2024-02-22 10:13:35 +08:00
Hongze Cheng a9e3ca41a9 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-22 09:39:48 +08:00
Haojun Liao 6f8a54f27b fix(stream): free dummy rsp msg. 2024-02-21 16:27:52 +08:00
dmchen 606aa61c4f remove errors and delete 2024-02-21 08:06:45 +00:00
Hongze Cheng b0b71bc3c2 more code 2024-02-21 15:21:46 +08:00
Haojun Liao b361eb4a7c fix(stream): add hb rsp handle function for vnode and snode. 2024-02-21 15:16:07 +08:00
Hongze Cheng 4b71031014 more code 2024-02-21 14:29:10 +08:00
Hongze Cheng b7b9c02694 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-21 13:18:56 +08:00
slzhou 87c8f1aa82 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4243-3.0 2024-02-21 13:09:36 +08:00
dmchen c55e9b1877 insert user empty 2024-02-21 04:12:45 +00:00
Haojun Liao d6f5ae226b refactor: do some internal refactor. 2024-02-21 09:42:23 +08:00
Hongze Cheng fca1c077fe
Merge pull request #24790 from taosdata/fix/TD-28329
fix(tsdb/cache): remove unused block index cache
2024-02-21 09:03:54 +08:00
Minglei Jin efd2bc6bac fix(tsdb/cache): remove unused block index cache 2024-02-20 17:12:55 +08:00
Hongze Cheng 6cdef62f92
Merge pull request #24772 from taosdata/fix/TD-28539-3.0
fix: invalid memory access during meta snapshot transfer
2024-02-20 17:01:46 +08:00
Hongze Cheng 261d38d4a7
Merge pull request #24710 from taosdata/fix/TD-24422-2
enh(tsdb/cache): flag empty table when creating
2024-02-20 16:17:18 +08:00
Hongze Cheng cb0a5b4725 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28539-3.0 2024-02-20 14:20:48 +08:00
Haojun Liao 13c3654bf5 other: merge 3.0 2024-02-20 10:51:04 +08:00
Alex Duan 2eb33b6ee6
Merge pull request #24759 from taosdata/coverage/TD-28602-3.0
coverage: add schUtil.c and schedulerTest
2024-02-20 09:14:03 +08:00
dapan1121 980e1b83be
Merge pull request #24775 from taosdata/opti/TS-4480
opti:consume performance if all data is in format of "insert into using"
2024-02-20 09:07:59 +08:00
Haojun Liao 46b1fe520f
Merge pull request #24538 from taosdata/feat/TD-22023
stream count window
2024-02-20 08:50:25 +08:00
wangmm0220 77e2500a81 fix:conflicts from 3.0 2024-02-19 18:46:31 +08:00
54liuyao af1893d109 merge 3.0 2024-02-19 18:30:12 +08:00
Haojun Liao 931b9f0b51 other: merge 3.0 2024-02-19 18:27:18 +08:00
Alex Duan ba306043bb Merge branch '3.0' into coverage/TD-28602-3.0 2024-02-19 16:06:57 +08:00
Haojun Liao bf242a4f64 fix(stream): handle pause event in waiting list. 2024-02-19 15:57:21 +08:00
wangmm0220 a74f12e2e1 opti:consume performance if all data is in format of "insert into using" 2024-02-19 15:50:43 +08:00
Haojun Liao a3b04c3c58 fix(stream): set the processVer for streamTask when initializing the task object. 2024-02-19 14:50:09 +08:00
Hongze Cheng ad0c91e6c3 fix: invalid memory access during meta snapshot transfer 2024-02-19 14:06:45 +08:00
wangmm0220 ac9582b24a fix:[TD-28567] do not add md5 to the end of subtable if create stream by sma 2024-02-19 13:58:58 +08:00
Haojun Liao d3e8adf2eb enh(stream): async handle pause event 2024-02-19 13:36:57 +08:00
Haojun Liao 7e866c5527 refactor: do some internal refactor. 2024-02-19 11:32:04 +08:00
54liuyao b53dc5602e Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-02-19 10:58:20 +08:00
Haojun Liao cf571e4f1f refactor: do some internal refactor. 2024-02-19 09:52:22 +08:00
Hongze Cheng 45684e49c7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-19 09:08:58 +08:00
54liuyao 05eaa90c11 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-19 08:59:15 +08:00
Alex Duan b3a6fa9c12 coverage: add explain.c 2024-02-18 19:36:35 +08:00
wangmm0220 a8e45440c0 fix:conflicts from 3.0 2024-02-18 18:02:14 +08:00
Haojun Liao 245f0ef806 fix(stream): fix deadlock. 2024-02-18 17:05:00 +08:00
Haojun Liao 472020a2b9 enh(stream): handle event async function. 2024-02-18 14:07:15 +08:00
Hongze Cheng 8f1fa68994 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4478-3.0 2024-02-18 10:53:51 +08:00
dapan1121 8f63952ad5
Merge pull request #24750 from taosdata/mark/3.0
fix:[TD-28590]add logic for consume excluded
2024-02-18 10:13:25 +08:00
Hongze Cheng 52ed1ec5f7 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-02-18 09:52:53 +08:00
Alex Duan f5e0563891 coverage: tsdbCache.c 2024-02-17 12:12:37 +08:00
Alex Duan 8852beb2cc coverage: tsdbUtil.c 2024-02-16 15:17:15 +08:00
dm chen 6d2d37d964
Merge pull request #24751 from taosdata/3.0
merge 3.0
2024-02-06 19:16:53 +08:00
dmchen e5dcef0794 forward client directly 2024-02-06 08:29:09 +00:00
wangmm0220 871ebfa7ba Merge branch '3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-02-06 14:02:46 +08:00
Haojun Liao 2bba011e4e Merge remote-tracking branch 'origin/feat/TD-22023' into feat/TD-22023 2024-02-05 17:51:23 +08:00
Haojun Liao 7a18e5910c enh(stream): halt the initial stream tasks when fill-history is set for count window agg 2024-02-05 17:51:09 +08:00
wangmm0220 5796f411e4 Merge branch 'mark/3.0' of https://github.com/taosdata/TDengine into mark/3.0 2024-02-05 17:08:05 +08:00
wangmm0220 a656d75ca7 opti:consume data excluded from some source 2024-02-05 17:07:50 +08:00
54liuyao c588770699 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-05 15:10:34 +08:00
wade zhang 0ebd7d2527
Merge pull request #24737 from taosdata/feat/TD-27463-3.0
feat: support uniq grant
2024-02-05 10:32:34 +08:00
54liuyao b16fc7d9df Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-02-05 10:15:59 +08:00
dmchen 16aef66260 ci case fail 2024-02-05 01:34:20 +00:00
Haojun Liao 2e79c766fa
Merge pull request #24731 from taosdata/fix/3_liaohj
fix(tsdb): check and return if the rows in stt are before the data rows in data files.
2024-02-05 09:00:32 +08:00
54liuyao ea9353b9fd merge 3.0 2024-02-04 16:04:23 +08:00
Haojun Liao 6736fd1615 fix(tsdb): check and return if the rows in stt are before the data rows in data files. 2024-02-04 14:11:17 +08:00
kailixu f53d0bce5d feat: support uniq grant 2024-02-04 00:24:42 +08:00
Hongze Cheng 89f0aa4bc4 more code 2024-02-02 12:45:01 +08:00
Hongze Cheng b79859d2a3 more code 2024-02-02 12:26:05 +08:00
slzhou 4a6317a047 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4243-3.0 2024-02-02 11:29:04 +08:00
Haojun Liao 3236ef7bae feat(stream): return the stream source task exec delay, and do some internal refactor. 2024-02-02 11:26:47 +08:00
Alex Duan 035f7d096c
Merge pull request #24715 from taosdata/coverage/TD-28550-3.0
coverage: metaIdx.c comment no use function
2024-02-02 09:05:51 +08:00
Alex Duan 963bb20ce3 coverage: metaIdx.c comment no use funciton 2024-02-01 19:11:50 +08:00
Minglei Jin d59b767af3 enh(tsdb/cache): flag empty table when creating 2024-02-01 17:40:32 +08:00
Haojun Liao cb2ea4a721 fix(stream): take ver snapshot for all vgroups before launching stream with fill-history option opened. 2024-02-01 11:37:57 +08:00
wangmm0220 a9fcc67321 fix:conflicts from 3.0 2024-02-01 11:13:03 +08:00
Haojun Liao 556baed25d other: merge 3.0 2024-01-30 18:35:59 +08:00
Haojun Liao 4970040459 refactor: do some internal refactor. 2024-01-30 15:22:49 +08:00
dmchen 8d683983e0 interface name 2024-01-29 10:11:17 +00:00
54liuyao d7fb8db086 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-29 16:13:39 +08:00
Haojun Liao bfbd61a02f
Merge pull request #24634 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-26 18:08:54 +08:00
Hongze Cheng e7177dae57 more code 2024-01-26 17:14:00 +08:00
Hongze Cheng 09a65e5992 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4478-3.0 2024-01-26 16:51:47 +08:00
Haojun Liao ac08f659c3 refactor: remove invalid procedure in fill-history. 2024-01-26 16:20:43 +08:00
54liuyao bc4f3d1296 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-26 15:55:06 +08:00
Haojun Liao 649d26ce72 fix(stream): seek to right place to start wal read. 2024-01-26 14:14:04 +08:00
Haojun Liao 49aff4571b fix(stream): fix memory leak. 2024-01-26 11:33:07 +08:00
Haojun Liao db117a3ac7
Merge pull request #24628 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-26 09:09:44 +08:00
Haojun Liao d4bab8c09b refactor: do some internal refactor. 2024-01-25 16:53:30 +08:00
Haojun Liao 834f08a2e0
Merge pull request #24552 from taosdata/fix/3_liaohj
fix(stream): do checkpoint after fill-history task completed.
2024-01-25 16:53:11 +08:00
Hongze Cheng e8a8748dc9 more fix 2024-01-25 15:48:45 +08:00
Hongze Cheng 7d27c3902a feat: avoid meta rwlock starvation 2024-01-25 15:45:09 +08:00
54liuyao 7105b0ffe3 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-22023 2024-01-25 10:12:13 +08:00
dmchen d9af07de6f new table structure 2024-01-24 09:44:44 +00:00
Hongze Cheng 82f3b3a931
Merge pull request #24589 from taosdata/fix/ttlnoretry-3.0
fix: no retry for ttl drop table
2024-01-24 14:03:18 +08:00
Haojun Liao 8a7e38ad15 fix(stream): fix checkpoint failure check. 2024-01-24 13:10:53 +08:00
Shungang Li 5bd14b4866 enh: errcode for message has been processed in preprocess 2024-01-23 13:53:51 +08:00
Benguang Zhao 192bb179e7 enh: trigger vnodeCommit at exit even if no data changed 2024-01-23 10:15:00 +08:00
54liuyao 0975e37845 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-23 10:07:50 +08:00
Haojun Liao ecd51e366f
Merge pull request #24512 from taosdata/opti/TD-28118
opti:[TD-28118] raw block data for tmq
2024-01-22 11:47:13 +08:00
Haojun Liao d973f66cea fix(stream): do checkpoint after fill-history task completed. 2024-01-19 16:18:02 +08:00
54liuyao 5a7d72d6ef Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2024-01-19 10:39:11 +08:00
wangmm0220 7246fedfef Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_multi_marks 2024-01-18 19:08:35 +08:00
factosea b83bb8c150 fix: last_row error 2024-01-18 17:20:31 +08:00
Haojun Liao 76e6c453e7 enh(stream): send msg to mnode when the transferring state completed. 2024-01-18 15:43:36 +08:00
Haojun Liao 719d1d1b90 refactor: do some internal refactor. 2024-01-18 14:34:18 +08:00
Haojun Liao f8d0c52483 fix(stream): remove this unused drop history task msg and corresponding functions. 2024-01-18 14:32:48 +08:00
wangmm0220 d5d1dd9127 opti:[TD-28118] raw block data for tmq 2024-01-17 20:08:26 +08:00
Haojun Liao d1dbd03341 fix(tsdb): fix invalid set. 2024-01-17 17:29:00 +08:00
Haojun Liao d44dc5bbb2 fix(tsdb): fix race condition. 2024-01-17 15:20:17 +08:00
Haojun Liao 56eac88349 Merge branch '3.0' into fix/3_liaohj 2024-01-17 15:14:52 +08:00
Haojun Liao 1ea671e373 enh(stream): remove time controller. 2024-01-17 14:55:15 +08:00
Haojun Liao fc16d26da2
Merge pull request #24488 from taosdata/fix/3_liaohj
fix(stream): fix some errors and do some internal refactor.
2024-01-17 14:25:32 +08:00
54liuyao 3bbfb26e09 stream count window 2024-01-17 14:22:19 +08:00
dapan1121 66c9c076e8
Merge pull request #24469 from taosdata/fix/xsren/TD-28204/whereOptimizeConditional
Fix/xsren/td 28204/where optimize conditional
2024-01-17 10:20:51 +08:00
Haojun Liao a56e589048
Merge pull request #24490 from taosdata/fix/TD-28338
fix:[TD-28338]empty varchar value return NULL in tmq
2024-01-17 10:09:40 +08:00
yihaoDeng 0d4cc6b8e2 fix:[TD-28338]empty varchar value return NULL in tmq 2024-01-16 18:46:37 +08:00
Haojun Liao 3d98fc6a67 other: merge 3.0 2024-01-16 18:29:33 +08:00
jiajingbin d59ede5196 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-28032 2024-01-16 15:05:13 +08:00
Haojun Liao 9a4b7a6d82 fix(stream): remove invalid lock, and fix a typo. 2024-01-16 14:52:27 +08:00
Haojun Liao 80793c94c2 fix(stream): reset the tasks status before start all tasks, and do some other internal refactor. 2024-01-16 14:32:45 +08:00
xinsheng Ren ae5f540692
Merge branch '3.0' into fix/xsren/TD-28204/whereOptimizeConditional 2024-01-16 14:28:37 +08:00
Haojun Liao dfe959eb28
Merge pull request #24468 from taosdata/fix/3_liaohj
fix(stream): fix deadlock in pause.
2024-01-16 12:58:27 +08:00
Haojun Liao 63494de7f9 refactor: do some internal refactor. 2024-01-16 10:28:07 +08:00
dapan1121 53094f62d8
Merge pull request #24359 from taosdata/FIX/TD-27003
Fix : use last row scan when select last_row, last
2024-01-16 08:50:23 +08:00
fullhonest fafb5b1f03 Fix TD-28018: last row num error where partition by null column 2024-01-15 18:29:41 +08:00
wangmm0220 2ab54a1335 fix:conflicts from 3.0 2024-01-15 16:54:52 +08:00
factosea 2c0dd3db03 fix: memory leak 2024-01-15 16:41:52 +08:00
Haojun Liao 43081b540b fix(stream): reset restart counter to be 0 if all tasks are ready. 2024-01-15 16:16:28 +08:00
fullhonest cb2ab749b5 Fix TD-27003: use last row scan when select last_row, last 2024-01-15 15:22:29 +08:00
Haojun Liao 143e6a13af fix(stream): fix deadlock in pause. 2024-01-15 14:37:24 +08:00
Haojun Liao e012bc4bde refactor: do some internal refactor. 2024-01-15 11:28:36 +08:00
Haojun Liao c710718f9e
Merge pull request #24457 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2024-01-15 10:58:45 +08:00
Haojun Liao 00e2bdec23 refactor: do some internal refactor. 2024-01-12 19:08:46 +08:00
wangmm0220 00e0da15a3 fix:[TD-28032]groupid = 0 & modify test case in sim 2024-01-12 17:37:22 +08:00
Haojun Liao ee24bb9b03
Merge pull request #24444 from taosdata/fix/3_liaohj
fix(stream): close the inputQ of the related stream task.
2024-01-12 13:41:30 +08:00
Haojun Liao cf941f7488 fix(stream): check status when resume to run. 2024-01-12 11:12:23 +08:00
Haojun Liao b36cc97236 fix(stream): close the inputQ of the related stream task when the fill-history task recv the trans-state msg from upstream. 2024-01-12 10:44:49 +08:00
Hongze Cheng 8399f5253f
Merge pull request #24439 from taosdata/fix/TD-28285-30
fix(tsdb/cache): clear fs state before next open
2024-01-12 10:38:43 +08:00
dapan1121 3b928237d7
Merge pull request #24419 from wangjiaming0909/draft/fix/TD-28182
fix: table merge scan return disordered rows
2024-01-12 10:16:21 +08:00
Haojun Liao ea0ea09b0f
Merge pull request #24409 from taosdata/opt/optMsgOnMnode
opt msg on mnd
2024-01-12 09:36:37 +08:00
Minglei Jin aa410a6deb fix(tsdb/cache): clear fs state before next open 2024-01-12 09:32:40 +08:00
wangjiaming0909 686108050b fix: table merge scan return disordered rows 2024-01-11 09:57:35 +08:00
Haojun Liao f6c0649108 fix(stream): fix syntax error. 2024-01-11 09:53:19 +08:00
Haojun Liao bff0ad89a4 other: merge 3.0 2024-01-11 09:51:12 +08:00
Haojun Liao 1c562bd535 refactor: enable the restart of stream tasks. 2024-01-11 09:41:40 +08:00
wangmm0220 216830f8b4 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 20:33:13 +08:00
wangmm0220 df69a89da2 fix:[TD-28185]add pause & resume logic for snode 2024-01-10 18:46:10 +08:00
Yihao Deng b5e5167b8f split sync/status channel 2024-01-10 09:57:08 +00:00
wangmm0220 02c7bdd4f0 fix:[TD-28032]fsdfasd 2024-01-10 14:57:16 +08:00
Haojun Liao b0202bb853 fix(tsdb): open reader during resume task for main reader after suspending reader. 2024-01-10 13:44:21 +08:00
Haojun Liao e8aea42498 fix(tsdb): open reader during resume task for main reader after suspending reader. 2024-01-10 13:42:36 +08:00
Haojun Liao 1b6d55616f fix(stream): fix syntax error. 2024-01-10 11:28:06 +08:00
Haojun Liao eac0d14868 fix(stream): add check when merging rows from files and buffer. 2024-01-10 11:02:44 +08:00
Haojun Liao 9d0d0d9ddc Merge branch '3.0' into fix/3_liaohj 2024-01-10 09:57:46 +08:00
Haojun Liao 2b3ad002f5
Merge pull request #24401 from taosdata/fix/TD-28142-3.0
opti:[TD-28142]memory size if block num is too large
2024-01-10 09:40:07 +08:00
Haojun Liao dc0c5539a0 fix(stream): remove invalid timer controllers. 2024-01-10 08:48:49 +08:00