Commit Graph

6393 Commits

Author SHA1 Message Date
Minglei Jin 75ccd024a2 cache/writebatch: separate read & write batches 2023-05-22 18:06:58 +08:00
dapan1121 08ff4f4540 fix: crash issue 2023-05-22 17:06:01 +08:00
Hongze Cheng 8b83c85b0c more code 2023-05-22 16:28:31 +08:00
kailixu f18fc19d76 fix: tsdb read and tsma _wstart append 2023-05-22 16:13:50 +08:00
Hui Li 0f4fb1c31d
Merge pull request #21407 from taosdata/mark/tmq
fix:set task code success after kill
2023-05-22 16:10:18 +08:00
wangmm0220 ae515851c4 fix:remove get schema from previous for taosx 2023-05-22 15:32:30 +08:00
Minglei Jin 21adc23af4 cache/loading: skip partial loading tables 2023-05-22 15:21:19 +08:00
Hongze Cheng e731a08f2d Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-22 14:07:49 +08:00
wangmm0220 591b51f624 fix:set task code success after kill 2023-05-22 12:42:21 +08:00
Haojun Liao f520de0dab refactor: adjust the module dependency. 2023-05-22 10:07:01 +08:00
Hui Li 3f824e2045
Merge pull request #21355 from taosdata/mark/tmq
fix:error in pHandle lock
2023-05-22 08:57:45 +08:00
Haojun Liao 9423001fea
Merge pull request #21396 from taosdata/refact/fillhistory
Refact/fillhistory
2023-05-21 01:12:00 +08:00
Haojun Liao 899e4d3350 refactor: do some internal refactor. 2023-05-20 18:13:58 +08:00
Haojun Liao de44c9160c refactor: do some internal refactor. 2023-05-20 18:05:39 +08:00
wangmm0220 7b735c67d0 fix:move sleep logic from rpc thread to tmq thread & fix some error 2023-05-20 16:36:25 +08:00
wangmm0220 8183be4aff fix:move sleep logic from rpc thread to tmq thread & fix some error 2023-05-20 16:13:52 +08:00
wangmm0220 04858fae22 fix:tsdbreader is free by mistake 2023-05-20 12:20:54 +08:00
wangmm0220 1ddbdad33c fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 21:40:33 +08:00
wangmm0220 33d6df8717 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 19:11:49 +08:00
Haojun Liao e2ec8d738c other: add some logs. 2023-05-19 18:08:01 +08:00
wangmm0220 c7c255e967 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 18:06:05 +08:00
Hongze Cheng 545d7a6ad6 more code 2023-05-19 17:56:21 +08:00
Haojun Liao bcaa44e290
Merge pull request #21385 from taosdata/fix/liaohj_main
fix(query): add null check.
2023-05-19 17:55:02 +08:00
Hongze Cheng de1bdf97f9 more code 2023-05-19 17:20:53 +08:00
wangmm0220 ff2b545b27 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 17:16:47 +08:00
Minglei Jin a5c1b9a054 cache/commit: skip batch write if empty 2023-05-19 17:10:24 +08:00
Hongze Cheng b75aca7538 more code 2023-05-19 16:44:32 +08:00
Minglei Jin 962db65775 Merge branch '3.0' into fix/TD-23549 2023-05-19 16:19:57 +08:00
Haojun Liao be35194d16 fix(query): add null check. 2023-05-19 15:54:46 +08:00
Hongze Cheng 1c4abc62c3 more code 2023-05-19 15:16:01 +08:00
wangmm0220 f7ab8dabf0 fix:[TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-19 15:14:39 +08:00
wangmm0220 238254e49e fix:add task status check in doQueueScan & checkout consumer in tqProcessPollReq 2023-05-19 14:06:43 +08:00
Hongze Cheng e247870548 more code 2023-05-19 13:35:32 +08:00
Haojun Liao d8525123a2 enh(stream): add API to retrieve last ts for multi-tables. 2023-05-19 11:03:41 +08:00
Hongze Cheng 66ea10755e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-19 10:58:12 +08:00
Hongze Cheng 944d6a9c74 more code 2023-05-19 10:24:07 +08:00
wade zhang 208c9756cf
Merge pull request #21331 from taosdata/fix/TD-24097
enh(cache/batchread): load columns in one trip
2023-05-19 10:20:47 +08:00
dapan1121 e882601b67 fix: last table scan issue 2023-05-19 09:15:48 +08:00
wangmm0220 bca1af3f5d fix:change tmq subscribe try time to 60mins 2023-05-18 21:18:44 +08:00
Minglei Jin 35f74ce2e8 cache/schema: not cache schema 2023-05-18 18:35:06 +08:00
Haojun Liao c4c5bbb65c other: merge 3.0 2023-05-18 17:28:40 +08:00
Haojun Liao dbd52ecffa
Merge pull request #21364 from taosdata/enh/rocksdbSstate
state merge into 3.0
2023-05-18 17:25:44 +08:00
Hongze Cheng a622a1065a more code 2023-05-18 17:08:46 +08:00
liuyao da3fc5111e fix pause agg task 2023-05-18 15:29:41 +08:00
Hongze Cheng c7d1c88fbc more code 2023-05-18 15:06:21 +08:00
Minglei Jin f95867d255 cache/del: fix lru key length 2023-05-18 14:48:08 +08:00
Minglei Jin 3b316051bf cache/schema: fix schema double free 2023-05-18 13:51:07 +08:00
yihaoDeng 9380b22394 merge 3.0 2023-05-18 05:46:38 +00:00
Minglei Jin 0f8b7c87f7 cache/delete: fix rocks key length 2023-05-18 13:15:25 +08:00
Haojun Liao 5d5b2bb16a refactor: do some internal refactor. 2023-05-18 12:59:19 +08:00
Haojun Liao ce61b2ab00 fix: fix syntax error in tqRead 2023-05-18 11:35:45 +08:00
Haojun Liao 81f821a6fc refactor: do some internal refactor. 2023-05-18 10:51:43 +08:00
Hongze Cheng c8ba83cb31 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-18 10:38:50 +08:00
wangmm0220 54f4860139 fix:rollback [TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-17 19:44:56 +08:00
Haojun Liao b9bda9b30f fix(stream): set the correct start offset for resumed stream task. 2023-05-17 19:36:42 +08:00
wangmm0220 405cdfa7bc fix:error in pHandle lock 2023-05-17 19:02:16 +08:00
wangmm0220 1d9dd153ea fix:error in pHandle lock 2023-05-17 18:57:45 +08:00
Minglei Jin 765cc72618 cache/memtable: update cache when flag is on 2023-05-17 18:56:03 +08:00
Haojun Liao 73b1a4bddf fix(stream): fix syntax error. 2023-05-17 18:29:52 +08:00
Haojun Liao 92feb89a09 refactor: do some internal refactor. 2023-05-17 18:08:04 +08:00
Hongze Cheng d4ab729c10 more code 2023-05-17 17:14:11 +08:00
Hongze Cheng 4b5ea55d1a more code 2023-05-17 16:46:10 +08:00
Haojun Liao a4d9210b07 fix(tmq): add filter for taosX poll rsp. 2023-05-17 16:40:44 +08:00
Minglei Jin f428a68ec1 cache/update: update lru when deleting or updating 2023-05-17 16:08:48 +08:00
wangmm0220 4bb25c280f fix:add log 2023-05-17 15:54:36 +08:00
Haojun Liao 041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
Minglei Jin b892b1fdfe cache/flag: fix cache flag compiling issue 2023-05-17 15:26:10 +08:00
Haojun Liao f55f8d245c fix(tmq): avoid the offset is revised by pool rsp which is issued before invoking tmq_offset_seek function. 2023-05-17 15:19:51 +08:00
Hongze Cheng ccbc7c5ba0 more code 2023-05-17 15:18:08 +08:00
Haojun Liao 366cd1871a
Merge pull request #21314 from taosdata/fix/liaohj_main
fix(stream):extract delete msg from wal.
2023-05-17 14:52:49 +08:00
Minglei Jin e95613ec10 cache/commit: update & commit cache if cache not off 2023-05-17 14:32:02 +08:00
Minglei Jin 86e3c1d20d cache/stt: remove ts from merge tree loading 2023-05-17 14:05:28 +08:00
Haojun Liao 3896e148fd log(tmq): add some logs. 2023-05-17 11:37:38 +08:00
dapan1121 fb7a06e06e
Merge pull request #21271 from taosdata/enh/tsbsPerf.4
Enh/tsbs perf.4
2023-05-17 11:00:14 +08:00
Haojun Liao f3f52c0232 fix(stream): add some logs and set the wal offset to be the ended version when finishing the step2 recover stage. 2023-05-17 10:43:23 +08:00
Haojun Liao d457b84aba
Merge pull request #21311 from taosdata/mark/tmq
fix:add lock to pHandle for safety
2023-05-17 09:11:39 +08:00
Minglei Jin 756fefaa29 cache/batchread: load columns in one trip 2023-05-16 18:56:05 +08:00
wangmm0220 90099ea1c0 fix:compile error in windows 2023-05-16 18:41:35 +08:00
wangmm0220 e6860cada8 fix:compile error in windows 2023-05-16 18:35:10 +08:00
wangmm0220 a52939127f fix:dead lock 2023-05-16 17:58:31 +08:00
Hongze Cheng 0e466a97f0 more code 2023-05-16 15:48:17 +08:00
Hongze Cheng f39b8a0652 more code 2023-05-16 15:31:38 +08:00
Hongze Cheng ec7cb5f217 more code 2023-05-16 15:19:13 +08:00
kailixu 9faefb7498 Merge branch 'main' into enh/TD-22404-M 2023-05-16 15:17:42 +08:00
Hongze Cheng 0b17e3fe1c more code 2023-05-16 14:35:57 +08:00
wangmm0220 e6e0ac7603 fix:alwalys in exec if consumer Id mismatch & check result for wal seek ver 2023-05-16 14:01:38 +08:00
Haojun Liao e35d145734 fix(stream): fix memory leak. 2023-05-16 13:59:13 +08:00
Hongze Cheng d273d10ff0 more code 2023-05-16 11:39:53 +08:00
Haojun Liao cbb02458ed fix(stream): fix the seek condition. 2023-05-16 11:19:11 +08:00
Hongze Cheng 7cc7d35be4 more code 2023-05-16 11:09:15 +08:00
Haojun Liao 30e7cb5860 fix(tmq): avoid return delete msg for table subscription. 2023-05-16 10:42:02 +08:00
Hongze Cheng f40986408c more code 2023-05-16 10:34:02 +08:00
Hongze Cheng 96bfbbe784 refact more code 2023-05-16 10:07:46 +08:00
Hongze Cheng e783609ebd more code 2023-05-16 09:36:32 +08:00
Haojun Liao 5e16db4e19 fix(stream):extract delete msg from wal. 2023-05-16 08:54:03 +08:00
wangmm0220 62520af2e5 fix:core dump 2023-05-16 00:32:21 +08:00
Haojun Liao d585f34ea9 fix(tmq): avoid seek to previous position. 2023-05-15 18:48:50 +08:00
wangmm0220 36454c73ed fix:add lock to pHandle for safety 2023-05-15 18:38:14 +08:00
Hongze Cheng f8220e8b90 more code 2023-05-15 17:26:00 +08:00
Haojun Liao 04c8c933c8 fix(stream): add initial offset check. 2023-05-15 17:15:03 +08:00
Hongze Cheng 68f07c4bec more code 2023-05-15 17:14:45 +08:00
Hongze Cheng 23ad540035 more code 2023-05-15 15:56:13 +08:00
Hongze Cheng 066786e681 more code 2023-05-15 15:47:06 +08:00
Hongze Cheng c31b1034cd Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-15 14:26:40 +08:00
Haojun Liao 17592ea294 refactor: do some internal refactor. 2023-05-15 13:49:26 +08:00
Haojun Liao 9feb0a86d6 fix(tmq): assert after the assignment of value. 2023-05-15 12:46:00 +08:00
Hongze Cheng 33b8ff9bce more code 2023-05-15 11:39:00 +08:00
Haojun Liao 6aa197123e refactor: do some internal refactor. 2023-05-15 11:29:23 +08:00
Haojun Liao 6f7add8870 refactor: do some internal refactor. 2023-05-15 10:48:03 +08:00
Haojun Liao 6cbedc5d4a refactor: do some internal refactor. 2023-05-15 10:45:01 +08:00
Haojun Liao ac287572ef fix: free table sink info 2023-05-15 00:03:53 +08:00
Haojun Liao 3d00f6ce54 refactor: do some internal refactor. 2023-05-14 22:08:17 +08:00
Haojun Liao 8e15c64499 refactor: do some internal refactor. 2023-05-13 23:22:36 +08:00
Haojun Liao 170c603995 other: merge 3.0 2023-05-13 20:16:55 +08:00
Haojun Liao 99148d6719 other: merge 3.0 2023-05-13 20:02:48 +08:00
Haojun Liao 236926b9ee other: merge enh/rocksdbstate 2023-05-13 19:49:28 +08:00
Haojun Liao 1975e94501 Merge branch 'main' into enh/rocksdbSstate 2023-05-13 19:41:03 +08:00
Haojun Liao 40ffe0cd83 fix(tmq): check handle status before close sub. 2023-05-13 16:45:21 +08:00
Haojun Liao b383651d8b fix(tmq): fix the invalid write and set the flag when closing taosx sub. 2023-05-13 16:17:26 +08:00
Haojun Liao 5b2ef2a675 other: merge main and remove invalid return data for poll. 2023-05-13 02:31:39 +08:00
dapan1121 3ca5559b37 fix: invalid read issue 2023-05-12 19:27:11 +08:00
dapan1121 1a52b3d519 fix: taosd crash issue 2023-05-12 18:13:16 +08:00
Hongze Cheng e7ebb5c2db more code 2023-05-12 16:23:07 +08:00
Haojun Liao 99422c87c3 fix(tq): set the offset to be the consume offset, instead of the committed offset. And update the table sim. 2023-05-12 16:14:56 +08:00
kailixu a39ff5f3bc chore: more code 2023-05-12 14:26:15 +08:00
Hongze Cheng a15a1ab806 Merge branches 'enh/tsdb_optimize' and '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-12 14:14:45 +08:00
kailixu 0c9aa5bf3f merge main 2023-05-12 13:55:22 +08:00
kailixu 00f15c19aa merge main 2023-05-12 13:52:47 +08:00
dapan1121 69795286fa Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.4 2023-05-12 13:46:16 +08:00
dapan1121 0dd0b16842 enh: optimize table scan for last query 2023-05-12 13:30:17 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
wangmm0220 cd105381a9 fix:[TD-24111]avoid exec pHandle task in multi query thread 2023-05-12 11:41:59 +08:00
wangmm0220 d85f0f56d5 fix:[TD-24111]avoid exec pHandle task in multi query thread 2023-05-12 10:51:13 +08:00
Hongze Cheng a792bcad68 more code 2023-05-12 09:07:50 +08:00
Haojun Liao 26f94ecd60
Merge pull request #21260 from taosdata/feature/3_liaohj
fix(tmq): update the local offset when retrieving offset from vnode.
2023-05-11 23:12:33 +08:00
liuyao 8b7b804606 opt partition by tbname 2023-05-11 18:47:27 +08:00
Hongze Cheng 2a754394bf more code 2023-05-11 18:16:55 +08:00
Haojun Liao 26bea33ccc fix(tmq): add null check for print log. 2023-05-11 17:56:19 +08:00
Haojun Liao a76e47ef54 refactor: add some logs. 2023-05-11 14:19:27 +08:00
Haojun Liao f0f90888ab refactor: update some logs. 2023-05-11 13:48:50 +08:00
Haojun Liao 2b736ffd60 fix(stream): avoid duplicated task id in task id list. 2023-05-11 11:47:57 +08:00
Haojun Liao 8a1b0ed052 refactor: do some internal refactor. 2023-05-11 10:35:09 +08:00
Haojun Liao b02b3117b5 refactor: do some internal refactor. 2023-05-11 10:14:29 +08:00
Minglei Jin 7d23b176e5 meta/table: new api metaTrimTables for vnode split 2023-05-11 09:09:32 +08:00
Minglei Jin 81d4673153 cache/get: clear writebatch after writing 2023-05-10 17:52:26 +08:00
Minglei Jin 74c9a4b80b Merge branch '3.0' into fix/TS-3181 2023-05-10 17:42:46 +08:00
Minglei Jin 10cee51d32 fix(cache/get): move rocks wring out of column iterating 2023-05-10 17:32:51 +08:00
yihaoDeng 5708fcb5cb Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-10 08:02:16 +00:00
Hongze Cheng 3f4b4b5235 more code 2023-05-10 14:54:13 +08:00
Minglei Jin 9bbf36d35d cache/serialize: keep original col value untouched 2023-05-10 14:39:51 +08:00
Minglei Jin 84987c494a cache/fs: fix primary ts column loading 2023-05-10 12:25:36 +08:00
Hui Li b1b85c3d95
Merge pull request #21227 from taosdata/fix/TD-24058
fix:[TD-24058]send poll result to client if no data 5 times to avoid …
2023-05-10 11:12:20 +08:00
Minglei Jin 0958fe5635 cache/binary: memcpy binary pData if pLastCol is from rocks lookup 2023-05-10 10:15:48 +08:00
Yihao Deng c6e5879f44
Merge branch 'main' into enh/rocksdbSstate 2023-05-10 10:04:28 +08:00
yihaoDeng 8356533eb1 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-09 12:13:16 +00:00
dapan1121 d0e26d2efc
Merge pull request #21216 from taosdata/fix/TS-3358
fix:after restarting taosd, stream does not work.
2023-05-09 19:01:43 +08:00
dapan1121 39adac8537
Merge pull request #21224 from taosdata/fix/TS-3376
fix: fix crash caused by tsdbReaderResume error not handled
2023-05-09 18:56:36 +08:00
wangmm0220 587f750c94 fix:[TD-24058]send poll result to client if no data 5 times to avoid lost data 2023-05-09 17:42:11 +08:00
liuyao 8224d49702 fix:after restarting taosd, stream does not work. 2023-05-09 17:24:11 +08:00
Ganlin Zhao 76dd5a962a fix: fix crash caused by tsdbReaderResume error not handled 2023-05-09 17:19:45 +08:00
dapan1121 52fd6a84ac enh: support db cfg cache update 2023-05-09 17:04:20 +08:00
yihaoDeng 55014aa003 Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-05-09 08:58:51 +00:00
Hongze Cheng c748e4af25 more code 2023-05-09 16:46:23 +08:00
Hongze Cheng 61eb991eca more code 2023-05-09 16:24:18 +08:00
Hongze Cheng 023281ae32 more code 2023-05-09 14:50:37 +08:00
Hongze Cheng faadf5d3a2 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-09 13:32:16 +08:00
Minglei Jin 412fc9b0bc cache/memory: fix double free issue with tsim/parser/last_cache.sim 2023-05-09 11:09:53 +08:00
Minglei Jin 064c46bc7b cache/dclp: double check to load from tsdb 2023-05-09 09:17:26 +08:00
dapan1121 1f973123c4
Merge pull request #21177 from taosdata/fix/TD-23972
fix:[TD-23972] push subscribe msg to vnode even though consumer not c…
2023-05-08 20:29:31 +08:00
Hongze Cheng f45d10bb28 more code 2023-05-08 18:15:31 +08:00
Minglei Jin 9b275f7421 cache/last_row cid: first round implementation for last_row with cid 2023-05-08 17:33:35 +08:00
Hongze Cheng ebfd8b03a3 more code 2023-05-08 16:16:45 +08:00
Minglei Jin e0f0536d2d cache/serialize: nullize pData if zero-length 2023-05-08 15:56:54 +08:00
Hongze Cheng 198fe28967 more code 2023-05-08 13:20:15 +08:00
Minglei Jin 5349fac910 cache/last: use rowTs instead of lastRowTs 2023-05-08 11:33:01 +08:00
Minglei Jin 2eec395720 cache/commit: flush cache when tsdb commits data 2023-05-08 11:14:59 +08:00
Minglei Jin 198ce399d2 cache/get: store recalced column value back into rocks 2023-05-08 10:59:56 +08:00
Hongze Cheng 592c4393dd more code 2023-05-08 10:53:39 +08:00
Hongze Cheng c9dc9b3170 more code 2023-05-08 10:27:55 +08:00
Yihao Deng cb223acf82
Merge branch 'main' into enh/rocksdbSstate 2023-05-08 09:45:27 +08:00
yihaoDeng 08c3a63341 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-06 12:37:54 +00:00
dapan1121 c83367e455 enh: add table group cache 2023-05-06 19:24:47 +08:00
Haojun Liao 9392c03b7f fix(stream): add some logs. 2023-05-06 19:05:55 +08:00
Haojun Liao c6007d53e8
Merge pull request #21190 from taosdata/fix/TS-3347
fix:[TS-3347]set ver to first version if version stored is smaller th…
2023-05-06 18:51:49 +08:00
Minglei Jin dca985214c cache/last: new api: merge last with cid 2023-05-06 18:44:15 +08:00
wangmm0220 279fe0803f fix:[TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-06 18:35:24 +08:00
wangmm0220 ee32620808 fix:[TS-3347]set ver to first version if version stored is smaller than first version in wal when subscribe db 2023-05-06 16:22:30 +08:00
Minglei Jin 596bee8028 Merge branch '3.0' into fix/TD-23623 2023-05-06 16:07:26 +08:00
Haojun Liao f1a638c196 refactor: do some internal refactor. 2023-05-06 13:36:42 +08:00
Haojun Liao 6b305bf745 refactor: do some internal refactor. 2023-05-06 13:35:18 +08:00
Hongze Cheng 8f058c8571 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-06 13:22:49 +08:00
Haojun Liao 7dfa4c2105 fix(query): fix syntax error. 2023-05-06 13:13:28 +08:00
Haojun Liao da6212bab0 other: merge main. 2023-05-06 12:51:38 +08:00
wangmm0220 446097434e fix:[TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-06 11:06:41 +08:00
wangmm0220 55eddbfb5e fix:[TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-06 10:54:05 +08:00
Haojun Liao 1fa4327f6c Merge branch 'main' into fix/liaohj_main 2023-05-06 10:15:23 +08:00
Haojun Liao 29fcd1b83a refactor: do some internal refactor. 2023-05-06 10:08:05 +08:00
Haojun Liao 5d4a3116d5
Merge pull request #21139 from taosdata/fix/liaohj_main
refactor: do some internal refactor.
2023-05-06 09:49:26 +08:00
Haojun Liao 50ba55561b fix(stream): set correct group id and table id. 2023-05-05 22:11:59 +08:00
Haojun Liao 8958aabe4b fix(stream): opt task scan performance. 2023-05-05 19:33:30 +08:00
Haojun Liao 08ce790cda fix(query): fix memory leak. 2023-05-05 18:20:27 +08:00
Hongze Cheng 2fd7974113 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-05-05 15:39:29 +08:00
Haojun Liao 8b12d4d3da fix(stream): secure the delete task operation. TD-1198 2023-05-05 15:02:03 +08:00
Benguang Zhao c949fee06b enh: commit vnode after consolidating alter hash range 2023-05-05 13:48:04 +08:00
Haojun Liao 38cbe0b768 fix(query): fix the invalid copmarison. 2023-05-05 12:52:10 +08:00
Haojun Liao 42b23e6471 fix(query): stop tsdb reader asap. 2023-05-05 10:40:55 +08:00
Minglei Jin 992480eb00 cache/read: fix ltype calc 2023-05-05 10:22:59 +08:00
Haojun Liao 32b4642dac fix(tmq): fix invalid free. 2023-05-05 00:57:43 +08:00
Haojun Liao 25f451ba81 fix(tmq): fix result data block info. 2023-05-04 23:34:35 +08:00
Benguang Zhao 5d63f438b5 enh: confirm alter hash range 2023-05-04 19:43:11 +08:00
Minglei Jin 90be20a662 cache/lstring: use ltype with cache/get 2023-05-04 18:08:03 +08:00
Haojun Liao 1a8a834a2c fix(tmq): fix memory leak. 2023-05-04 17:03:53 +08:00
Haojun Liao 23c49594b7 other: merge main. 2023-05-04 16:41:53 +08:00
Haojun Liao 09a04052ec refactor: do some internal refactor. 2023-05-04 16:15:14 +08:00
Hongze Cheng 80511b334d more code 2023-05-04 13:28:16 +08:00
Haojun Liao 11dccf12de
Merge pull request #21131 from taosdata/fix/liaohj_main
refactor: do some internal refactor.
2023-05-04 11:26:00 +08:00
Haojun Liao 851193a033
Merge pull request #21060 from taosdata/fix/TS-3222
opti:change push mgr to consume msg for subscribe
2023-05-04 10:16:41 +08:00
liuyao d8a1f15d10 fix resum bug 2023-05-04 09:28:06 +08:00
kailixu 94d945a889 Merge branch 'main' into enh/TD-22404-M 2023-05-02 18:34:41 +08:00
Haojun Liao 3b814f2478 fix(stream): do some internal refactor. 2023-05-01 23:21:29 +08:00
Haojun Liao 3c61932ecc refactor: do some internal refactor. 2023-05-01 19:28:54 +08:00
Haojun Liao 563fca5c54 fix(tmq): remove unnecessary error log. 2023-05-01 14:47:01 +08:00
Haojun Liao 465c595c3a Merge branch 'main' into fix/liaohj_main 2023-04-30 18:19:35 +08:00
Haojun Liao 9cc4721e2a refactor: do some internal refactor. 2023-04-30 16:37:09 +08:00
Haojun Liao d8e0d02e6e refactor: do some internal refactor. 2023-04-30 16:32:51 +08:00
Haojun Liao 2fe494c2c7 fix(query):add more check. 2023-04-30 02:42:26 +08:00
Haojun Liao f645454f6c fix(query): add check. 2023-04-30 01:58:08 +08:00
Haojun Liao a88a4f5db0 fix(query): add more check for stopping tsdb reader 2023-04-30 01:03:13 +08:00
Haojun Liao ace193ca9b fix(stream): set the seek version if the reader's version is earlier than the first version in wal. 2023-04-29 23:34:49 +08:00
Haojun Liao 777ed1761f refactor: update logs. 2023-04-29 18:24:46 +08:00
Haojun Liao bbb8aaa0dc refactor: add some logs. 2023-04-29 02:37:10 +08:00
Haojun Liao 8b57184a9a
Merge pull request #21123 from taosdata/fix/liaohj_main
refactor: remove assert.
2023-04-29 00:44:24 +08:00
Haojun Liao b69137df44 refactor(log): add some logs. 2023-04-29 00:00:25 +08:00
Haojun Liao 05d416f3b9 fix(stream): fix invalid access when handling error, not start stream if tsDisablestream is set. 2023-04-28 23:53:53 +08:00
wangmm0220 3b66e63444 fix:[TD-23788] client wait if task status error in taosx transform data 2023-04-28 20:07:54 +08:00
Haojun Liao c647ded0da fix(stream): add some logs. 2023-04-28 19:47:49 +08:00
wangmm0220 8d84e8f8a5 fix:[TD-23788] client wait if task status error in taosx transform data 2023-04-28 19:29:17 +08:00
yihaoDeng dda1c8803c Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-04-28 09:17:22 +00:00
wangmm0220 18d05ff69f fix:memory leak 2023-04-28 15:53:56 +08:00
Haojun Liao ad059db91b
Merge pull request #21120 from taosdata/fix/liaohj_main
other: add some logs.
2023-04-28 14:12:04 +08:00
Haojun Liao b7c8346b44 other: merge other branch. 2023-04-28 13:06:47 +08:00
Haojun Liao f9a64cbcd6 other: add some logs. 2023-04-28 12:58:03 +08:00
Haojun Liao a0c2b34788
Merge pull request #21119 from taosdata/fix/liaohj_main
refactor: do some internal refactor.
2023-04-28 12:53:31 +08:00
Haojun Liao da0d9c78ef refactor: do some internal refactor. 2023-04-28 11:42:34 +08:00
liuyao 2984c5a758 merge main 2023-04-28 10:34:46 +08:00
wangmm0220 cce868d140 fix:offset encode assert error 2023-04-28 09:45:16 +08:00
wangmm0220 1ee1b0422c fix:change push mgr from SArray to Hash 2023-04-27 23:44:27 +08:00
yihaoDeng 36a4413bf1 merge rocksdb inst 2023-04-27 14:38:33 +00:00
wangmm0220 db5b5c828e fix:add log for msg push 2023-04-27 18:35:10 +08:00
Haojun Liao ad7c3218f7
Merge pull request #21111 from taosdata/fix/liaohj_main
enh(query): stop tsdb reader ASAP.  TD-23249
2023-04-27 17:45:38 +08:00
Haojun Liao 802c05150a enh(query): stop tsdb reader ASAP. 2023-04-27 16:18:28 +08:00
Haojun Liao e822dc2025 enh(query): add reader status. 2023-04-27 16:10:36 +08:00
Haojun Liao 7762e0ea47 refactor: do some internal refactor. 2023-04-27 16:10:06 +08:00
Haojun Liao 91f9b58f9a refactor: do some internal refactor. 2023-04-27 16:06:06 +08:00
wangmm0220 8677b56a4f fix:assert error in tqProcessSubmitReqForSubscribe if put pHandle to array twice 2023-04-27 15:44:44 +08:00
Haojun Liao b7040ed15e enh(stream): support resume from the latest data, and do some internal refactor. 2023-04-27 15:07:54 +08:00
Haojun Liao e1bd65ec0a
Merge pull request #21105 from taosdata/fix/liaohj_main
fix(query): check the init status for pReader->status.merger  TD-23903
2023-04-27 12:40:13 +08:00
Haojun Liao 3093726c5a fix(query): init row merger for tsdbread. 2023-04-27 11:49:00 +08:00
Haojun Liao fe3f3f478a fix(query): check the init status for pReader->status.merger 2023-04-27 10:15:52 +08:00
wangmm0220 6a889ae80e Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-27 09:48:04 +08:00
Haojun Liao db1d75bb48 refactor: do some internal refactor. 2023-04-27 09:28:20 +08:00
liuyao 863d30e5a9 opt tq read 2023-04-26 18:58:19 +08:00
wangmm0220 224d87b131 fix:cosume null if rebalance 2023-04-26 17:58:14 +08:00
Haojun Liao 9a35d4e950
Merge pull request #21087 from taosdata/fix/liaohj_main
refactor: do some internal refactor.
2023-04-26 17:57:37 +08:00
Minglei Jin a1fba2df65 Merge branch '3.0' into fix/TD-23623 2023-04-26 17:38:47 +08:00
Hongze Cheng 98384b1a4e more code 2023-04-26 17:17:32 +08:00
Haojun Liao ca4df761f1 fix(query): fix syntax error. 2023-04-26 17:14:54 +08:00
Haojun Liao 627429d490 fix(query): fix the comparion error. 2023-04-26 16:05:57 +08:00
Hongze Cheng e2df5f772e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-26 15:36:30 +08:00
Hongze Cheng a3877153bb more code 2023-04-26 15:35:16 +08:00
Haojun Liao 3e80f57fc7 refactor: do some internal refactor. 2023-04-26 12:09:05 +08:00
Haojun Liao 59725d1d87 refactor: do some internal refactor. 2023-04-26 12:02:43 +08:00
Haojun Liao 8d0a4772a5
Merge pull request #21070 from taosdata/fix/liaohj_main
enh(query): opt last row read performance. TD-23313
2023-04-26 11:54:48 +08:00
Hongze Cheng 37fb13fa9d more code 2023-04-26 11:16:49 +08:00
Hui Li 133327140f
Merge pull request #21078 from taosdata/fix/TS-3267
fix: more fix
2023-04-26 10:42:09 +08:00
Minglei Jin 6835e75903 cache/get: malloc zero-length binary to unify frees 2023-04-26 10:07:15 +08:00
Haojun Liao 8e2edd6ebf fix(query): fix null ptr access. 2023-04-26 10:00:00 +08:00
Minglei Jin 5758aa4d80 cache/read: fix pRow, pLastCols memory issues 2023-04-26 08:17:08 +08:00
Haojun Liao 2a45ef88b0 fix(query): fix memory leak. 2023-04-26 00:40:33 +08:00
Haojun Liao 7b7a483afc fix(query): add tmp variable to hold the TSDBROW value. 2023-04-25 18:43:48 +08:00
Minglei Jin c8cbabe419 cache/none column: move to outter scope 2023-04-25 18:13:33 +08:00
Hongze Cheng 49728a235e fix: more fix 2023-04-25 17:32:45 +08:00
54liuyao b79313ecd7 pause&resume 2023-04-25 16:59:09 +08:00
wangmm0220 4321012ac4 Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-25 16:24:28 +08:00
wangmm0220 d1e5d6e0f9 fix:pHandle->msg is not null if rebalance 2023-04-25 16:23:58 +08:00
slzhou aede1090ff fix: the latest schema may delete columns 2023-04-25 16:23:30 +08:00
Minglei Jin 2566bd4ae8 row/iter: fix null column iter 2023-04-25 16:17:58 +08:00
Haojun Liao 16fe48f770 fix(query): fix memory leak. 2023-04-25 16:09:58 +08:00
Haojun Liao bca5fc7893 fix(query): fix memory leak. 2023-04-25 15:28:54 +08:00
cadem 2fd9640a39 change learner config format 2023-04-25 15:15:28 +08:00
Haojun Liao 8dbc3b3457 refactor: do some internal refactor. 2023-04-25 15:07:37 +08:00
Haojun Liao 0b6e531dd3 refactor: do some internal refactor. 2023-04-25 14:56:20 +08:00
Haojun Liao 81e54541de refactor: do some internal refactor. 2023-04-25 14:24:24 +08:00
Haojun Liao 05d1692073 refactor: do some internal refactor. 2023-04-25 13:50:05 +08:00
Haojun Liao d8762b9bc9 refactor: do some internal refactor. 2023-04-25 10:48:21 +08:00
Haojun Liao 6467b99a52 refactor: do some internal refactor. 2023-04-25 10:23:21 +08:00
Haojun Liao 4c4e148635 refactor: do some internal refactor. 2023-04-25 10:19:37 +08:00
wangmm0220 41bec8560a opti:change push mgr to consume msg for subscribe 2023-04-25 09:58:28 +08:00
Haojun Liao e724bc15e0 refactor: do some internal refactor. 2023-04-25 09:54:00 +08:00
Hongze Cheng d57676c924 fix: delete table error 2023-04-25 09:52:16 +08:00
Minglei Jin 33fba6f99a cache/read: fix transferBuf index 2023-04-25 09:48:56 +08:00
Haojun Liao ae8a9d25c0 refactor: do some internal refactor. 2023-04-25 09:41:49 +08:00
Haojun Liao a73957aaba fix(query): fix error in add row into merger. 2023-04-25 09:24:15 +08:00
Haojun Liao 37d042a338 fix(query): fix error in add row into merger. 2023-04-25 00:33:24 +08:00
Haojun Liao 9a14e0db47 fix(query): fix error in add row into merger. 2023-04-25 00:30:43 +08:00
Haojun Liao c6daa68e54 enh(query): opt merge life cycle. 2023-04-25 00:17:37 +08:00
wangmm0220 8572f4a32f opti:change push mgr to consume msg for subscribe 2023-04-24 19:41:30 +08:00
Minglei Jin 4adc95f9db cache/deserialize: fix binary pData calc 2023-04-24 18:21:25 +08:00
Minglei Jin 3b88efbd5f cache/delete: fix null column values 2023-04-24 17:07:20 +08:00
Haojun Liao 7360a6b65c enh(query): opt hash. 2023-04-24 16:39:55 +08:00
Haojun Liao d73306f616 enh(query): opt last row read performance. 2023-04-24 16:08:49 +08:00
Haojun Liao 5663550de2 enh(query): opt query perf by allocate the SLDataIter when opening reader. 2023-04-24 15:47:02 +08:00
Minglei Jin c7d5b48920 cache/read: fix pRes buffer index 2023-04-24 15:42:53 +08:00
Xiaoyu Wang f5a974489e
Merge pull request #21045 from taosdata/fix/block-check-to-async-check
fix/block-check-to-async-check
2023-04-24 15:41:17 +08:00
Haojun Liao 48c36a8c35 Merge branch 'main' into enh/rocksdbSstate 2023-04-24 14:44:13 +08:00
Minglei Jin f8bf98f6dc Merge branch '3.0' into fix/TD-23623 2023-04-24 14:28:49 +08:00
Haojun Liao fa46165227 Merge branch 'main' into enh/rocksdbSstate 2023-04-24 12:59:24 +08:00
Haojun Liao 057cc2d30d
Merge pull request #21018 from taosdata/feature/3_liaohj
fix(stream): set the correct start offset for stream task.
2023-04-24 12:02:20 +08:00
Minglei Jin 8f21090343 cache/delete: just remove affected cache entries 2023-04-24 10:47:28 +08:00
cadem a781d43577 fix/block-check-to-async-check 2023-04-24 10:23:43 +08:00
wangmm0220 9bd74ec5b2 Merge branch 'fix/TS-3222' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-24 10:14:32 +08:00
Haojun Liao 134c0528ae Merge branch 'main' into fix/liaohj_main 2023-04-24 01:43:00 +08:00
wangmm0220 77e03bfd78 opti:change push mgr to consume msg for subscribe 2023-04-23 20:14:49 +08:00
Hongze Cheng 50319f2630 more code 2023-04-23 18:00:02 +08:00
Hongze Cheng 651ca6aca2 more code 2023-04-23 17:37:12 +08:00
liuyao 641c707b37 pause&resume 2023-04-23 17:37:10 +08:00
Hongze Cheng 59e543e18d more code 2023-04-23 16:31:11 +08:00
Hongze Cheng 81efe36d30 more code 2023-04-23 16:18:18 +08:00
Hongze Cheng 172eeee609 refact more code 2023-04-23 15:45:57 +08:00
Hongze Cheng eba557effe more code 2023-04-23 15:31:23 +08:00
wangmm0220 4bc319c6dd Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-23 15:15:33 +08:00
Xiaoyu Wang 35f02cdbad
Merge pull request #21013 from taosdata/FIX/TD-23768-main
fix: change tdbTbInsert to tdbTbUpsert for meta update in tdb
2023-04-23 15:15:17 +08:00
liuyao 5bd8fe5441 feat:add pause&resume 2023-04-23 15:09:01 +08:00
54liuyao 5089528a02 feat:stream pause&resume 2023-04-23 15:08:51 +08:00
kailixu df40699a50 Merge branch 'main' into enh/TD-22404-M 2023-04-23 15:01:31 +08:00
Hongze Cheng 7cf2911c23 more code 2023-04-23 14:57:49 +08:00
Hongze Cheng 85a36d625e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-23 14:03:59 +08:00
Hongze Cheng c336ec749a more code 2023-04-23 14:02:43 +08:00
Haojun Liao 6fc364db19 fix(query): add null ptr check. 2023-04-23 13:53:55 +08:00
Haojun Liao 9cf89c6b6f enh(tmq): add check for consumer Id; 2023-04-23 11:51:43 +08:00
Xiaoyu Wang 206887166c fix: vnode errcode setting error 2023-04-23 10:53:28 +08:00
yihaoDeng 917b07348c Merge branch 'fix/rocksdbState' into enh/rocksRevert 2023-04-23 02:37:26 +00:00
Haojun Liao 3dbe208712 enh(tmq): fix memory error and add retrieve wal info as required. 2023-04-22 15:34:46 +08:00
Benguang Zhao 3c53516299 fix: use tdbTbUpsert for metaUpdate functions 2023-04-21 19:24:09 +08:00
Minglei Jin 9918d326cc Merge branch '3.0' into fix/TD-23623 2023-04-21 18:39:07 +08:00
Minglei Jin a75d43a259 cache/read: remove unused extract function 2023-04-21 18:38:20 +08:00
Minglei Jin 12fc21ae84 cache/get: use pRow from reader 2023-04-21 18:34:58 +08:00
wangmm0220 6efbcfec4b Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TS-3222 2023-04-21 17:46:35 +08:00
Minglei Jin 09c62e6ca2 fix values_list index when freeing 2023-04-21 16:30:00 +08:00
Minglei Jin 8e87b21a59 rocks/multi_get value: free rocks allocated memory 2023-04-21 16:23:40 +08:00
chenhaoran 7d7a0769b3 Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.1 2023-04-21 16:20:37 +08:00
Minglei Jin 01d95b5e95 cache/read: use new interface with signle query 2023-04-21 16:07:22 +08:00
kailixu 6292fb766f Merge branch 'main' into enh/TD-22404-M 2023-04-21 16:04:11 +08:00
Minglei Jin 0394c6a50c free rocks errs array 2023-04-21 15:24:42 +08:00
Minglei Jin c9959b5bf6 dst slot for last_row 2023-04-21 14:18:04 +08:00
Haojun Liao b6f4cac619 fix(stream): set the correct offset version. 2023-04-21 13:35:24 +08:00
Hongze Cheng 2f91256a09 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-21 10:45:41 +08:00
Hongze Cheng bf8b9e744f more code 2023-04-21 10:45:27 +08:00
Haojun Liao 8fac91e265 refactor: do some internal refactor. 2023-04-21 09:38:51 +08:00
Haojun Liao 6c641cff39 fix(stream): fix error in start stream tasks. 2023-04-21 09:37:16 +08:00
Haojun Liao 471abd9160 log: update the log. 2023-04-20 23:39:13 +08:00
Haojun Liao 5e6c06e253 fix(stream): fix the race condition during create new stream tasks. 2023-04-20 23:21:18 +08:00
dm chen d594e4963f
Merge branch '3.0' into feat/learner 2023-04-20 19:11:06 +08:00
Haojun Liao 65fded4a28 fix(stream): set the correct number of tasks. 2023-04-20 19:03:43 +08:00
Haojun Liao f9801ba9c5 enh(stream): stop stream asap. 2023-04-20 18:58:07 +08:00
Haojun Liao 6f595fb5fd other: add some logs. 2023-04-20 18:50:44 +08:00
wangmm0220 5df7906a62 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/rocksRevert 2023-04-20 18:33:37 +08:00
Minglei Jin 7d896bbc85 last/empty_table: continue if table's empty 2023-04-20 17:36:46 +08:00
Haojun Liao c7e42d5422 other: do some internal refactor. 2023-04-20 17:30:02 +08:00
Haojun Liao 8323ad8670 enh(stream): add more check to stop stream asap. 2023-04-20 17:29:08 +08:00
Minglei Jin 1e51b2d781
Merge branch '3.0' into fix/TD-23623 2023-04-20 16:32:43 +08:00
Minglei Jin 642aa47887 last: first round implementation for column loading 2023-04-20 16:26:27 +08:00
Benguang Zhao 1b2fe38f75 enh: improve logging msg in metaSnapWrite 2023-04-20 16:22:16 +08:00
Haojun Liao b60b1796f7 fix(stream): add lock during check wal to create new stream task. 2023-04-20 15:53:41 +08:00
Benguang Zhao a21e0fe75e enh: propose vnode commit synchronously 2023-04-20 14:28:56 +08:00
Haojun Liao 742b5ee08c other: update wal logs level. 2023-04-20 13:42:16 +08:00
Haojun Liao c654f1145d enh(stream): add new msg for seek, and do some internal refactor. 2023-04-20 10:59:16 +08:00
cadem 8b16f4b118 config compitible 2023-04-19 18:02:04 +08:00
yihaoDeng 5402a6061f Merge branch 'dev' into enh/rocksRevert 2023-04-19 17:37:07 +08:00
cadem c22bd63ed4 vnode config compitible 2023-04-19 15:11:16 +08:00
Hongze Cheng b81f1c7be1 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-19 14:38:24 +08:00
Xiaoyu Wang 7cf9919ab0
Merge pull request #20964 from taosdata/enh/3.0_planner_optimize
feat: last queries with tags output can be read from cache
2023-04-19 14:34:32 +08:00
Haojun Liao 3f12156c53 enh(tmq): support seek in tmq. 2023-04-19 13:56:42 +08:00
Xiaoyu Wang 586b3945d1 feat: last queries with tags output can be read from cache 2023-04-19 13:09:11 +08:00
wangmm0220 594d68b8a4 fix:remove lock for consume handler 2023-04-19 11:46:59 +08:00
wangmm0220 14fd2e7904 fix:remove lock for consume handler 2023-04-19 11:44:52 +08:00
wangmm0220 1061eef144 fix:move consumer msg from fetch thread to query thread 2023-04-19 10:49:18 +08:00
wangmm0220 25542c26c7 fix:remove tmPushMsg in consumer 2023-04-19 10:43:13 +08:00
Minglei Jin 76edc16ce1 operator/cache-scan: pass col list down to tsdb cache 2023-04-19 10:04:48 +08:00
cadem 3b78d4382b add learner 2023-04-18 19:03:45 +08:00
kailixu b93c85fbf5 Merge branch 'main' into enh/TD-22404-M 2023-04-18 18:49:25 +08:00
Haojun Liao fb32ffd960 fix(stream): update the reference count value to be int32, insead of int8 2023-04-18 18:06:03 +08:00
dapan1121 2af63992ea
Merge pull request #20952 from taosdata/fix/TD-23639
fix: fix double free caused crash
2023-04-18 17:50:45 +08:00
Xiaoyu Wang 6669c3a5ad feat: last queries with tags output can be read from cache 2023-04-18 17:13:14 +08:00
Haojun Liao cc67b631f6 refactor: do some internal refactor. 2023-04-18 17:01:09 +08:00
Haojun Liao 9f16802451 fix(stream): set the initial value. 2023-04-18 16:42:40 +08:00
Ganlin Zhao e58bf86c33 fix local variable 2023-04-18 16:34:06 +08:00
Haojun Liao abfc2455e6 fix(stream): update the atomic variables. 2023-04-18 16:21:30 +08:00
Haojun Liao 7da998ecfb other: merge main. 2023-04-18 16:15:08 +08:00
Minglei Jin dee2ca3476 tsdb/cache: inplace_update are commented out 2023-04-18 16:09:42 +08:00
Haojun Liao 7a8dd0db45 refactor: update the log. 2023-04-18 16:08:51 +08:00
Minglei Jin dd42db0077 tsdb/mem table: remove unused codes 2023-04-18 15:09:13 +08:00
Minglei Jin e159c4ead9 first round rocks batch write implementation 2023-04-18 14:25:35 +08:00
Haojun Liao 76becf59b7
Merge pull request #20947 from taosdata/feature/3_liaohj
fix(stream): set the correct initial checkpoint versions.
2023-04-18 11:26:48 +08:00
Haojun Liao 97da34050b fix(query): fix invalid free. 2023-04-18 10:40:53 +08:00
Haojun Liao 7d3e5aa3d3 fix(query): set the table schema correctly when the table is dropped. 2023-04-18 09:03:30 +08:00
Haojun Liao 2ae05b8cf6 fix(stream): set the correct initial offset value. 2023-04-18 08:56:31 +08:00
liuyao 27d14f742d fix:stream memory leak 2023-04-17 17:27:02 +08:00
Ganlin Zhao d21628b2c9 fix: fix double free caused crash 2023-04-17 16:57:29 +08:00
kailixu 751a821e5d Merge branch 'main' into enh/TD-22404-M 2023-04-17 13:57:53 +08:00
kailixu fcb587b456 Merge branch 'main' into enh/TD-22404-M 2023-04-17 11:42:48 +08:00
Hongze Cheng a2bf1e2c7a Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-17 10:59:41 +08:00
Haojun Liao be90d2c511 fix(stream): disable stream task when no tasks exist. 2023-04-16 23:07:54 +08:00
Haojun Liao 1350af5267 fix(stream): set the correct initial checkpoint version to restore the operators state and add check for the initial destination tables. 2023-04-16 22:48:22 +08:00
Haojun Liao 04e042f21d Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-15 09:35:43 +08:00
Haojun Liao efb9ebe875
Merge pull request #20873 from taosdata/feature/3_liaohj
enh(stream): the stream will start after vnode restore being completed.
2023-04-15 09:34:34 +08:00
Hongze Cheng edf9fdbecc make it compile 2023-04-14 23:19:36 +08:00
Hongze Cheng bd1c8e1902 fix more code 2023-04-14 21:59:08 +08:00
Hongze Cheng 01bacc10ef fix: an important fix 2023-04-14 21:43:40 +08:00
Haojun Liao 1cd2268a99 Merge branch 'main' into feature/3_liaohj 2023-04-14 18:30:55 +08:00
Minglei Jin ec4ea9cf5d enh(cache/rocks): base for rocks put/get 2023-04-14 18:28:15 +08:00
Haojun Liao ab4b08a4b5 Merge branch 'feature/3_liaohj' into enh/rocksRevert 2023-04-14 17:44:50 +08:00
Haojun Liao e0cb8aa534 fix(stream): don't the initial task status and do some internal refactor. 2023-04-14 17:43:37 +08:00
dapan1121 423ec923ca enh: reuse tsdb cache reader 2023-04-14 14:30:20 +08:00
Hongze Cheng d1289d4c21 more code 2023-04-14 13:39:42 +08:00
Haojun Liao eb0e1f848a fix(stream): remove unused tqreader, do some internal refactor, set the meta value for streamtask. 2023-04-14 12:00:09 +08:00
Haojun Liao b57c813681 other: merge feature/3_liaohj 2023-04-14 10:36:54 +08:00
Xiaoyu Wang 96d2c5b9e3
Merge pull request #20927 from taosdata/FIX/TD-23552-main
enh: try to propose vnode commit at vnode closing
2023-04-14 09:14:10 +08:00
Haojun Liao f8b672f09f other: merge main. 2023-04-14 09:07:18 +08:00
Haojun Liao 4d83118ff7 fix(stream): fix memory leak. 2023-04-13 23:49:14 +08:00
Haojun Liao 70b45a4cf0 fix(stream): all data should be extracted from wal. 2023-04-13 23:22:09 +08:00
Benguang Zhao d8386754ee enh: try to propose vnode commit at vnode closing 2023-04-13 19:45:24 +08:00
Xiaoyu Wang 7e51190bc8
Merge pull request #20914 from taosdata/fix/TD-22941-1
fix(tsdb/read): release bi cache entry before returning
2023-04-13 19:24:06 +08:00
Hongze Cheng ac0bb0cf44 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-13 15:13:42 +08:00
Hongze Cheng e60672d019 more code 2023-04-13 15:13:27 +08:00
Minglei Jin ab372d501a fix(tsdb/read): release bi cache entry before returning 2023-04-13 14:33:37 +08:00
Xiaoyu Wang a44d455e56 merge 3.0 2023-04-13 14:32:05 +08:00
Xiaoyu Wang 3d962cd950
Merge pull request #20905 from taosdata/fix/TD-22941
fix(tsdb/cache): fix block index ref releasing
2023-04-13 13:37:20 +08:00
Minglei Jin 589ed9d0ce fix(tsdb/cache): fix block index ref releasing 2023-04-13 12:09:44 +08:00
Minglei Jin ef219095cf fix(tsdb/read): remove duplicat schema fetching 2023-04-13 10:06:49 +08:00
kailixu 85e11d8cbf Merge branch 'main' into enh/TD-22404-M 2023-04-12 18:30:43 +08:00
Hongze Cheng 58ed42b063 more code 2023-04-12 15:18:12 +08:00
Xiaoyu Wang 933660ae8d Merge remote-tracking branch 'origin/main' into fix/3.0_merge_main 2023-04-12 14:13:23 +08:00
Hongze Cheng 3f8f7bb451 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-12 11:28:30 +08:00
Hongze Cheng d24fed6ffa more code 2023-04-12 11:14:52 +08:00
Xiaoyu Wang 813591f993
Merge pull request #20872 from taosdata/fix/TD-23474
fix(tsdb/cache): skip schema updating for non ts row
2023-04-12 10:47:02 +08:00
Xiaoyu Wang 8b8ac0cd77 merge main 2023-04-12 10:43:28 +08:00
Haojun Liao f6315af0c9 other: merge main. 2023-04-11 19:41:17 +08:00
Haojun Liao 5ab54481f0 refactor: do some internal refactor. 2023-04-11 19:24:34 +08:00
Haojun Liao f083697dba refactor(tq): do some internal refactor. 2023-04-11 19:04:33 +08:00
Haojun Liao 24c9495772
Merge pull request #20857 from taosdata/fix/TS-3081
fix:optimize log & change the length of tag if tag is null in schemaless
2023-04-11 19:01:07 +08:00
yihaoDeng b24b91886a Merge branch 'dev3' into enh/rocksRevert 2023-04-11 10:59:00 +00:00
Minglei Jin 3ac5b35f4b fix(tsdb/cache): skip schema updating for non ts row 2023-04-11 18:57:11 +08:00
Hongze Cheng 8d7055b123 more code 2023-04-11 17:04:52 +08:00
Haojun Liao aae2758863 fix(stream): disable the deploy msg when restart taosd. 2023-04-11 16:58:51 +08:00
Xiaoyu Wang 4c04b155d5 merge main 2023-04-11 15:56:28 +08:00
Haojun Liao 18479d8115 refactor: do some internall refactor. 2023-04-11 15:42:24 +08:00
Hongze Cheng 1df5680e9e more code 2023-04-11 15:34:40 +08:00
Hongze Cheng 2f51c609f4 more code 2023-04-11 15:01:42 +08:00
Hongze Cheng a72633d715 more code 2023-04-11 14:22:36 +08:00
wangmm0220 c40c695ea7 fix:optimize log & change the length of tag if tag is null in schemaless 2023-04-11 13:49:18 +08:00
Haojun Liao 15cceb5a5a refactor: do some internal refactors. 2023-04-11 11:53:10 +08:00
Hongze Cheng 47b961018c more code 2023-04-11 11:00:35 +08:00
Haojun Liao a4ba5401f9 enh(stream): set the start version of all operators. 2023-04-11 10:01:36 +08:00
liuyao 524bb214e7 delete invalid code 2023-04-10 19:18:56 +08:00
Haojun Liao 497c9ea9c8 Merge branch 'main' into feature/3_liaohj 2023-04-10 17:57:26 +08:00
Hongze Cheng 6bc0d17605 more code 2023-04-10 17:52:51 +08:00
Haojun Liao 7419c0bfe9 enh(stream): the stream will start after vnode restore being completed. 2023-04-10 16:56:14 +08:00
Hongze Cheng a0039fe271 more code 2023-04-10 15:00:01 +08:00
Hongze Cheng 90a13bf451 more code 2023-04-10 14:50:50 +08:00
Hongze Cheng fe4dca9b1e more code 2023-04-10 14:09:39 +08:00
Xiaoyu Wang 4dff8950c2
Merge pull request #20812 from taosdata/fix/TS-3025
fix(tsdb/read): use the correct schema with multilevel merging
2023-04-10 10:30:37 +08:00
kailixu 7f6fdd4b6b Merge branch 'main' into enh/TD-22404-M 2023-04-09 13:26:56 +08:00
Haojun Liao f5b52749c2 refactor: do some internal refactor. 2023-04-09 01:39:09 +08:00
kailixu 3530ae0307 Merge branch 'main' into enh/TD-22404-M 2023-04-07 17:51:40 +08:00
Hongze Cheng f100a328b4 more code 2023-04-07 16:52:30 +08:00
Haojun Liao 5de76e4b72
Merge pull request #20809 from taosdata/fix/TD-23517
fix:[TD-23517] set offset type to wal if only meta & check if tag is …
2023-04-07 16:35:08 +08:00
Minglei Jin 8ae43fe6cb fix(tsdb/read): use the correct schema for mem/imem rows 2023-04-07 15:28:23 +08:00
Hongze Cheng afbaeb0d2d more code 2023-04-07 15:12:31 +08:00
Minglei Jin f262ac8230 fix(tsdb/read): use irow's schema instead of NULL 2023-04-07 14:37:56 +08:00
wangmm0220 05ec2b0928 fix:[TD-23517] set offset type to wal if only meta & check if tag is the same type in schemaless 2023-04-07 14:24:29 +08:00
Hongze Cheng d370d6a662 more code 2023-04-07 14:23:42 +08:00
Minglei Jin 1ff8511eb3 tsdb/row merger: comment init out 2023-04-07 13:43:07 +08:00
Minglei Jin 55f7e41f3b tsdb/row merger: remove tsdbRowMerge 2023-04-07 13:31:33 +08:00
Minglei Jin 360113115f fix(tsdb/row merger): remove unused code 2023-04-07 09:49:48 +08:00
Hongze Cheng 4e8e3854a7 more code 2023-04-06 16:26:41 +08:00
Hongze Cheng e8e0e4976e Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-06 15:51:20 +08:00
Hongze Cheng fd16a6b3b7 more code 2023-04-06 14:27:18 +08:00
Haojun Liao 871cfb4760
Merge pull request #20775 from taosdata/fix/TD-23450
fix:tq memory leak
2023-04-06 11:48:45 +08:00
Haojun Liao 2b2059ef18
Merge pull request #20534 from taosdata/fix/TD-22671
fix:error in TD-23218 & remove useless logic
2023-04-06 11:47:24 +08:00
yihaoDeng 5aff5aa93b add backpressure 2023-04-04 12:38:56 +00:00
54liuyao 519e2f1cfd fix:tq memory leak 2023-04-04 18:21:37 +08:00
yihaoDeng 628bb62c8a add backpressure 2023-04-04 07:20:05 +00:00
Haojun Liao c91d8a5901 Merge branch 'main' into feature/3_liaohj 2023-04-04 15:18:24 +08:00
Xiaoyu Wang e9d7a099cc merge main 2023-04-04 14:50:58 +08:00
Hongze Cheng 6e6100f254 more code 2023-04-04 14:38:17 +08:00
Xiaoyu Wang 0e53e578a7
Merge pull request #20748 from taosdata/fix/TD-23473
ehn(plan/optimizer): remove tbname fetching with cached groupby
2023-04-04 09:36:56 +08:00
dapan1121 ec3c706c3b
Merge pull request #20739 from taosdata/fix/TS-3063
fix(query): fix interp tsdbReader external range not setting properly
2023-04-04 09:23:47 +08:00
wangmm0220 d651ba02ae fix:lose consume data because of exec close if consume while insert data 2023-04-03 19:54:52 +08:00
Haojun Liao d48be5c0ce refactor: do some internal refactor. 2023-04-03 18:23:35 +08:00
Haojun Liao a3ac8b647c refactor: do some internal refactor. 2023-04-03 18:20:35 +08:00
Haojun Liao 482c319bee refactor: do some internal refactor. 2023-04-03 18:07:28 +08:00
Haojun Liao 3ef7d43dae refactor: do some internal refactor. 2023-04-03 17:47:48 +08:00
Ganlin Zhao aa6a4efd5b fix(query): fix interp tsdbReader external range not setting properly 2023-04-03 16:18:16 +08:00
Hongze Cheng 2bab385071 more code 2023-04-03 16:15:21 +08:00
Hongze Cheng 7e48fc3ca5 Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-04-03 15:25:04 +08:00
Hongze Cheng ffb655bae6 more code 2023-04-03 13:59:37 +08:00
wangmm0220 2d6436c57d fix:modify log & sleep 500ms if data is inserting while consume 2023-04-03 11:24:22 +08:00
wangmm0220 858144145f fix:memory leak 2023-04-02 23:39:59 +08:00
wangmm0220 b029c8f157 fix:remove useless setmsg 2023-04-02 22:34:51 +08:00
wangmm0220 afcc3d2064 opti:code for tmq 2023-03-31 19:02:38 +08:00
wangmm0220 97b5c7abee fix:merge from main 2023-03-31 16:20:21 +08:00
Hongze Cheng 171d360cac
Revert "current from binary to json" 2023-03-31 15:25:00 +08:00
Hongze Cheng 552ea09690 more code 2023-03-30 17:43:54 +08:00
Hongze Cheng 88907b1996 more code 2023-03-30 17:05:58 +08:00
Hongze Cheng 8afa2c5354 more code 2023-03-30 16:06:07 +08:00
dapan1121 15578cf980
Merge branch 'main' into fix/cencVer 2023-03-30 15:36:30 +08:00
kailixu 9552ac2800 enh: coverity scan for sma 2023-03-30 15:11:35 +08:00
Haojun Liao 5f4cb41e28 fix(tmq): set correct start offset value. 2023-03-29 23:45:41 +08:00
Haojun Liao c8ad465a0d refactor: do some internal refactor. 2023-03-29 19:40:34 +08:00
Haojun Liao 56c98d7768 refactor: do some internal refactor. 2023-03-29 19:35:04 +08:00
kailixu 9ee43c271d enh: coverity scan for sma 2023-03-29 18:38:35 +08:00
wangmm0220 2243184a4d fix:conflicts 2023-03-29 17:53:05 +08:00
Hongze Cheng 0404810252 more code 2023-03-29 17:34:36 +08:00
dapan1121 6a1150301e fix: column rows size 2023-03-29 17:30:20 +08:00
wangmm0220 9d9ae749d1 opti:tmq logic & fix CI cases 2023-03-29 17:27:04 +08:00
Haojun Liao 25245b9005 Merge branch 'main' into feature/3_liaohj 2023-03-29 16:40:12 +08:00
Haojun Liao 152fc5daab fix(stream):fix the race condition when creating new tsables. 2023-03-29 16:36:35 +08:00
kailixu fabd96deef enh: coverity scan for sma 2023-03-29 15:56:44 +08:00
dapan1121 a90354cd92 fix: restore debug code 2023-03-29 15:56:08 +08:00
dapan1121 9952be43f6 Merge remote-tracking branch 'origin/main' into fix/cencVer 2023-03-29 15:50:14 +08:00
dapan1121 4f06728c17 fix: restore sl level 2023-03-29 15:48:11 +08:00
dapan1121 84eef542d5 fix: memory rows count issue 2023-03-29 15:45:18 +08:00
Xiaoyu Wang b9d905c2d3
Merge pull request #20686 from taosdata/fix/liaohj
fix(tsdb/read): use correct scheme for mem & imem merging
2023-03-29 15:38:21 +08:00
Minglei Jin 91c16f0344 tsdb/read: remove dup mem schema fetching 2023-03-29 15:34:55 +08:00
Minglei Jin 7eb8a63944 Merge branch 'fix/liaohj' of https://github.com/taosdata/TDengine into fix/liaohj 2023-03-29 14:21:05 +08:00
Minglei Jin 8cf8ac84d7 fix(tsdb/read): use correct scheme for mem & imem merging 2023-03-29 14:19:15 +08:00
Hongze Cheng d2185b7e68 more code 2023-03-29 13:27:36 +08:00
dapan1121 2714ce2af8 fix: rows count issue 2023-03-29 13:22:12 +08:00
kailixu eb301a1d61 enh: coverage for sma 2023-03-29 12:16:12 +08:00
dapan1121 0659814d16
Merge pull request #20674 from taosdata/fix/TS-3010
fix: query schema is old issue
2023-03-29 11:41:07 +08:00
Xiaoyu Wang eaf56916fe
Merge pull request #20678 from taosdata/FIX/TD-22975-main
enh: separate sync read and write
2023-03-29 11:09:31 +08:00
dapan1121 0327a8eaa3 fix: block rows number type 2023-03-29 10:46:56 +08:00
Haojun Liao 7a050d64bd fix(query): set ptr to be NULL. 2023-03-29 10:27:05 +08:00
dapan1121 702202d4af fix: fix block scan issue 2023-03-29 10:14:53 +08:00
Haojun Liao f1ff5dcec4 fix(query): use hashmap to keep the multiple schema. 2023-03-28 22:53:57 +08:00
dapan1121 a0c8dd52b1 fix: memory count issue 2023-03-28 19:42:09 +08:00
dapan1121 c5f37d284e fix: memory row count issue 2023-03-28 19:27:49 +08:00
dapan1121 e0f951e668 fix: memory rows issue 2023-03-28 19:15:38 +08:00
wangmm0220 d0c55ef572 fix:conflicts 2023-03-28 18:12:13 +08:00
Benguang Zhao ae8d87643f Merge branch 'main' into FIX/TD-22975-main 2023-03-28 18:00:51 +08:00
dapan1121 def8c9044e Merge remote-tracking branch 'origin/enh/TS-2967' into fix/cencVer 2023-03-28 17:47:41 +08:00
dapan1121 a87d35be08 fix: optimize performance 2023-03-28 17:40:46 +08:00
Hongze Cheng 8233a5bc31 more code 2023-03-28 16:43:22 +08:00
Haojun Liao 0ae2034ebb fix: fix syntax error. 2023-03-28 16:05:05 +08:00
Haojun Liao 7342aeb750 fix(tmq): fix the syntax error. 2023-03-28 15:42:53 +08:00
Hongze Cheng dc10b0196e more code 2023-03-28 15:38:55 +08:00
dapan1121 22ad3129b9 fix: query schema is old issue 2023-03-28 15:21:47 +08:00
Haojun Liao a883e57cf2 Merge branch 'main' into fix/liaohj 2023-03-28 15:07:32 +08:00
Haojun Liao 68f310dd48 refactor: do some internal refactor. 2023-03-28 15:05:10 +08:00
Haojun Liao 4fd3064fd9 refactor: do some internal refactor. 2023-03-28 14:43:37 +08:00
Haojun Liao ac9773b5df
Merge pull request #20670 from taosdata/fix/liaohj
refactor: do some internal refactor.
2023-03-28 14:32:10 +08:00
Haojun Liao c36c5253c5 refactor: do some internal refactor. 2023-03-28 13:31:40 +08:00
Haojun Liao fca79dbc53 Merge branch 'fix/liaohj' into main 2023-03-28 11:20:01 +08:00
Haojun Liao c158087d66 fix(tmq): kill the ongoing tsdb scans while transferring the ownership of vnode to other consumers. 2023-03-28 09:53:49 +08:00
Haojun Liao 5c128e2292 refactor: do some internal refactor. 2023-03-28 09:27:48 +08:00
dapan1121 61571d9296 enh: optimize count performance 2023-03-27 19:40:29 +08:00
Hongze Cheng 23e78dd908 more code 2023-03-27 19:12:25 +08:00
Xiaoyu Wang 77f27bb9df
Merge pull request #20613 from taosdata/FIX/TD-23308-main
enh: disable timely vnodeCommit
2023-03-27 17:58:20 +08:00
Hongze Cheng 8f84e88616 more code 2023-03-27 17:07:59 +08:00
Hongze Cheng 7b82bd5ebb Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-03-27 16:30:40 +08:00
Hongze Cheng 978c73fb48 more code 2023-03-27 16:30:22 +08:00
kailixu 11bf7511e5 Merge branch 'main' into enh/TD-22404-M 2023-03-27 11:16:11 +08:00
Hongze Cheng 69a2f7129c more code 2023-03-27 09:42:08 +08:00
wangmm0220 f1d67b6059 fix:conflict 2023-03-25 19:03:23 +08:00
wangmm0220 750cd8c5a4 fix:ci error 2023-03-25 16:33:47 +08:00
dapan1121 8a89550f16 fix: skiplist level 2023-03-25 13:10:14 +08:00
wangmm0220 9f5e435140 fix:conflict from main 2023-03-25 11:49:37 +08:00
dapan1121 dd12e41227
Merge pull request #20618 from taosdata/fix/TS-2974
fix: change float display mode
2023-03-25 09:19:04 +08:00
dapan1121 481091bae6 fix: sma load issue 2023-03-24 19:01:19 +08:00
Hongze Cheng 0a13fc497d more code 2023-03-24 18:07:16 +08:00
Hongze Cheng 052d9c6e4b more code 2023-03-24 17:57:37 +08:00
dapan1121 8bf49fdbd2 fix: skiplist level 2023-03-24 17:16:06 +08:00
Haojun Liao b22cc82270 others: merge main. 2023-03-24 15:43:13 +08:00
Haojun Liao 8f6ac6d771 fix(tmq): wait for 2mins when subscribe topics. 2023-03-24 15:36:42 +08:00
dapan1121 4167e4c00c fix: some columns sma are not set issue 2023-03-24 15:20:27 +08:00
wangmm0220 57331cd71d Merge branch 'main' of https://github.com/taosdata/TDengine into fix/TD023101 2023-03-24 14:51:11 +08:00
wangmm0220 5d06474f2e fix:send data batch if consume wal where subscribe db 2023-03-24 14:43:29 +08:00
Hongze Cheng 873c9705fe more code 2023-03-24 14:24:34 +08:00
wangmm0220 1a2513d212 Merge branch 'fix/TD023101' of https://github.com/taosdata/TDengine into fix/TD023101 2023-03-24 10:12:12 +08:00
wangmm0220 bf78f63e22 fix:send data batch if consume wal where subscribe db 2023-03-24 10:10:52 +08:00
cadem 86ca5ce210 fix/trigger election by sync msg 2023-03-24 09:13:20 +08:00
Benguang Zhao 9be09492f0 enh: disable timely vnodeCommit 2023-03-24 09:05:06 +08:00
Xiaoyu Wang bddba107be
Merge pull request #20608 from taosdata/fix/TS-2960
fix(tdb/restore): rollback journal files backward
2023-03-23 19:47:31 +08:00
Hongze Cheng 62231ef14c more code 2023-03-23 18:40:44 +08:00
Hongze Cheng 8fa2f08711 more code 2023-03-23 17:15:51 +08:00
Hongze Cheng d596f3be4a Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-03-23 16:29:03 +08:00
Hongze Cheng 5173d85c8c more code 2023-03-23 16:28:13 +08:00
dapan1121 7f50b463bb
Merge pull request #20599 from taosdata/fix/mainT3.0
fix: merge main to 3.0
2023-03-23 16:17:01 +08:00
Hongze Cheng 7bc38466bf more code 2023-03-23 16:10:08 +08:00