Commit Graph

6251 Commits

Author SHA1 Message Date
Minglei Jin 8ee1288611 fix(cache): remove deleted data 2023-05-25 17:47:55 +08:00
Haojun Liao 0966213847 fix(arch): set the correct module api dependency. 2023-05-25 14:21:40 +08:00
Haojun Liao da9f33a483 fix: fix error in set function ptr. 2023-05-25 09:56:34 +08:00
wade zhang 511ff7130b
Merge pull request #21445 from taosdata/fix/TD-24373
fix(cache/read): associate tbname with primary ts column
2023-05-25 08:01:51 +08:00
Haojun Liao 4a42f6b983 fix: fix error in api call. 2023-05-25 00:50:03 +08:00
Haojun Liao a9b18d203d fix:fix error. 2023-05-24 23:49:26 +08:00
Haojun Liao ab907e3344 fix(query): fix syntax error. 2023-05-24 21:53:40 +08:00
Hongze Cheng 4d526ed0cd change more 2023-05-24 18:59:09 +08:00
Minglei Jin fc5d06681e cache/last_row: treat none as null with last_row 2023-05-24 18:55:51 +08:00
wangmm0220 8537e4e80e feat:add tag filter for stable subscribe 2023-05-24 18:26:55 +08:00
Haojun Liao fe09705855 fix: set the init function pointer. 2023-05-24 17:13:20 +08:00
Ganlin Zhao 89bea7100f fix: fix count var type error 2023-05-24 00:31:05 -07:00
dapan1121 cbbbaca553
Merge pull request #21437 from taosdata/fix/TD-23955-3.0
fix: delete index filter for desc query
2023-05-24 14:05:07 +08:00
Haojun Liao b2ce45b07b refactor: do some internal refactor. 2023-05-24 13:39:20 +08:00
Haojun Liao a2f29aa0f5 refactor: do some internal refactor. 2023-05-24 13:34:46 +08:00
Haojun Liao 1f7f326bed refactor: do some internal refactor and set the api function ptr. 2023-05-24 13:22:05 +08:00
kailixu ef899a0cc3 fix: delete index filter for desc query 2023-05-24 11:28:45 +08:00
Minglei Jin 26bfa4363d fix(cache/read): associate tbname with primary ts column 2023-05-24 11:01:47 +08:00
Hongze Cheng d6d0bf0e41 enh: add varchar sma 2023-05-24 10:47:26 +08:00
liuyao 180abf2229 set agg task status 2023-05-24 09:34:40 +08:00
liuyao b5d01f9bab set agg pause status 2023-05-24 09:19:28 +08:00
Haojun Liao 39a1fa8f78 refactor: do some internal refactor. 2023-05-23 19:20:25 +08:00
Haojun Liao 66477a28ca refactor: do some internal refactor. 2023-05-23 19:10:50 +08:00
Haojun Liao 3d084adf1f Merge remote-tracking branch 'origin/refact/fillhistory' into refact/fillhistory
# Conflicts:
#	source/dnode/vnode/inc/vnode.h
#	source/libs/executor/src/executil.c
#	source/libs/index/CMakeLists.txt
#	source/libs/index/src/indexFilter.c
2023-05-23 18:32:47 +08:00
Haojun Liao e67b532d8a refactor: refactor the module dependency. 2023-05-23 18:29:23 +08:00
kailixu 82b8c3c3d1 fix: delete index filter for desc query 2023-05-23 18:21:21 +08:00
kailixu 18e83173c8 fix: delete index filter for desc query 2023-05-23 17:21:45 +08:00
wade zhang 68a98d4d09
Merge pull request #21429 from taosdata/fix/TD-24306
fix(cache): sychronize commit, read and write threads with writebatch
2023-05-23 16:20:59 +08:00
Minglei Jin 6d620a7d7c fix(cache/read): set none to null instead of skipping column 2023-05-23 14:51:26 +08:00
Minglei Jin 81048f93b0 fix(cache): sychronize commit, read and write threads with writebatch 2023-05-23 13:44:33 +08:00
yihaoDeng c15b1e3520 opt compile 2023-05-23 11:46:02 +08:00
wangmm0220 ed612088c0 fix:lost data because tsdbreader or task is killed 2023-05-23 10:32:13 +08:00
kailixu a171c0c860 Merge branch '3.0' into fix/TD-21457-3.0 2023-05-23 09:27:31 +08:00
wade zhang 9e73a69316
Merge pull request #21389 from taosdata/fix/TD-24306
fix(cache/commit): skip batch write if empty
2023-05-23 08:22:33 +08:00
kailixu a3bf49d22f chore: revert 2023-05-22 20:35:52 +08:00
kailixu c75aa54a3d fix: tsdb read and append _wstart for tsma 2023-05-22 20:33:29 +08:00
wangmm0220 d8387b95ff fix:set task status to 0 in inti 2023-05-22 20:14:43 +08:00
Haojun Liao f3491310a9
Merge pull request #21411 from taosdata/fix/TD-24144
fix:remove get schema from previous for taosx
2023-05-22 18:37:20 +08:00
Minglei Jin 75ccd024a2 cache/writebatch: separate read & write batches 2023-05-22 18:06:58 +08:00
dapan1121 08ff4f4540 fix: crash issue 2023-05-22 17:06:01 +08:00
kailixu f18fc19d76 fix: tsdb read and tsma _wstart append 2023-05-22 16:13:50 +08:00
Hui Li 0f4fb1c31d
Merge pull request #21407 from taosdata/mark/tmq
fix:set task code success after kill
2023-05-22 16:10:18 +08:00
wangmm0220 ae515851c4 fix:remove get schema from previous for taosx 2023-05-22 15:32:30 +08:00
Minglei Jin 21adc23af4 cache/loading: skip partial loading tables 2023-05-22 15:21:19 +08:00
wangmm0220 591b51f624 fix:set task code success after kill 2023-05-22 12:42:21 +08:00
Haojun Liao f520de0dab refactor: adjust the module dependency. 2023-05-22 10:07:01 +08:00
Hui Li 3f824e2045
Merge pull request #21355 from taosdata/mark/tmq
fix:error in pHandle lock
2023-05-22 08:57:45 +08:00
Haojun Liao 9423001fea
Merge pull request #21396 from taosdata/refact/fillhistory
Refact/fillhistory
2023-05-21 01:12:00 +08:00
Haojun Liao 899e4d3350 refactor: do some internal refactor. 2023-05-20 18:13:58 +08:00
Haojun Liao de44c9160c refactor: do some internal refactor. 2023-05-20 18:05:39 +08:00
wangmm0220 7b735c67d0 fix:move sleep logic from rpc thread to tmq thread & fix some error 2023-05-20 16:36:25 +08:00
wangmm0220 8183be4aff fix:move sleep logic from rpc thread to tmq thread & fix some error 2023-05-20 16:13:52 +08:00
wangmm0220 04858fae22 fix:tsdbreader is free by mistake 2023-05-20 12:20:54 +08:00
wangmm0220 1ddbdad33c fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 21:40:33 +08:00
wangmm0220 33d6df8717 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 19:11:49 +08:00
Haojun Liao e2ec8d738c other: add some logs. 2023-05-19 18:08:01 +08:00
wangmm0220 c7c255e967 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 18:06:05 +08:00
Haojun Liao bcaa44e290
Merge pull request #21385 from taosdata/fix/liaohj_main
fix(query): add null check.
2023-05-19 17:55:02 +08:00
wangmm0220 ff2b545b27 fix:set task status killed when vnode receive subscribe msg from mnode 2023-05-19 17:16:47 +08:00
Minglei Jin a5c1b9a054 cache/commit: skip batch write if empty 2023-05-19 17:10:24 +08:00
Haojun Liao be35194d16 fix(query): add null check. 2023-05-19 15:54:46 +08:00
wangmm0220 f7ab8dabf0 fix:[TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-19 15:14:39 +08:00
wangmm0220 238254e49e fix:add task status check in doQueueScan & checkout consumer in tqProcessPollReq 2023-05-19 14:06:43 +08:00
Haojun Liao d8525123a2 enh(stream): add API to retrieve last ts for multi-tables. 2023-05-19 11:03:41 +08:00
wade zhang 208c9756cf
Merge pull request #21331 from taosdata/fix/TD-24097
enh(cache/batchread): load columns in one trip
2023-05-19 10:20:47 +08:00
dapan1121 e882601b67 fix: last table scan issue 2023-05-19 09:15:48 +08:00
wangmm0220 bca1af3f5d fix:change tmq subscribe try time to 60mins 2023-05-18 21:18:44 +08:00
Minglei Jin 35f74ce2e8 cache/schema: not cache schema 2023-05-18 18:35:06 +08:00
Haojun Liao c4c5bbb65c other: merge 3.0 2023-05-18 17:28:40 +08:00
Haojun Liao dbd52ecffa
Merge pull request #21364 from taosdata/enh/rocksdbSstate
state merge into 3.0
2023-05-18 17:25:44 +08:00
liuyao da3fc5111e fix pause agg task 2023-05-18 15:29:41 +08:00
Minglei Jin f95867d255 cache/del: fix lru key length 2023-05-18 14:48:08 +08:00
Minglei Jin 3b316051bf cache/schema: fix schema double free 2023-05-18 13:51:07 +08:00
yihaoDeng 9380b22394 merge 3.0 2023-05-18 05:46:38 +00:00
Minglei Jin 0f8b7c87f7 cache/delete: fix rocks key length 2023-05-18 13:15:25 +08:00
Haojun Liao 5d5b2bb16a refactor: do some internal refactor. 2023-05-18 12:59:19 +08:00
Haojun Liao ce61b2ab00 fix: fix syntax error in tqRead 2023-05-18 11:35:45 +08:00
Haojun Liao c3491dae16 refactor: do some interal refactor. 2023-05-18 10:56:40 +08:00
Haojun Liao 81f821a6fc refactor: do some internal refactor. 2023-05-18 10:51:43 +08:00
wangmm0220 54f4860139 fix:rollback [TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-17 19:44:56 +08:00
Haojun Liao b9bda9b30f fix(stream): set the correct start offset for resumed stream task. 2023-05-17 19:36:42 +08:00
wangmm0220 405cdfa7bc fix:error in pHandle lock 2023-05-17 19:02:16 +08:00
wangmm0220 1d9dd153ea fix:error in pHandle lock 2023-05-17 18:57:45 +08:00
Minglei Jin 765cc72618 cache/memtable: update cache when flag is on 2023-05-17 18:56:03 +08:00
Haojun Liao 73b1a4bddf fix(stream): fix syntax error. 2023-05-17 18:29:52 +08:00
Haojun Liao 92feb89a09 refactor: do some internal refactor. 2023-05-17 18:08:04 +08:00
Haojun Liao a4d9210b07 fix(tmq): add filter for taosX poll rsp. 2023-05-17 16:40:44 +08:00
Minglei Jin f428a68ec1 cache/update: update lru when deleting or updating 2023-05-17 16:08:48 +08:00
wangmm0220 4bb25c280f fix:add log 2023-05-17 15:54:36 +08:00
Haojun Liao 041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
Minglei Jin b892b1fdfe cache/flag: fix cache flag compiling issue 2023-05-17 15:26:10 +08:00
Haojun Liao f55f8d245c fix(tmq): avoid the offset is revised by pool rsp which is issued before invoking tmq_offset_seek function. 2023-05-17 15:19:51 +08:00
Haojun Liao 366cd1871a
Merge pull request #21314 from taosdata/fix/liaohj_main
fix(stream):extract delete msg from wal.
2023-05-17 14:52:49 +08:00
Minglei Jin e95613ec10 cache/commit: update & commit cache if cache not off 2023-05-17 14:32:02 +08:00
Minglei Jin 86e3c1d20d cache/stt: remove ts from merge tree loading 2023-05-17 14:05:28 +08:00
Haojun Liao 3896e148fd log(tmq): add some logs. 2023-05-17 11:37:38 +08:00
dapan1121 fb7a06e06e
Merge pull request #21271 from taosdata/enh/tsbsPerf.4
Enh/tsbs perf.4
2023-05-17 11:00:14 +08:00
Haojun Liao f3f52c0232 fix(stream): add some logs and set the wal offset to be the ended version when finishing the step2 recover stage. 2023-05-17 10:43:23 +08:00
Haojun Liao d457b84aba
Merge pull request #21311 from taosdata/mark/tmq
fix:add lock to pHandle for safety
2023-05-17 09:11:39 +08:00
Minglei Jin 756fefaa29 cache/batchread: load columns in one trip 2023-05-16 18:56:05 +08:00
wangmm0220 90099ea1c0 fix:compile error in windows 2023-05-16 18:41:35 +08:00
wangmm0220 e6860cada8 fix:compile error in windows 2023-05-16 18:35:10 +08:00
wangmm0220 a52939127f fix:dead lock 2023-05-16 17:58:31 +08:00
wangmm0220 e6e0ac7603 fix:alwalys in exec if consumer Id mismatch & check result for wal seek ver 2023-05-16 14:01:38 +08:00
Haojun Liao e35d145734 fix(stream): fix memory leak. 2023-05-16 13:59:13 +08:00
Haojun Liao cbb02458ed fix(stream): fix the seek condition. 2023-05-16 11:19:11 +08:00
Haojun Liao 30e7cb5860 fix(tmq): avoid return delete msg for table subscription. 2023-05-16 10:42:02 +08:00
Haojun Liao 5e16db4e19 fix(stream):extract delete msg from wal. 2023-05-16 08:54:03 +08:00
wangmm0220 62520af2e5 fix:core dump 2023-05-16 00:32:21 +08:00
Haojun Liao d585f34ea9 fix(tmq): avoid seek to previous position. 2023-05-15 18:48:50 +08:00
wangmm0220 36454c73ed fix:add lock to pHandle for safety 2023-05-15 18:38:14 +08:00
Haojun Liao 04c8c933c8 fix(stream): add initial offset check. 2023-05-15 17:15:03 +08:00
Haojun Liao 17592ea294 refactor: do some internal refactor. 2023-05-15 13:49:26 +08:00
Haojun Liao 9feb0a86d6 fix(tmq): assert after the assignment of value. 2023-05-15 12:46:00 +08:00
Haojun Liao 6aa197123e refactor: do some internal refactor. 2023-05-15 11:29:23 +08:00
Haojun Liao 6f7add8870 refactor: do some internal refactor. 2023-05-15 10:48:03 +08:00
Haojun Liao 6cbedc5d4a refactor: do some internal refactor. 2023-05-15 10:45:01 +08:00
Haojun Liao ac287572ef fix: free table sink info 2023-05-15 00:03:53 +08:00
Haojun Liao 3d00f6ce54 refactor: do some internal refactor. 2023-05-14 22:08:17 +08:00
Haojun Liao 8e15c64499 refactor: do some internal refactor. 2023-05-13 23:22:36 +08:00
Haojun Liao 170c603995 other: merge 3.0 2023-05-13 20:16:55 +08:00
Haojun Liao 99148d6719 other: merge 3.0 2023-05-13 20:02:48 +08:00
Haojun Liao 236926b9ee other: merge enh/rocksdbstate 2023-05-13 19:49:28 +08:00
Haojun Liao 1975e94501 Merge branch 'main' into enh/rocksdbSstate 2023-05-13 19:41:03 +08:00
Haojun Liao 40ffe0cd83 fix(tmq): check handle status before close sub. 2023-05-13 16:45:21 +08:00
Haojun Liao b383651d8b fix(tmq): fix the invalid write and set the flag when closing taosx sub. 2023-05-13 16:17:26 +08:00
Haojun Liao 5b2ef2a675 other: merge main and remove invalid return data for poll. 2023-05-13 02:31:39 +08:00
dapan1121 3ca5559b37 fix: invalid read issue 2023-05-12 19:27:11 +08:00
dapan1121 1a52b3d519 fix: taosd crash issue 2023-05-12 18:13:16 +08:00
Haojun Liao 99422c87c3 fix(tq): set the offset to be the consume offset, instead of the committed offset. And update the table sim. 2023-05-12 16:14:56 +08:00
dapan1121 69795286fa Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.4 2023-05-12 13:46:16 +08:00
dapan1121 0dd0b16842 enh: optimize table scan for last query 2023-05-12 13:30:17 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
wangmm0220 cd105381a9 fix:[TD-24111]avoid exec pHandle task in multi query thread 2023-05-12 11:41:59 +08:00
wangmm0220 d85f0f56d5 fix:[TD-24111]avoid exec pHandle task in multi query thread 2023-05-12 10:51:13 +08:00
Haojun Liao 26f94ecd60
Merge pull request #21260 from taosdata/feature/3_liaohj
fix(tmq): update the local offset when retrieving offset from vnode.
2023-05-11 23:12:33 +08:00
liuyao 8b7b804606 opt partition by tbname 2023-05-11 18:47:27 +08:00
Haojun Liao 26bea33ccc fix(tmq): add null check for print log. 2023-05-11 17:56:19 +08:00
Haojun Liao a76e47ef54 refactor: add some logs. 2023-05-11 14:19:27 +08:00
Haojun Liao f0f90888ab refactor: update some logs. 2023-05-11 13:48:50 +08:00
Haojun Liao 2b736ffd60 fix(stream): avoid duplicated task id in task id list. 2023-05-11 11:47:57 +08:00
Haojun Liao 8a1b0ed052 refactor: do some internal refactor. 2023-05-11 10:35:09 +08:00
Haojun Liao b02b3117b5 refactor: do some internal refactor. 2023-05-11 10:14:29 +08:00
Minglei Jin 81d4673153 cache/get: clear writebatch after writing 2023-05-10 17:52:26 +08:00
Minglei Jin 74c9a4b80b Merge branch '3.0' into fix/TS-3181 2023-05-10 17:42:46 +08:00
Minglei Jin 10cee51d32 fix(cache/get): move rocks wring out of column iterating 2023-05-10 17:32:51 +08:00
yihaoDeng 5708fcb5cb Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-10 08:02:16 +00:00
Minglei Jin 9bbf36d35d cache/serialize: keep original col value untouched 2023-05-10 14:39:51 +08:00
Minglei Jin 84987c494a cache/fs: fix primary ts column loading 2023-05-10 12:25:36 +08:00
Hui Li b1b85c3d95
Merge pull request #21227 from taosdata/fix/TD-24058
fix:[TD-24058]send poll result to client if no data 5 times to avoid …
2023-05-10 11:12:20 +08:00