Commit Graph

5717 Commits

Author SHA1 Message Date
Minglei Jin f95867d255 cache/del: fix lru key length 2023-05-18 14:48:08 +08:00
Minglei Jin 3b316051bf cache/schema: fix schema double free 2023-05-18 13:51:07 +08:00
yihaoDeng 9380b22394 merge 3.0 2023-05-18 05:46:38 +00:00
Minglei Jin 0f8b7c87f7 cache/delete: fix rocks key length 2023-05-18 13:15:25 +08:00
Haojun Liao 5d5b2bb16a refactor: do some internal refactor. 2023-05-18 12:59:19 +08:00
Haojun Liao ce61b2ab00 fix: fix syntax error in tqRead 2023-05-18 11:35:45 +08:00
Haojun Liao 81f821a6fc refactor: do some internal refactor. 2023-05-18 10:51:43 +08:00
Haojun Liao b9bda9b30f fix(stream): set the correct start offset for resumed stream task. 2023-05-17 19:36:42 +08:00
Minglei Jin 765cc72618 cache/memtable: update cache when flag is on 2023-05-17 18:56:03 +08:00
Haojun Liao 73b1a4bddf fix(stream): fix syntax error. 2023-05-17 18:29:52 +08:00
Haojun Liao 92feb89a09 refactor: do some internal refactor. 2023-05-17 18:08:04 +08:00
Haojun Liao a4d9210b07 fix(tmq): add filter for taosX poll rsp. 2023-05-17 16:40:44 +08:00
Minglei Jin f428a68ec1 cache/update: update lru when deleting or updating 2023-05-17 16:08:48 +08:00
Haojun Liao 041ffa91bd other: merge main. 2023-05-17 15:42:15 +08:00
Minglei Jin b892b1fdfe cache/flag: fix cache flag compiling issue 2023-05-17 15:26:10 +08:00
Haojun Liao f55f8d245c fix(tmq): avoid the offset is revised by pool rsp which is issued before invoking tmq_offset_seek function. 2023-05-17 15:19:51 +08:00
Haojun Liao 366cd1871a
Merge pull request #21314 from taosdata/fix/liaohj_main
fix(stream):extract delete msg from wal.
2023-05-17 14:52:49 +08:00
Minglei Jin e95613ec10 cache/commit: update & commit cache if cache not off 2023-05-17 14:32:02 +08:00
Minglei Jin 86e3c1d20d cache/stt: remove ts from merge tree loading 2023-05-17 14:05:28 +08:00
Haojun Liao 3896e148fd log(tmq): add some logs. 2023-05-17 11:37:38 +08:00
dapan1121 fb7a06e06e
Merge pull request #21271 from taosdata/enh/tsbsPerf.4
Enh/tsbs perf.4
2023-05-17 11:00:14 +08:00
Haojun Liao f3f52c0232 fix(stream): add some logs and set the wal offset to be the ended version when finishing the step2 recover stage. 2023-05-17 10:43:23 +08:00
Haojun Liao d457b84aba
Merge pull request #21311 from taosdata/mark/tmq
fix:add lock to pHandle for safety
2023-05-17 09:11:39 +08:00
Minglei Jin 756fefaa29 cache/batchread: load columns in one trip 2023-05-16 18:56:05 +08:00
wangmm0220 90099ea1c0 fix:compile error in windows 2023-05-16 18:41:35 +08:00
wangmm0220 e6860cada8 fix:compile error in windows 2023-05-16 18:35:10 +08:00
wangmm0220 a52939127f fix:dead lock 2023-05-16 17:58:31 +08:00
wangmm0220 e6e0ac7603 fix:alwalys in exec if consumer Id mismatch & check result for wal seek ver 2023-05-16 14:01:38 +08:00
Haojun Liao e35d145734 fix(stream): fix memory leak. 2023-05-16 13:59:13 +08:00
Haojun Liao cbb02458ed fix(stream): fix the seek condition. 2023-05-16 11:19:11 +08:00
Haojun Liao 30e7cb5860 fix(tmq): avoid return delete msg for table subscription. 2023-05-16 10:42:02 +08:00
Haojun Liao 5e16db4e19 fix(stream):extract delete msg from wal. 2023-05-16 08:54:03 +08:00
wangmm0220 62520af2e5 fix:core dump 2023-05-16 00:32:21 +08:00
Haojun Liao d585f34ea9 fix(tmq): avoid seek to previous position. 2023-05-15 18:48:50 +08:00
wangmm0220 36454c73ed fix:add lock to pHandle for safety 2023-05-15 18:38:14 +08:00
Haojun Liao 04c8c933c8 fix(stream): add initial offset check. 2023-05-15 17:15:03 +08:00
Haojun Liao 17592ea294 refactor: do some internal refactor. 2023-05-15 13:49:26 +08:00
Haojun Liao 9feb0a86d6 fix(tmq): assert after the assignment of value. 2023-05-15 12:46:00 +08:00
Haojun Liao 6aa197123e refactor: do some internal refactor. 2023-05-15 11:29:23 +08:00
Haojun Liao 6f7add8870 refactor: do some internal refactor. 2023-05-15 10:48:03 +08:00
Haojun Liao 6cbedc5d4a refactor: do some internal refactor. 2023-05-15 10:45:01 +08:00
Haojun Liao ac287572ef fix: free table sink info 2023-05-15 00:03:53 +08:00
Haojun Liao 3d00f6ce54 refactor: do some internal refactor. 2023-05-14 22:08:17 +08:00
Haojun Liao 8e15c64499 refactor: do some internal refactor. 2023-05-13 23:22:36 +08:00
Haojun Liao 170c603995 other: merge 3.0 2023-05-13 20:16:55 +08:00
Haojun Liao 99148d6719 other: merge 3.0 2023-05-13 20:02:48 +08:00
Haojun Liao 236926b9ee other: merge enh/rocksdbstate 2023-05-13 19:49:28 +08:00
Haojun Liao 1975e94501 Merge branch 'main' into enh/rocksdbSstate 2023-05-13 19:41:03 +08:00
Haojun Liao 40ffe0cd83 fix(tmq): check handle status before close sub. 2023-05-13 16:45:21 +08:00
Haojun Liao b383651d8b fix(tmq): fix the invalid write and set the flag when closing taosx sub. 2023-05-13 16:17:26 +08:00
Haojun Liao 5b2ef2a675 other: merge main and remove invalid return data for poll. 2023-05-13 02:31:39 +08:00
dapan1121 3ca5559b37 fix: invalid read issue 2023-05-12 19:27:11 +08:00
dapan1121 1a52b3d519 fix: taosd crash issue 2023-05-12 18:13:16 +08:00
Haojun Liao 99422c87c3 fix(tq): set the offset to be the consume offset, instead of the committed offset. And update the table sim. 2023-05-12 16:14:56 +08:00
dapan1121 69795286fa Merge remote-tracking branch 'origin/main' into enh/tsbsPerf.4 2023-05-12 13:46:16 +08:00
dapan1121 0dd0b16842 enh: optimize table scan for last query 2023-05-12 13:30:17 +08:00
Haojun Liao 7ef16e1922 other: merge main. 2023-05-12 11:49:53 +08:00
wangmm0220 cd105381a9 fix:[TD-24111]avoid exec pHandle task in multi query thread 2023-05-12 11:41:59 +08:00
wangmm0220 d85f0f56d5 fix:[TD-24111]avoid exec pHandle task in multi query thread 2023-05-12 10:51:13 +08:00
Haojun Liao 26f94ecd60
Merge pull request #21260 from taosdata/feature/3_liaohj
fix(tmq): update the local offset when retrieving offset from vnode.
2023-05-11 23:12:33 +08:00
liuyao 8b7b804606 opt partition by tbname 2023-05-11 18:47:27 +08:00
Haojun Liao 26bea33ccc fix(tmq): add null check for print log. 2023-05-11 17:56:19 +08:00
Haojun Liao a76e47ef54 refactor: add some logs. 2023-05-11 14:19:27 +08:00
Haojun Liao f0f90888ab refactor: update some logs. 2023-05-11 13:48:50 +08:00
Haojun Liao 2b736ffd60 fix(stream): avoid duplicated task id in task id list. 2023-05-11 11:47:57 +08:00
Haojun Liao 8a1b0ed052 refactor: do some internal refactor. 2023-05-11 10:35:09 +08:00
Haojun Liao b02b3117b5 refactor: do some internal refactor. 2023-05-11 10:14:29 +08:00
Minglei Jin 81d4673153 cache/get: clear writebatch after writing 2023-05-10 17:52:26 +08:00
Minglei Jin 74c9a4b80b Merge branch '3.0' into fix/TS-3181 2023-05-10 17:42:46 +08:00
Minglei Jin 10cee51d32 fix(cache/get): move rocks wring out of column iterating 2023-05-10 17:32:51 +08:00
yihaoDeng 5708fcb5cb Merge branch 'enh/3.0' into enh/rocksdbSstateMerge 2023-05-10 08:02:16 +00:00
Minglei Jin 9bbf36d35d cache/serialize: keep original col value untouched 2023-05-10 14:39:51 +08:00
Minglei Jin 84987c494a cache/fs: fix primary ts column loading 2023-05-10 12:25:36 +08:00
Hui Li b1b85c3d95
Merge pull request #21227 from taosdata/fix/TD-24058
fix:[TD-24058]send poll result to client if no data 5 times to avoid …
2023-05-10 11:12:20 +08:00
Minglei Jin 0958fe5635 cache/binary: memcpy binary pData if pLastCol is from rocks lookup 2023-05-10 10:15:48 +08:00
Yihao Deng c6e5879f44
Merge branch 'main' into enh/rocksdbSstate 2023-05-10 10:04:28 +08:00
yihaoDeng 8356533eb1 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-09 12:13:16 +00:00
dapan1121 d0e26d2efc
Merge pull request #21216 from taosdata/fix/TS-3358
fix:after restarting taosd, stream does not work.
2023-05-09 19:01:43 +08:00
dapan1121 39adac8537
Merge pull request #21224 from taosdata/fix/TS-3376
fix: fix crash caused by tsdbReaderResume error not handled
2023-05-09 18:56:36 +08:00
wangmm0220 587f750c94 fix:[TD-24058]send poll result to client if no data 5 times to avoid lost data 2023-05-09 17:42:11 +08:00
liuyao 8224d49702 fix:after restarting taosd, stream does not work. 2023-05-09 17:24:11 +08:00
Ganlin Zhao 76dd5a962a fix: fix crash caused by tsdbReaderResume error not handled 2023-05-09 17:19:45 +08:00
dapan1121 52fd6a84ac enh: support db cfg cache update 2023-05-09 17:04:20 +08:00
yihaoDeng 55014aa003 Merge branch 'enh/rocksdbSstate' into enh/rocksdbSstateMerge 2023-05-09 08:58:51 +00:00
Minglei Jin 412fc9b0bc cache/memory: fix double free issue with tsim/parser/last_cache.sim 2023-05-09 11:09:53 +08:00
Minglei Jin 064c46bc7b cache/dclp: double check to load from tsdb 2023-05-09 09:17:26 +08:00
dapan1121 1f973123c4
Merge pull request #21177 from taosdata/fix/TD-23972
fix:[TD-23972] push subscribe msg to vnode even though consumer not c…
2023-05-08 20:29:31 +08:00
Minglei Jin 9b275f7421 cache/last_row cid: first round implementation for last_row with cid 2023-05-08 17:33:35 +08:00
Minglei Jin e0f0536d2d cache/serialize: nullize pData if zero-length 2023-05-08 15:56:54 +08:00
Minglei Jin 5349fac910 cache/last: use rowTs instead of lastRowTs 2023-05-08 11:33:01 +08:00
Minglei Jin 2eec395720 cache/commit: flush cache when tsdb commits data 2023-05-08 11:14:59 +08:00
Minglei Jin 198ce399d2 cache/get: store recalced column value back into rocks 2023-05-08 10:59:56 +08:00
Yihao Deng cb223acf82
Merge branch 'main' into enh/rocksdbSstate 2023-05-08 09:45:27 +08:00
yihaoDeng 08c3a63341 Merge branch 'enh/standVer' into enh/rocksdbSstateMerge 2023-05-06 12:37:54 +00:00
dapan1121 c83367e455 enh: add table group cache 2023-05-06 19:24:47 +08:00
Haojun Liao 9392c03b7f fix(stream): add some logs. 2023-05-06 19:05:55 +08:00
Haojun Liao c6007d53e8
Merge pull request #21190 from taosdata/fix/TS-3347
fix:[TS-3347]set ver to first version if version stored is smaller th…
2023-05-06 18:51:49 +08:00
Minglei Jin dca985214c cache/last: new api: merge last with cid 2023-05-06 18:44:15 +08:00
wangmm0220 279fe0803f fix:[TD-23972] push subscribe msg to vnode even though consumer not change 2023-05-06 18:35:24 +08:00
wangmm0220 ee32620808 fix:[TS-3347]set ver to first version if version stored is smaller than first version in wal when subscribe db 2023-05-06 16:22:30 +08:00