Commit Graph

14781 Commits

Author SHA1 Message Date
Haojun Liao d5974a8f25 refactor(stream): refactor the pause/resume for fill history execution. 2023-07-28 18:05:32 +08:00
liuyao d712124921 init scan state 2023-07-28 17:25:56 +08:00
wangmm0220 ce7db7bf90 fix:subscribe time & return -1 if wal not exist 2023-07-28 15:07:15 +08:00
wangjiaming0909 6713882b48 fix: window fill ts range check with int64 overflow 2023-07-28 14:17:21 +08:00
dapan1121 9c7b53083b
Merge pull request #22223 from taosdata/fix/td-25378
fix: fix memleak during create initial sources for block merge sort
2023-07-28 13:09:34 +08:00
Haojun Liao 2a78cd2d23
Merge pull request #22215 from taosdata/fix/liaohj
other: merge main.
2023-07-28 13:06:17 +08:00
Haojun Liao 6459587ae7 other: fix merge error. 2023-07-28 10:59:34 +08:00
slzhou bcf4c1ebae fix: fix memleak during create initial sources for block merge sort 2023-07-28 09:54:56 +08:00
Haojun Liao 688884de08
Merge pull request #22220 from taosdata/fix/ly_stream_fill
fix stream fill issue
2023-07-28 09:27:21 +08:00
Haojun Liao ccc0f13649
Merge pull request #22214 from taosdata/fix/3_liaohj
fix(stream): scan wal in step2
2023-07-28 00:42:15 +08:00
Haojun Liao 22a5a18fff fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store. 2023-07-27 18:57:36 +08:00
liuyao f667a09cc6 fix stream fill issue 2023-07-27 18:56:25 +08:00
liuyao 5d21f50340 adjust history task trigger mode 2023-07-27 17:45:28 +08:00
Haojun Liao 6319cb8dd4 fix: fix syntax error. 2023-07-27 17:16:45 +08:00
Haojun Liao b145771a1b other: merge 3.0 2023-07-27 16:38:57 +08:00
Haojun Liao 3d403dca5a other: merge main. 2023-07-27 16:23:41 +08:00
Haojun Liao 3fdbd5383f Merge remote-tracking branch 'origin/fix/3_liaohj' into fix/3_liaohj 2023-07-27 16:11:07 +08:00
Haojun Liao 6ff50d4eaf fix(stream): update the step2 scan wal files. 2023-07-27 16:10:55 +08:00
liuyao 7c9898cfa5 adj stream scan 2023-07-27 15:56:06 +08:00
wade zhang cc3cc73cfc
Merge pull request #22199 from taosdata/fix/TS-3708
fix/TS-3708: check term for role time
2023-07-27 15:43:23 +08:00
liuyao c54bd55c68 op stream scan 2023-07-27 15:16:22 +08:00
liuyao c72274504e op stream scan 2023-07-27 15:13:57 +08:00
liuyao 0b53bdbae6 op stream scan 2023-07-27 15:09:25 +08:00
liuyao 0ac7ebe9c7 op stream scan 2023-07-27 14:56:06 +08:00
Haojun Liao 40fe3ef4f6 fix(stream): refactor the step2 wal scan. 2023-07-27 14:49:20 +08:00
Shungang Li 167ecea705 fix: check term for role time
1. time of mnode becomes current role in this term
2. show 0 for offline mnodes
2023-07-27 14:16:54 +08:00
Haojun Liao d9fe1a3107
Merge pull request #22209 from taosdata/fix/TD-25392
optimize session operator reload state
2023-07-27 14:10:46 +08:00
Haojun Liao e89f530db2 fix(stream): scan wal in step2 2023-07-27 10:55:59 +08:00
wade zhang 866f469bc1
Merge pull request #22203 from taosdata/FIX/TD-25382-3.0
fix: not to walEndSnapshot in syncNodeTimerRoutine
2023-07-27 10:15:55 +08:00
liuyao 1894608b80 optimize session operator reload state 2023-07-27 09:59:58 +08:00
Haojun Liao 05504023f5
Merge pull request #22200 from taosdata/fix/ly_stream_test
stream fill operator mem leak
2023-07-27 09:38:22 +08:00
Benguang Zhao f5fced5ab9 fix: not to walEndSnapshot in syncNodeTimerRoutine 2023-07-26 20:06:51 +08:00
liuyao c368db30c3 stream fill operator mem leak 2023-07-26 17:38:37 +08:00
Haojun Liao 7d9fa2b0d4 Merge branch '3.0' into fix/3_liaohj 2023-07-26 16:36:41 +08:00
Haojun Liao 432c943c25 fix(stream): do filter before the update check. 2023-07-26 16:34:39 +08:00
Haojun Liao 610f9d19c1
Merge pull request #22188 from taosdata/fix/3_liaohj
fix(stream): set the correct step2 scan time window range.
2023-07-26 16:34:10 +08:00
wade zhang 0666284547
Merge pull request #22183 from taosdata/fix/TS-3691
fix/TS-3691: monitor reports log summary
2023-07-26 16:21:18 +08:00
Haojun Liao df57768a3e Merge branch '3.0' into fix/3_liaohj 2023-07-26 14:45:11 +08:00
Haojun Liao cdffabcdad fix(stream): fix memory leak. 2023-07-26 14:37:04 +08:00
Shungang Li 0b167c94f3 fix: monitor reports log summary 2023-07-26 13:54:32 +08:00
liuyao 6d40cdb62e adj max combine fucntion 2023-07-26 09:52:07 +08:00
Haojun Liao 12986ff594 fix(stream): fix memory leaks. 2023-07-26 09:25:30 +08:00
Haojun Liao 4d6b9d4a15 fix(stream): split delete msg for real-time scan from wal. 2023-07-26 09:08:17 +08:00
Haojun Liao 063673726a fix(stream): fix syntax error 2023-07-25 18:08:22 +08:00
Haojun Liao 2cc4e0a727 fix(stream): fix syntax error 2023-07-25 17:56:40 +08:00
dapan1121 66042669a1
Merge pull request #22176 from taosdata/szhou/enhance-limit-proc
fix: choose heap sort for table merge scan with long row and limit
2023-07-25 17:48:11 +08:00
Haojun Liao 0bdccd2681 refactor: do some internal refactor. 2023-07-25 17:31:54 +08:00
slzhou f4c28d848b fix: table merge scan use heap sort when there is limit 2023-07-25 15:23:00 +08:00
Haojun Liao d29f835a63 fix(stream): set the correct step2 scan time window range. 2023-07-25 15:09:22 +08:00
dapan1121 768a84647c
Merge pull request #22177 from taosdata/enh/TS-3625
fix: fix error message
2023-07-25 13:28:19 +08:00
slzhou ca2ad71bb8 fix: return null when there are no input stream blocks for priority queue sort 2023-07-25 13:08:37 +08:00
wade zhang 7579144599
Merge pull request #22133 from taosdata/fix/TS-3691-main
fix/TS-3691: (main) monitor no longer reports logs
2023-07-25 10:28:38 +08:00
wade zhang f963c4332e
Merge pull request #22132 from taosdata/fix/TS-3691
fix/TS-3691: monitor no longer reports logs
2023-07-25 10:28:12 +08:00
Ganlin Zhao c9c7f99764 fix: fix error message 2023-07-25 09:49:23 +08:00
slzhou a205eba2ab fix: choose heap sort for table merge scan when row size is big and has limit 2023-07-25 09:48:08 +08:00
dapan1121 10f9c40dba
Merge pull request #22171 from taosdata/szhou/enhance-limit-proc
enhance: skip data blocks with the merge limit ts when create initial…
2023-07-25 08:42:35 +08:00
Haojun Liao 96722a07b1
Merge pull request #22174 from taosdata/fix/3_liaohj
fix(stream): fix the invalid check of step2 .
2023-07-25 00:30:06 +08:00
Haojun Liao a2694b9ce9 fix(stream): fix the invalid check of step2 . 2023-07-24 19:44:28 +08:00
Haojun Liao d36903bf08
Merge pull request #22162 from taosdata/fix/3_liaohj
fix(stream): add some logs, and remove the invalid loop.
2023-07-24 16:29:51 +08:00
wangmm0220 9628a9f74e fix:open info log in tmq & ignore wal apply ver when read wal 2023-07-24 15:53:02 +08:00
Shungang Li dc77e783a5 fix: monitor no longer reports logs 2023-07-24 15:17:36 +08:00
Shungang Li d78f28ce2e fix: monitor no longer reports logs 2023-07-24 15:16:48 +08:00
slzhou 1d24b96e82 enhance: skip data blocks with the merge limit ts when create initial source 2023-07-24 15:16:39 +08:00
Haojun Liao 9bae91bcba fix(stream): add some logs, and remove the invalid loop. 2023-07-24 13:37:44 +08:00
dapan1121 6fbf251978
Merge pull request #22138 from taosdata/enh/TS-3625
fix: fix(value, null) output behavior
2023-07-24 13:17:19 +08:00
Haojun Liao 13bab114cb
Merge pull request #22155 from taosdata/fix/3_liaohj
fix(stream): refactor the halt status to check more status.
2023-07-24 11:04:08 +08:00
Haojun Liao 1367552f38 fix(stream): refactor the halt status to check more status. 2023-07-24 10:04:15 +08:00
Haojun Liao 6a19ad3127
Merge pull request #22151 from taosdata/fix/3_liaohj
fix(stream): set the correct flag of pause/resume.
2023-07-24 09:07:49 +08:00
Haojun Liao 0b6e1a12bb refactor: do some internal refactor. 2023-07-23 19:09:43 +08:00
Haojun Liao e387b2f932 refactor: do some internal refactor. 2023-07-23 18:59:34 +08:00
Haojun Liao 4e0f7ffbf8 fix(stream): set the correct flag of pause/resume. 2023-07-23 18:49:56 +08:00
Haojun Liao 321be1f83f
Merge pull request #22135 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-07-22 15:06:28 +08:00
Haojun Liao 9679cc4527 fix(stream): fix race condition. 2023-07-22 10:19:51 +08:00
Haojun Liao f4864b8713 fix(stream): fix memory leak. 2023-07-22 01:02:58 +08:00
Haojun Liao bfc4a07207 fix(stream): fix memory leak. 2023-07-22 00:20:02 +08:00
Haojun Liao 1b2636028a fix(stream): fix memory leak. 2023-07-21 23:05:42 +08:00
Haojun Liao 16d7707b90 fix(stream): align the scan real time data for stream task. 2023-07-21 19:33:43 +08:00
wade zhang 7b1e809d98
Merge pull request #21794 from taosdata/enh/tsdb_optimize
for test purpose
2023-07-21 14:18:32 +08:00
liuyao 4451b2185a transform stream state 2023-07-21 10:32:53 +08:00
Ganlin Zhao 62b73db8bf fix: fix(value, null) output behavior 2023-07-21 10:19:41 +08:00
Ganlin Zhao 624b6b094f fix: fix(value, null) output behavior 2023-07-21 10:14:12 +08:00
Haojun Liao d0da988b7d Merge branch '3.0' into fix/3_liaohj 2023-07-21 09:47:44 +08:00
Haojun Liao 39ca9b537f fix(stream): fix syntax error 2023-07-21 09:43:08 +08:00
dapan1121 2ef01728ca
Merge pull request #22089 from wangjiaming0909/fix/3.0/TD-23763
feat: optimize partition by tbname slimit
2023-07-21 09:29:36 +08:00
dapan1121 d81727afa9
Merge pull request #22130 from taosdata/fix/TD-25270
enh: support show create table for system tables
2023-07-21 09:26:11 +08:00
Haojun Liao bd8b811b9d refactor: do some internal refactor. 2023-07-21 09:14:25 +08:00
Haojun Liao 0d1c4f9ee2 fix(stream): fix syntax error 2023-07-21 09:13:06 +08:00
Haojun Liao db46d31ca5 fix(stream): refactor the halt function. 2023-07-21 01:32:42 +08:00
Ganlin Zhao 076a425d53 fix: fix show create table issue for system tables 2023-07-20 17:21:24 +08:00
Haojun Liao c9fa170e65 refactor: do some internal refactor. 2023-07-20 16:31:46 +08:00
dapan1121 fde8eabfd7
Merge pull request #22111 from taosdata/szhou/tms-dev-2
enhance: table merge scan optimization
2023-07-20 16:28:29 +08:00
Haojun Liao 45cb478b31 refactor: do some internal refactor. 2023-07-20 15:36:46 +08:00
wangjiaming0909 7d850c1a5e feat: optimize partition by tbname slimit 2023-07-20 15:07:55 +08:00
slzhou 1a0031a43c enhance: uinfo to qdebug and increase pages num to 2048 2023-07-20 13:53:13 +08:00
slzhou 5d9f6fd481 fix: fix limit/offset bugs 2023-07-20 12:29:34 +08:00
Haojun Liao 87fa8f0c4c Merge branch '3.0' into fix/3_liaohj 2023-07-20 12:15:23 +08:00
Haojun Liao aed99da6c1 refactor: refactor the stream task starting order. 2023-07-20 12:14:53 +08:00
slzhou 30129f64da enhance: merge blocks of the same table before sort 2023-07-20 09:28:19 +08:00
liuyao 8a6ed67f9d fill history 2023-07-20 09:13:30 +08:00
liuyao ccc8142ab3 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2023-07-20 09:07:54 +08:00
wangmm0220 9378a0ef83 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-19 23:42:23 +08:00
Haojun Liao 97c44e7c18 refactor: do some internal refactor. 2023-07-19 18:42:02 +08:00
Haojun Liao c30c53c3d2
Merge pull request #22120 from taosdata/fix/TD-25268
remove redundant results
2023-07-19 18:33:33 +08:00
dapan1121 ec04a5eff7
Merge pull request #22121 from taosdata/fix/TD-25236-3.0a
fix: auth check for sys table when user is disabled
2023-07-19 18:03:50 +08:00
dapan1121 cbe03ef212
Merge pull request #22069 from taosdata/enh/TS-2288
enh: add scope for show xx variables
2023-07-19 18:01:11 +08:00
liuyao af18afba9d fill history 2023-07-19 17:19:55 +08:00
liuyao c7e4aa4f77 set win range 2023-07-19 15:51:22 +08:00
kailixu 8e06a75d24 fix: auth check for sys table when user is disabled 2023-07-19 15:28:59 +08:00
liuyao 8481725517 remove redundant results 2023-07-19 14:58:28 +08:00
slzhou d1a1976aa4 enhance: add limit to merge sort 2023-07-19 13:59:43 +08:00
Minglei Jin 4b96bc7147
Merge branch '3.0' into enh/tsdb_optimize 2023-07-19 11:15:57 +08:00
wade zhang c3e5375f15
Merge pull request #22085 from taosdata/FEAT/TS-2699-3.0
feat: distribute vnode primary dirs among disks of level 0
2023-07-19 09:44:43 +08:00
wangmm0220 5c344b0159 fix:conflicts from main 2023-07-19 09:05:05 +08:00
Haojun Liao 5c75883069
Merge pull request #22112 from taosdata/fix/3_liaohj
fix(stream): set downstream task ready state.
2023-07-18 22:02:18 +08:00
yihaoDeng de4efca56f update ip 2023-07-18 12:12:56 +00:00
Haojun Liao 40411fcd01 Merge branch '3.0' into fix/3_liaohj 2023-07-18 19:27:15 +08:00
Haojun Liao 9513f76172 fix(stream): set downstream task ready state. 2023-07-18 19:02:24 +08:00
liuyao caa4503352 reset state key memory 2023-07-18 18:02:39 +08:00
slzhou 4348b9c51d fix: use uinfo to show on stdout 2023-07-18 16:47:31 +08:00
slzhou f79fc81d9c fix: add to page buf in the same way as single source sort 2023-07-18 15:46:38 +08:00
Benguang Zhao 24fed51137 enh: tfsRename dir on primary disk at last 2023-07-18 13:58:43 +08:00
dapan1121 c2245a3546
Merge pull request #22100 from taosdata/fix/TD-25241
fix: fix interval in nested query filter not applied
2023-07-18 13:52:35 +08:00
Benguang Zhao 5624ecc8df fix: prepare vnode dir recursively in vnodeCreate 2023-07-18 11:32:23 +08:00
Benguang Zhao 6b6b7d8d8f enh: alloc disk of vnode primary dir in vmAllocPrimaryDisk 2023-07-18 11:32:23 +08:00
slzhou 97a6e89d11 enhance: refactor create initial sources 2023-07-18 10:38:40 +08:00
Ganlin Zhao 94b13df641 fix: fix interval in nested query filter not applied 2023-07-18 10:36:07 +08:00
kailixu 52c56f4bd7 chore: support non sma option () if supported 2023-07-17 22:40:22 +08:00
kailixu cf39fcdd12 fix: add sma option when show create table for stb/ntb 2023-07-17 22:24:27 +08:00
slzhou ba2b404295 enhance: optimize msortComparFn for table merge scan 2023-07-17 21:07:55 +08:00
wangmm0220 872222eb77 fix:[TD-25222] error in drop topic if topic num is too long 2023-07-17 19:52:07 +08:00
slzhou 1b9754f1bc enhance: add log with info level. change to debug later 2023-07-17 16:18:06 +08:00
Ganlin Zhao 929db3d647 Merge branch '3.0' into enh/TS-2288 2023-07-17 16:09:07 +08:00
slzhou 655233fd4f fix: create initial source with blocks 2023-07-17 15:05:30 +08:00
dapan1121 2822245a37
Merge pull request #22076 from wangjiaming0909/fix/m/TD-25199
fix: create sma index for us/ns database failed
2023-07-17 14:21:57 +08:00
dapan1121 bcadc8d85b
Merge pull request #22070 from wangjiaming0909/fix/m/TS-3671
fix: state/session/event window with order by _wstart/_wend has no effect
2023-07-17 10:06:16 +08:00
wangjiaming0909 ee7c8289aa fix: create sma index for us/ns database failed 2023-07-17 09:02:30 +08:00
shenglian zhou 9a0e9df567 enhance: block is ts sorted and each book is a source 2023-07-16 23:39:41 +08:00
slzhou f93af4d2e0 enhance: pass simple test 2023-07-16 20:28:54 +08:00
shenglian zhou 8b6d7db7ad enhance: use one tsdb reader to read table sequentially 2023-07-16 17:54:39 +08:00
wangmm0220 6762a01d88 Merge branch 'main' of https://github.com/taosdata/TDengine into mark/tmq 2023-07-14 16:44:00 +08:00
wangmm0220 bbdcbcb75b fix:modify commit version to next validate version 2023-07-14 16:43:28 +08:00
wangjiaming0909 b850c1af47 fix: state/session/event window with order by _wstart/_wend has no effect 2023-07-14 16:03:59 +08:00
Ganlin Zhao b402782784 add scope for information_schema.ins_dnode_variables 2023-07-14 15:56:29 +08:00
yihaoDeng 49b21b3ccb fix coverity scan problem 2023-07-14 14:53:11 +08:00
yihaoDeng 2279706357 fix coverity scan problem 2023-07-14 14:49:02 +08:00
yihaoDeng e16a3935a5 fix coverity scan problem 2023-07-14 14:40:32 +08:00
Ganlin Zhao cdb3453812 add show local variables scope 2023-07-14 14:38:35 +08:00
Ganlin Zhao 7935d824b6 enhance show variables output 2023-07-14 13:57:02 +08:00
Markus Mayer 55ee9d6c25
Correct some typos in string literals (#22062) 2023-07-14 13:39:03 +08:00
Hongze Cheng 1fad69df3b Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/tsdb_optimize 2023-07-14 10:13:15 +08:00