Commit Graph

9977 Commits

Author SHA1 Message Date
Haojun Liao e4940e82c5 fix(query): update last_row callback function. 2022-10-18 17:54:29 +08:00
Ganlin Zhao 0f5e02b0b4 fix(query): mode function output one random result instead of NULL
if there're multiple highest frequency of occurrence.

TD-19619
2022-10-18 17:52:40 +08:00
Shengliang Guan 3cbfd2d160
Merge pull request #17392 from taosdata/FIX/TD-19183-3.0
enh: not allowed to start on disk space unavailable
2022-10-18 17:46:14 +08:00
Haojun Liao 60e7f2800b fix(query): fix bug in cached last query. 2022-10-18 17:39:28 +08:00
dapan1121 fe5b898ee5
Merge pull request #17430 from taosdata/fix/TD-19609
fix: fix case when crash issue
2022-10-18 17:37:37 +08:00
Shengliang Guan 3a7d89a6bb refact: remove bnode codes 2022-10-18 17:34:58 +08:00
Alex Duan 85ec70d099 fix(query): improve performance for first function x10 quickly1 2022-10-18 17:26:51 +08:00
Alex Duan e2637ab6a7 fix(query): improve performance for first function x10 quickly 2022-10-18 17:22:41 +08:00
Minghao Li 1df2703c41 refactor(sync): modify strategy for syncBeginSnapshot 2022-10-18 17:15:57 +08:00
Shengliang Guan 5b7872b119 Merge remote-tracking branch 'origin/3.0' into enh/TD-19463_2 2022-10-18 17:06:28 +08:00
Shengliang Guan 9e0feee081 enh: sync propose return at once if replica is 1 2022-10-18 17:06:03 +08:00
Shengliang Guan 194587558b
Merge pull request #17434 from taosdata/fix/3.0_bugfix_wxy
fix: plan problem with 'partition by tag group by tag' statement
2022-10-18 16:33:36 +08:00
dapan1121 0fe14f0b16 fix: fix coverity issues 2022-10-18 16:33:27 +08:00
Shengliang Guan af070148b9
Merge pull request #17394 from taosdata/enh/TD-19463_2
fix: crash while reconfig mnode will cause taosd reboot failure
2022-10-18 16:24:08 +08:00
Minghao Li e85954276f refactor(sync): rename functions 2022-10-18 16:16:53 +08:00
Minghao Li 1b36ad119c refactor(sync): rename functions 2022-10-18 15:24:00 +08:00
Shengliang Guan b92f1efd40 Merge remote-tracking branch 'origin/3.0' into enh/TD-19463_2 2022-10-18 15:16:38 +08:00
Xiaoyu Wang eaa2a344e1 fix: plan problem with 'partition by tag group by tag' statement 2022-10-18 15:01:52 +08:00
Shengliang Guan c5e9b6abd6
Merge pull request #17402 from taosdata/fix/TD-19259
fix: fix coverity scan problem
2022-10-18 14:50:45 +08:00
Minglei Jin 029abe7396 fix: coverity issues 2022-10-18 14:32:18 +08:00
Minghao Li 49c19e13f2 refactor(sync): rename function 2022-10-18 14:16:39 +08:00
Minghao Li e810f2ad64 refactor(sync): delete old code, ok 2022-10-18 13:53:03 +08:00
Haojun Liao 5a7b360d6c
Merge pull request #17428 from taosdata/fix/liao_cov
fix(query): fix coverity issues.
2022-10-18 13:29:00 +08:00
dapan1121 c51629e5d3
Merge pull request #17423 from taosdata/fix/TS-1901
fix: fix varchar and bigint compare issue
2022-10-18 13:16:27 +08:00
Shengliang Guan f76261dcb5 fix: become leader if replica num is 1 2022-10-18 12:31:15 +08:00
dapan1121 ab7a00abbe fix: fix case when crash issue 2022-10-18 11:54:30 +08:00
Haojun Liao 2e4dca1171 fix: remove a typo 2022-10-18 11:53:22 +08:00
Haojun Liao 91c376ab63 other: merge 3.0 2022-10-18 11:52:44 +08:00
Shengliang Guan 3ff1ae2bd5
Merge pull request #17421 from taosdata/feature/stream_ly
fix(stream): coverity scan, memory leak
2022-10-18 11:49:14 +08:00
Haojun Liao 95dd30be57 fix(query): fix coverity issues. 2022-10-18 11:43:58 +08:00
Xiaoyu Wang 0228caaa0d enh: last cache optimize 2022-10-18 11:38:59 +08:00
Benguang Zhao cf2b6ccbfb enh: write idx ahead of writing its log entry in WAL 2022-10-18 11:23:24 +08:00
Benguang Zhao af9aa9d783 enh: assert on alignment of idx entries in walWriteIndex 2022-10-18 11:23:13 +08:00
Benguang Zhao f0427c9322 fix: ftrunc on appending WAL log failure for recovery in walWriteImpl 2022-10-18 11:22:21 +08:00
Benguang Zhao 3190ef65a3 fix: deal with misaligned idx entries in walCheckAndRepairIdxFile 2022-10-18 11:21:48 +08:00
yihaoDeng b5f7623219 fix invalid packet 2022-10-18 10:53:29 +08:00
dapan1121 bdb81e2b89 fix: fix varchar and bigint compare issue 2022-10-18 10:44:24 +08:00
Xiaoyu Wang 78589248f2
Merge branch '3.0' into fix/3.0_bugfix_wxy 2022-10-18 09:53:08 +08:00
54liuyao 5fc475b960 fix(stream): coverity scan, memory leak 2022-10-18 09:40:19 +08:00
Shengliang Guan a609f0efb5 Merge remote-tracking branch 'origin/3.0' into enh/TD-19463_2 2022-10-18 09:37:33 +08:00
Shengliang Guan 98f1c3d89a
Merge pull request #17411 from taosdata/fix/coverity_glzhao
fix: coverity issues
2022-10-17 22:58:37 +08:00
Shengliang Guan b660f03f24
Merge pull request #17418 from taosdata/fix/invalidPack
fix: fix invalid packet
2022-10-17 22:58:04 +08:00
Haojun Liao 7e1521ba0a
Merge pull request #17401 from taosdata/fix/liao_cov
fix(query): fix coverity  issues.
2022-10-17 22:45:02 +08:00
yihaoDeng 78df93e0ca fix invalid packet 2022-10-17 22:17:47 +08:00
Minghao Li 94ba0f47f0 refactor(sync): stop elect when not candidate 2022-10-17 20:20:55 +08:00
yihaoDeng 5ff8bb5bc0 fix invalid packet 2022-10-17 19:56:59 +08:00
dapan1121 1992925d8d Merge remote-tracking branch 'origin/3.0' into fix/coverity.pw 2022-10-17 19:50:37 +08:00
dapan1121 cf9abe7258 fix: fix coverity check issues 2022-10-17 19:48:36 +08:00
Haojun Liao c8b180b129 fix(query): update the cached last query. 2022-10-17 19:14:06 +08:00
Hongze Cheng 50dfc57cda
Merge pull request #17398 from taosdata/fix/TD-19250-2
fix: coverity issues
2022-10-17 18:59:40 +08:00
Minghao Li 45bce6ad49 refactor(sync): add syncBeginSnapshot, syncEndSnapshot 2022-10-17 18:08:35 +08:00
Haojun Liao da9df99461 fix(query): opt last query. 2022-10-17 17:59:43 +08:00
Minghao Li 8a6eaed6f6 refactor(sync): delete some code 2022-10-17 17:36:51 +08:00
Ganlin Zhao 1a3b2fa4f2 fix: coverity issues
CID: 399527
2022-10-17 16:55:27 +08:00
Xiaoyu Wang 93aee94a3f fix: do coverity scan 2022-10-17 16:54:12 +08:00
Minghao Li 092a07475d refactor(sync): process hb and appendentries 2022-10-17 16:38:44 +08:00
yihaoDeng c9aadfadee fix coverity scan problem 2022-10-17 16:29:50 +08:00
Haojun Liao 6d965b8b81 fix(query): fix coverity issues. 2022-10-17 16:27:44 +08:00
Shengliang Guan ced97588d1
Merge pull request #17395 from taosdata/szhou/fixbugs
fix: reserve enough capacity for inter/final result block when performing scalar calculation of fill operator
2022-10-17 16:26:24 +08:00
Xiaoyu Wang b286b0cf26 fix: do coverity scan 2022-10-17 16:18:35 +08:00
Haojun Liao 89f80436c6 fix(query): fix coverity issues. 2022-10-17 16:17:16 +08:00
Ganlin Zhao 51dd72ec82 fix: coverity issues
CID: 372918
2022-10-17 15:53:24 +08:00
Xiaoyu Wang 9abea76791 fix: do coverity scan 2022-10-17 15:43:42 +08:00
Minglei Jin 5c66712b91 fix: coverity issues 2022-10-17 15:28:10 +08:00
Haojun Liao 08397dc698
Merge pull request #17389 from taosdata/fix/liao_cov
fix(query): fix bug in group by tag.
2022-10-17 15:06:26 +08:00
Shengliang Guan 77e40abea2
Merge pull request #17359 from taosdata/enh/3.0_planner_optimize
fix: problem when last is used for system table query
2022-10-17 14:37:04 +08:00
Shengliang Guan 8fe672feab fix: crash whle reconfig mnode will cause taosd reboot failure 2022-10-17 14:34:51 +08:00
slzhou 4c2896236f fix: reserve enough capacity for inter/final result block when performing scalar calculation of fill operator 2022-10-17 14:34:34 +08:00
Benguang Zhao a4fd2def98 fix: resolve a typo in errormsg printing in walScanLogGetLastVer 2022-10-17 14:22:20 +08:00
Haojun Liao ed9ec795eb fix(query): fix coverity issues. 2022-10-17 14:05:40 +08:00
Haojun Liao 87516ea332 fix(query): fix bug in group by tag. 2022-10-17 13:00:31 +08:00
Ganlin Zhao bcf2cfeed7 fix: coverity issues
CID: 354713
2022-10-17 11:06:02 +08:00
Minghao Li a3f8c03a65 refacotr(sync): add case sync2-test.sim 2022-10-17 10:58:55 +08:00
Minghao Li 5745223bca refactor(sync): add double queues in mnode 2022-10-17 10:33:27 +08:00
Liu Jicong 9a3ac0ca57 Merge branch '3.0' into feature/stream 2022-10-17 10:17:45 +08:00
Liu Jicong 6f9153c6e3 fix: error handling 2022-10-17 10:13:10 +08:00
Shengliang Guan 4223b43a3a
Merge pull request #17322 from taosdata/FIX/TD-19239-3.0
fix: enhance subroutines to resolve WAL inconsistency after crashing or disk full
2022-10-17 09:06:16 +08:00
Haojun Liao bcb3d41d08 fix(query): fix coverity issues. 2022-10-16 13:46:21 +08:00
Benguang Zhao e3f50c0d48 fix: align vers.firstVer with vers.snapshotVer+1 in WAL meta info 2022-10-16 13:10:57 +08:00
Haojun Liao aa9c99fa53 Merge branch '3.0' into feature/3_liaohj 2022-10-16 12:50:05 +08:00
Minghao Li fa30b94c67 refactor(sync): append entries 2022-10-16 12:07:02 +08:00
Benguang Zhao 616eb5f903 Merge branch '3.0' into FIX/TD-19239-3.0 2022-10-16 00:29:01 +08:00
Benguang Zhao 6f39a36344 fix: replace asserts on failure of tdbPagerWrite with tdbError msg 2022-10-15 23:57:37 +08:00
Benguang Zhao a4cc3f76d4 fix: ignore file not exist error of tdbOsRemove 2022-10-15 23:57:37 +08:00
Benguang Zhao c70d10334c enh: print vgId in error msg within syncNodeCommit 2022-10-15 23:57:37 +08:00
Benguang Zhao b6c31ee67d fix: fsync the current wal log and idx files at first to ensure validity of meta in walSaveMeta 2022-10-15 23:57:37 +08:00
Benguang Zhao 7fb827debd fix: refactor walScanLogGetLastVer, walCheckAndRepairMeta, and walCheckAndRepairIdx.
* search for the last entry in the contiguous range of valid WAL from the last pos fsynced as firstTrial
    * find the last entry before the last pos fsynced backwards as second trial
    * reserve sufficient space for computing CRC32 checksum, esp. of WAL record body
    * rebuild meta info to resolve potential misalignment between lists of meta and actual log files
    * retract commitIndex and appliedIndex to lastLogIndex if needed
    * put an upper size limit on possibly corrupted WAL range to be recovered
2022-10-15 23:56:31 +08:00
Shengliang Guan 513db327e8
Merge pull request #17366 from taosdata/fix/TD-19250
fix: dismiss some coverity scan issues
2022-10-15 21:54:58 +08:00
Hongze Cheng 0a0f67c872
Merge pull request #17373 from taosdata/revert-17368-refact/tag_agg_opt
Revert "enh(query): opt group by tag perf."
2022-10-15 20:43:59 +08:00
Shengliang Guan edf9253a16 Merge remote-tracking branch 'origin/3.0' into enh/TD-19463_2 2022-10-15 17:19:08 +08:00
Hongze Cheng 329b750701
Revert "enh(query): opt group by tag perf." 2022-10-15 16:14:50 +08:00
Minghao Li 797d1324c5 refactor(sync): request vote 2022-10-15 09:28:55 +08:00
Haojun Liao 77cafebd63
Merge pull request #17368 from taosdata/refact/tag_agg_opt
enh(query): opt group by tag perf.
2022-10-14 23:26:34 +08:00
Benguang Zhao c693384ec4 enh: replace asserts with error logs in walReadVer 2022-10-14 22:57:28 +08:00
Benguang Zhao 948fa60ef0 fix: check the length of remaining content for computing CRC32 chksum of WAL record body 2022-10-14 22:57:28 +08:00
Benguang Zhao 63b13db10f fix: eliminate asserts on getting and committing log entries 2022-10-14 22:57:27 +08:00
Benguang Zhao df18ddbbb5 enh: remove WAL log file corrupted completely 2022-10-14 22:57:27 +08:00
Benguang Zhao 715f53a856 fix: eliminate asserts on errors of appending or getting log entry 2022-10-14 22:46:35 +08:00
Benguang Zhao 9055f63742 fix: ftruncate WAL log after the last valid WAL record properly in walScanLogGetLastVer 2022-10-14 22:43:41 +08:00
Benguang Zhao 76865258cf enh: protect WAL meta by flushing to a tmpfile at first and then renaming 2022-10-14 22:32:15 +08:00
Shengliang Guan fc090a1a4a enh: refactor the code to create and delete mnodes 2022-10-14 22:19:10 +08:00
Benguang Zhao 36bf800e15 fix: improve fault tolerance on disk space full with error handling enhanced 2022-10-14 22:02:27 +08:00
dapan1121 0df311a78f
Merge pull request #17264 from taosdata/refact/query_opt
refactor:do some internal refactor to optimize the query performance.
2022-10-14 19:51:46 +08:00
Shengliang Guan ea4ae8a960 Merge remote-tracking branch 'origin/3.0' into enh/TD-19463_2 2022-10-14 19:23:02 +08:00
Haojun Liao aa04aee7fd enh(query): opt group by tag perf. 2022-10-14 18:49:19 +08:00
Shengliang Guan 78fb1911d4 enh: refactor the code to create and delete mnodes 2022-10-14 17:59:09 +08:00
Minglei Jin 3f46bd64b9 fix: dismiss some coverity scan issues 2022-10-14 17:47:21 +08:00
Liu Jicong bf2d8540d3
Merge pull request #17355 from taosdata/feature/stream
fix(stream): memory leak
2022-10-14 17:24:24 +08:00
dapan1121 fdffc2883f fix: fix code merge issue 2022-10-14 17:05:18 +08:00
Xiaoyu Wang bb3bb18c01 fix: problem when last is used for system table query 2022-10-14 16:24:00 +08:00
Shengliang Guan 2f69d657e0
Merge pull request #17353 from taosdata/feature/stream_ly
fix(stream):Defects Tracking, delete log
2022-10-14 16:03:46 +08:00
Shengliang Guan 075c2e9126
Merge pull request #17343 from taosdata/enh/3.0_planner_optimize
enh: do coverity scan
2022-10-14 16:03:03 +08:00
Liu Jicong 50896c3a01 Merge branch '3.0' into feature/stream 2022-10-14 15:38:58 +08:00
Liu Jicong a57a305035 fix(stream): memory leak 2022-10-14 14:43:22 +08:00
Hongze Cheng e20dbd566a
Merge pull request #17352 from taosdata/fix/hzcheng_coverity_scan
fix: converity scan problem
2022-10-14 14:42:43 +08:00
54liuyao d5a410b90e fix(stream):Defects Tracking, delete log 2022-10-14 14:29:25 +08:00
Liu Jicong cface2840e
Merge pull request #17349 from taosdata/feature/stream
fix(tmq): push msg
2022-10-14 14:18:17 +08:00
Xiaoyu Wang ab98754c56 Merge remote-tracking branch 'origin/3.0' into enh/3.0_planner_optimize 2022-10-14 13:45:15 +08:00
Hongze Cheng 2268a1e94e fix some converity scan problem 2022-10-14 13:34:25 +08:00
Liu Jicong 6f8d4d6955 fix(tmq): push msg 2022-10-14 13:31:05 +08:00
dapan1121 40591003d1 Merge branch 'refact/query_opt' of github.com:taosdata/TDengine into refact/query_opt 2022-10-14 13:09:30 +08:00
Minghao Li 4d123c4da6 refactor(sync): add interface in sync 2022-10-14 11:18:48 +08:00
dapan1121 9a024590f5
Merge pull request #17321 from taosdata/feat/caseWhen
feat: support case when operator
2022-10-14 09:57:29 +08:00
dapan1121 74be3572db enh: add query response policy 2022-10-14 09:31:18 +08:00
dapan1121 52e0681769 fix: fix merge issue 2022-10-14 09:16:02 +08:00
dapan1121 f3919c4450 Merge remote-tracking branch 'origin/3.0' into feat/caseWhen 2022-10-14 09:14:01 +08:00
Minghao Li 2ae4081a3f refactor(sync): add double queues in vnode 2022-10-13 20:57:36 +08:00
afwerar f80dbfb6f5 fix: memory param over 2022-10-13 18:48:06 +08:00
Xiaoyu Wang 9a946541a2 enh: do coverity scan 2022-10-13 18:14:44 +08:00
Xiaoyu Wang 242a53c285 enh: do coverity scan 2022-10-13 17:03:40 +08:00
Hongze Cheng 5f010843a6 more code format 2022-10-13 16:58:43 +08:00
Xiaoyu Wang 7a19119dc7 Merge remote-tracking branch 'origin/3.0' into enh/3.0_planner_optimize 2022-10-13 16:44:41 +08:00
Xiaoyu Wang 3cce178721 enh: do coverity scan 2022-10-13 16:43:56 +08:00
Haojun Liao d234681b74 other:merge 3.0 2022-10-13 15:39:06 +08:00
Haojun Liao 18740e7b48 other:merge 3.0, and support last query cache 2022-10-13 15:35:51 +08:00
Minghao Li 733440b352 refactor(sync): add double queues in vnode 2022-10-13 14:37:18 +08:00
Hongze Cheng 5b6e928d65 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/code_format 2022-10-13 14:25:51 +08:00
Hongze Cheng 8a033aca5c more code format 2022-10-13 14:25:37 +08:00
Liu Jicong 7f8d2ff56d
Merge pull request #17328 from taosdata/feature/stream
refactor(stream): set state buffer size
2022-10-13 14:24:31 +08:00
Haojun Liao f5f0a7026f other: merge 3.0 2022-10-13 14:20:51 +08:00
Hongze Cheng c4b3da5032 more code format 2022-10-13 14:15:42 +08:00
Hongze Cheng c79cc7e454 more code format 2022-10-13 14:06:27 +08:00
Hongze Cheng bb65999566 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/code_format 2022-10-13 14:03:34 +08:00
Hongze Cheng d8e32fb439 more code format 2022-10-13 14:03:23 +08:00
Hongze Cheng 63d9b85631 more code format 2022-10-13 13:59:18 +08:00
Shengliang Guan bf5c14b64c
Merge pull request #17305 from taosdata/feature/rpc_compress
support compress
2022-10-13 13:58:36 +08:00
Shengliang Guan ebf330fad2
Merge pull request #17309 from taosdata/fix/3.0_bugfix_wxy
fix: some problems of parser
2022-10-13 13:58:13 +08:00
Hongze Cheng d5255f1eb7 more format 2022-10-13 13:41:36 +08:00
Hongze Cheng bd2546a765
Merge pull request #17303 from taosdata/fix/TD-19482
fix(meta): META_READER_NOLOCK with inner meta readers
2022-10-13 13:19:57 +08:00
yihaoDeng 3addb95496 Merge branch 'new' into dd 2022-10-13 12:40:26 +08:00