Commit Graph

16217 Commits

Author SHA1 Message Date
Shengliang Guan 4223b43a3a
Merge pull request #17322 from taosdata/FIX/TD-19239-3.0
fix: enhance subroutines to resolve WAL inconsistency after crashing or disk full
2022-10-17 09:06:16 +08:00
Haojun Liao bcb3d41d08 fix(query): fix coverity issues. 2022-10-16 13:46:21 +08:00
Benguang Zhao e3f50c0d48 fix: align vers.firstVer with vers.snapshotVer+1 in WAL meta info 2022-10-16 13:10:57 +08:00
Benguang Zhao 616eb5f903 Merge branch '3.0' into FIX/TD-19239-3.0 2022-10-16 00:29:01 +08:00
Benguang Zhao 34ea8996a0 fix: check disk availability for committing vnode 2022-10-15 23:57:37 +08:00
Benguang Zhao 8f6a81a18c enh: indicate intentionally restarting taosd on tsdbCommit failure 2022-10-15 23:57:37 +08:00
Benguang Zhao 12d870ef3b fix: response TSDB_CODE_VND_NOT_SYNCED while not pVnode->inUse in vnodeProcessWriteMsg 2022-10-15 23:57:37 +08:00
Benguang Zhao 6f39a36344 fix: replace asserts on failure of tdbPagerWrite with tdbError msg 2022-10-15 23:57:37 +08:00
Benguang Zhao a4cc3f76d4 fix: ignore file not exist error of tdbOsRemove 2022-10-15 23:57:37 +08:00
Benguang Zhao c70d10334c enh: print vgId in error msg within syncNodeCommit 2022-10-15 23:57:37 +08:00
Benguang Zhao b6c31ee67d fix: fsync the current wal log and idx files at first to ensure validity of meta in walSaveMeta 2022-10-15 23:57:37 +08:00
Benguang Zhao 7fb827debd fix: refactor walScanLogGetLastVer, walCheckAndRepairMeta, and walCheckAndRepairIdx.
* search for the last entry in the contiguous range of valid WAL from the last pos fsynced as firstTrial
    * find the last entry before the last pos fsynced backwards as second trial
    * reserve sufficient space for computing CRC32 checksum, esp. of WAL record body
    * rebuild meta info to resolve potential misalignment between lists of meta and actual log files
    * retract commitIndex and appliedIndex to lastLogIndex if needed
    * put an upper size limit on possibly corrupted WAL range to be recovered
2022-10-15 23:56:31 +08:00
Shengliang Guan 31e712c16b
Merge pull request #17369 from taosdata/fix/TD-19559
fix(tsdb): checksum checking shall skip page 1 when loading
2022-10-15 21:55:27 +08:00
Shengliang Guan 513db327e8
Merge pull request #17366 from taosdata/fix/TD-19250
fix: dismiss some coverity scan issues
2022-10-15 21:54:58 +08:00
Hongze Cheng 85276450a3
Merge pull request #17370 from taosdata/fix/hzcheng_coverity_scan
fix: more cv issue
2022-10-15 20:45:13 +08:00
Hongze Cheng 0a0f67c872
Merge pull request #17373 from taosdata/revert-17368-refact/tag_agg_opt
Revert "enh(query): opt group by tag perf."
2022-10-15 20:43:59 +08:00
Shengliang Guan edf9253a16 Merge remote-tracking branch 'origin/3.0' into enh/TD-19463_2 2022-10-15 17:19:08 +08:00
Hongze Cheng 329b750701
Revert "enh(query): opt group by tag perf." 2022-10-15 16:14:50 +08:00
Hongze Cheng 7e174e347e fix more issue 2022-10-15 11:20:37 +08:00
Haojun Liao 77cafebd63
Merge pull request #17368 from taosdata/refact/tag_agg_opt
enh(query): opt group by tag perf.
2022-10-14 23:26:34 +08:00
Benguang Zhao 3af05070cf fix: assert on availability of inUse SVBufPool for vnode 2022-10-14 22:58:56 +08:00
Benguang Zhao c693384ec4 enh: replace asserts with error logs in walReadVer 2022-10-14 22:57:28 +08:00
Benguang Zhao 948fa60ef0 fix: check the length of remaining content for computing CRC32 chksum of WAL record body 2022-10-14 22:57:28 +08:00
Benguang Zhao 63b13db10f fix: eliminate asserts on getting and committing log entries 2022-10-14 22:57:27 +08:00
Benguang Zhao df18ddbbb5 enh: remove WAL log file corrupted completely 2022-10-14 22:57:27 +08:00
Benguang Zhao 56b32a77a4 fix: allow to restart on disk space full, e.g. in dmCheckDiskSpace 2022-10-14 22:57:27 +08:00
Benguang Zhao 715f53a856 fix: eliminate asserts on errors of appending or getting log entry 2022-10-14 22:46:35 +08:00
Benguang Zhao 9055f63742 fix: ftruncate WAL log after the last valid WAL record properly in walScanLogGetLastVer 2022-10-14 22:43:41 +08:00
Benguang Zhao 76865258cf enh: protect WAL meta by flushing to a tmpfile at first and then renaming 2022-10-14 22:32:15 +08:00
Shengliang Guan fc090a1a4a enh: refactor the code to create and delete mnodes 2022-10-14 22:19:10 +08:00
Benguang Zhao 36bf800e15 fix: improve fault tolerance on disk space full with error handling enhanced 2022-10-14 22:02:27 +08:00
dapan1121 0df311a78f
Merge pull request #17264 from taosdata/refact/query_opt
refactor:do some internal refactor to optimize the query performance.
2022-10-14 19:51:46 +08:00
Shengliang Guan ea4ae8a960 Merge remote-tracking branch 'origin/3.0' into enh/TD-19463_2 2022-10-14 19:23:02 +08:00
Minglei Jin b8dfe8707f fix(tsdb): checksum checking shall skip page 1 when loading 2022-10-14 18:58:07 +08:00
Haojun Liao aa04aee7fd enh(query): opt group by tag perf. 2022-10-14 18:49:19 +08:00
dapan1121 3a20447b9d
Merge pull request #17351 from taosdata/fix/TD-19544
fix: fix kill query crash issue
2022-10-14 18:37:48 +08:00
Shengliang Guan 78fb1911d4 enh: refactor the code to create and delete mnodes 2022-10-14 17:59:09 +08:00
Minglei Jin 3f46bd64b9 fix: dismiss some coverity scan issues 2022-10-14 17:47:21 +08:00
Liu Jicong bf2d8540d3
Merge pull request #17355 from taosdata/feature/stream
fix(stream): memory leak
2022-10-14 17:24:24 +08:00
dapan1121 fdffc2883f fix: fix code merge issue 2022-10-14 17:05:18 +08:00
Liu Jicong 1a113a5a0c temporarily disable failed test 2022-10-14 16:30:51 +08:00
Xiaoyu Wang bb3bb18c01 fix: problem when last is used for system table query 2022-10-14 16:24:00 +08:00
Shengliang Guan 2f69d657e0
Merge pull request #17353 from taosdata/feature/stream_ly
fix(stream):Defects Tracking, delete log
2022-10-14 16:03:46 +08:00
Shengliang Guan 075c2e9126
Merge pull request #17343 from taosdata/enh/3.0_planner_optimize
enh: do coverity scan
2022-10-14 16:03:03 +08:00
Liu Jicong 50896c3a01 Merge branch '3.0' into feature/stream 2022-10-14 15:38:58 +08:00
Liu Jicong a57a305035 fix(stream): memory leak 2022-10-14 14:43:22 +08:00
Hongze Cheng e20dbd566a
Merge pull request #17352 from taosdata/fix/hzcheng_coverity_scan
fix: converity scan problem
2022-10-14 14:42:43 +08:00
54liuyao d5a410b90e fix(stream):Defects Tracking, delete log 2022-10-14 14:29:25 +08:00
Liu Jicong cface2840e
Merge pull request #17349 from taosdata/feature/stream
fix(tmq): push msg
2022-10-14 14:18:17 +08:00
Xiaoyu Wang ab98754c56 Merge remote-tracking branch 'origin/3.0' into enh/3.0_planner_optimize 2022-10-14 13:45:15 +08:00
Hongze Cheng 2268a1e94e fix some converity scan problem 2022-10-14 13:34:25 +08:00
Liu Jicong 6f8d4d6955 fix(tmq): push msg 2022-10-14 13:31:05 +08:00
dapan1121 d5cfbebd82 fix: fix kill query crash issue 2022-10-14 13:26:10 +08:00
dapan1121 40591003d1 Merge branch 'refact/query_opt' of github.com:taosdata/TDengine into refact/query_opt 2022-10-14 13:09:30 +08:00
dapan1121 9a024590f5
Merge pull request #17321 from taosdata/feat/caseWhen
feat: support case when operator
2022-10-14 09:57:29 +08:00
dapan1121 74be3572db enh: add query response policy 2022-10-14 09:31:18 +08:00
dapan1121 52e0681769 fix: fix merge issue 2022-10-14 09:16:02 +08:00
Shengliang Guan d14969a846
Merge pull request #17344 from taosdata/fix/ZhiqiangWang/TD-13064-mac-change-service-name
os: Mac change service name
2022-10-14 09:14:05 +08:00
dapan1121 f3919c4450 Merge remote-tracking branch 'origin/3.0' into feat/caseWhen 2022-10-14 09:14:01 +08:00
Shengliang Guan 81e72ea84c
Merge pull request #17346 from taosdata/feature/TD-14761
fix:sml core dump if insert quickly because of spin lock destroy
2022-10-14 09:13:14 +08:00
Shengliang Guan 9885816ff0
Merge pull request #17345 from taosdata/fix/ZhiqiangWang/TD-19488-memory-param-over
Fix/zhiqiang wang/td 19488 memory param over
2022-10-14 09:12:52 +08:00
wangmm0220 8067febe27 fix:sml core dump if insert quickly because of spin lock destroy 2022-10-13 19:35:43 +08:00
Shengliang Guan 5a5cdb318c
Merge pull request #17342 from taosdata/fix/TD-19468
fix: close merge tree for each file set
2022-10-13 19:12:33 +08:00
afwerar f80dbfb6f5 fix: memory param over 2022-10-13 18:48:06 +08:00
afwerar e453e96d6b os: Mac change service name 2022-10-13 18:34:11 +08:00
Xiaoyu Wang 9a946541a2 enh: do coverity scan 2022-10-13 18:14:44 +08:00
Minglei Jin 66962bdddc fix: close merge tree for each file set 2022-10-13 18:12:26 +08:00
Xiaoyu Wang 242a53c285 enh: do coverity scan 2022-10-13 17:03:40 +08:00
Hongze Cheng 5f010843a6 more code format 2022-10-13 16:58:43 +08:00
Xiaoyu Wang 7a19119dc7 Merge remote-tracking branch 'origin/3.0' into enh/3.0_planner_optimize 2022-10-13 16:44:41 +08:00
Xiaoyu Wang 3cce178721 enh: do coverity scan 2022-10-13 16:43:56 +08:00
Haojun Liao 260ca17337
Merge pull request #17331 from taosdata/feature/3_liaohj
fix(query):set the correct active block index and add some logs.
2022-10-13 15:30:29 +08:00
Hongze Cheng 1ad117497c more format 2022-10-13 14:39:32 +08:00
Hongze Cheng 17040610e5 more code format 2022-10-13 14:37:03 +08:00
Hongze Cheng 5b6e928d65 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/code_format 2022-10-13 14:25:51 +08:00
Hongze Cheng 8a033aca5c more code format 2022-10-13 14:25:37 +08:00
Liu Jicong 7f8d2ff56d
Merge pull request #17328 from taosdata/feature/stream
refactor(stream): set state buffer size
2022-10-13 14:24:31 +08:00
Haojun Liao f5f0a7026f other: merge 3.0 2022-10-13 14:20:51 +08:00
Hongze Cheng c4b3da5032 more code format 2022-10-13 14:15:42 +08:00
Hongze Cheng c79cc7e454 more code format 2022-10-13 14:06:27 +08:00
Haojun Liao ab5bff4f37
Merge branch '3.0' into feature/3_liaohj 2022-10-13 14:06:26 +08:00
Hongze Cheng bb65999566 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/code_format 2022-10-13 14:03:34 +08:00
Hongze Cheng d8e32fb439 more code format 2022-10-13 14:03:23 +08:00
Hongze Cheng 63d9b85631 more code format 2022-10-13 13:59:18 +08:00
Shengliang Guan bf5c14b64c
Merge pull request #17305 from taosdata/feature/rpc_compress
support compress
2022-10-13 13:58:36 +08:00
Shengliang Guan ebf330fad2
Merge pull request #17309 from taosdata/fix/3.0_bugfix_wxy
fix: some problems of parser
2022-10-13 13:58:13 +08:00
Shengliang Guan 969a688b7a
Merge pull request #17330 from taosdata/fix/TD-19486
fix: coverity issues
2022-10-13 13:57:55 +08:00
Hongze Cheng d5255f1eb7 more format 2022-10-13 13:41:36 +08:00
Hongze Cheng 3950c8fc24
Merge pull request #17326 from taosdata/refact/code_format
refact: code format
2022-10-13 13:35:17 +08:00
Hongze Cheng bd2546a765
Merge pull request #17303 from taosdata/fix/TD-19482
fix(meta): META_READER_NOLOCK with inner meta readers
2022-10-13 13:19:57 +08:00
yihaoDeng 3addb95496 Merge branch 'new' into dd 2022-10-13 12:40:26 +08:00
Minglei Jin 060eb307a9 fix(mac): new metaReaderReleaseLock api to keep reader's buffer 2022-10-13 12:02:18 +08:00
Haojun Liao 3d9e284913 other:merge 3.0 2022-10-13 12:01:47 +08:00
Haojun Liao fbd3aac007 fix(query):set the correct active block index and add some logs. 2022-10-13 11:59:14 +08:00
Hongze Cheng 6ed0634fb7 format more code 2022-10-13 11:56:16 +08:00
Hongze Cheng 98f3f183c6 Merge branch '3.0' of https://github.com/taosdata/TDengine into refact/code_format 2022-10-13 11:49:53 +08:00
Hongze Cheng fcbaa6082b more code refact 2022-10-13 11:49:46 +08:00
Shengliang Guan f82e6b41ca
Merge pull request #17323 from taosdata/fix/TD-19486
fix: crash while create mnode
2022-10-13 11:45:09 +08:00
Liu Jicong d507678b35 refactor(stream): set state buffer size 2022-10-13 11:18:02 +08:00
Shengliang Guan c37df48fb4 fix: coverity issues 2022-10-13 11:14:13 +08:00