Commit Graph

51 Commits

Author SHA1 Message Date
Liu Jicong a6fff95795 fix: close wal ref 2022-12-09 17:18:21 +08:00
Benguang Zhao 3f1a0cefbb fix: walSaveMeta ahead of deleting WAL files as gc in walEndSnapshot
delete WAL files in descending order during walRollback
2022-12-06 00:51:45 +08:00
Shengliang Guan d9c261cd13 refact: remove some error codes 2022-12-03 10:17:02 +08:00
Shengliang Guan 2b5257f905 fix: memory lead found in asan 2022-11-16 20:45:15 +08:00
Liu Jicong efde22f081 fix: memory leak 2022-11-15 11:59:29 +08:00
benguang.zhao 07db554fab enh: persist wal at the beginning of vnodeCommit 2022-11-01 00:00:18 +08:00
Shengliang Guan 6c3cd3e19e test: adjust log 2022-10-21 10:39:29 +08:00
Benguang Zhao b6c31ee67d fix: fsync the current wal log and idx files at first to ensure validity of meta in walSaveMeta 2022-10-15 23:57:37 +08:00
Benguang Zhao 7fb827debd fix: refactor walScanLogGetLastVer, walCheckAndRepairMeta, and walCheckAndRepairIdx.
* search for the last entry in the contiguous range of valid WAL from the last pos fsynced as firstTrial
    * find the last entry before the last pos fsynced backwards as second trial
    * reserve sufficient space for computing CRC32 checksum, esp. of WAL record body
    * rebuild meta info to resolve potential misalignment between lists of meta and actual log files
    * retract commitIndex and appliedIndex to lastLogIndex if needed
    * put an upper size limit on possibly corrupted WAL range to be recovered
2022-10-15 23:56:31 +08:00
Benguang Zhao 36bf800e15 fix: improve fault tolerance on disk space full with error handling enhanced 2022-10-14 22:02:27 +08:00
Liu Jicong b1594a6857 fix coverity scan 2022-10-10 11:44:17 +08:00
Liu Jicong a6733dbbd1 feat(wal): auto fix corrupt file 2022-09-21 23:51:24 +08:00
Liu Jicong 3fa5791889 fix(stream): dispatch 2022-07-27 10:52:25 +08:00
Liu Jicong 0b8e9af8ec refactor(wal) 2022-07-26 13:33:26 +08:00
Shengliang Guan 5b654779ba Merge pull request #15372 from taosdata/fix/tsim
test: regression case
2022-07-25 15:23:41 +08:00
Liu Jicong 52d09b4173 refactor(wal) 2022-07-01 14:39:21 +08:00
Liu Jicong 7ab3a1e42c feat(wal): support restore from snapshot 2022-06-09 23:08:06 +08:00
Liu Jicong 0ad9c4cebd fix: init once 2022-05-23 20:58:40 +08:00
Liu Jicong 3629958b43 feat(tmq): serializer and deserializer for tq exec 2022-05-23 20:31:35 +08:00
Shengliang Guan 77575d1e70 refactor: shm queue in multi process mode 2022-05-18 14:20:46 +08:00
afwerar 222db126bc [TD-13758]<fix>: redefine memory api. 2022-03-26 00:29:53 +08:00
afwerar 79057240bd [TD-13759]<fix>: redefine thread api. 2022-03-20 00:47:45 +08:00
Shengliang Guan 68f3de6111 remove tfile 2022-02-28 13:49:38 +08:00
Shengliang Guan 7eec493a43 compare 2022-02-28 13:25:23 +08:00
afwerar 5a37fdf28f [TD-13062]<fix>: cross platform file system. 2022-02-25 01:47:20 +08:00
Liu Jicong a6303b07d3 force repair 2022-01-11 17:55:53 +08:00
Liu Jicong c22de779ac add tmemmem 2022-01-11 16:55:40 +08:00
Liu Jicong 57d341706b implement client heartbeat 2022-01-07 14:57:45 +08:00
Liu Jicong d037b24e05 refactor wal 2021-12-17 13:40:27 +08:00
Liu Jicong dfc8c4e0b7 format code 2021-12-16 15:04:13 +08:00
Liu Jicong 3d141cf109 refactor wal and tq 2021-12-15 17:17:50 +08:00
Liu Jicong 5874463cb1 refactor wal 2021-12-14 18:14:45 +08:00
Liu Jicong 43a2bcdce3 fix wal read handle 2021-12-14 14:38:52 +08:00
Liu Jicong e70989dd82 Merge branch 'feature/tq' into 3.0 2021-12-14 10:03:09 +08:00
Liu Jicong 242e8246e5 make wal cleanup called once for each init 2021-12-14 10:02:36 +08:00
Liu Jicong 793eb11432 Merge branch 'feature/tq' into 3.0 2021-12-13 18:33:54 +08:00
Liu Jicong dc24592929 add wal read handle 2021-12-13 18:33:30 +08:00
Shengliang Guan 1fbc186c34
Merge pull request #9065 from taosdata/feature/dnode3
Feature/dnode3
2021-12-13 17:06:51 +08:00
Shengliang Guan e073ab4bd4 TD-10431 restart dnode test 2021-12-13 17:06:04 +08:00
Liu Jicong b2083ea62f fix memory leak 2021-12-13 13:58:54 +08:00
Liu Jicong 9e4b890727 add test for wal snapshot 2021-12-11 17:18:18 +08:00
Liu Jicong bd408504bb make wal meta serialized and flushed into disk 2021-12-10 11:31:36 +08:00
Liu Jicong 03a54b5a35 make tfinit called once 2021-12-10 10:30:57 +08:00
Liu Jicong cf93f4c239 add unit test for wal 2021-12-09 18:32:38 +08:00
Liu Jicong 6de9692b7d refactor wal 2021-12-03 14:28:54 +08:00
Liu Jicong e123467221
Merge pull request #8860 from taosdata/feature/tq
refactor wal
2021-11-30 16:44:50 +08:00
Liu Jicong 2e859aa138 refactor wal 2021-11-30 16:44:11 +08:00
Liu Jicong 77657f5c67 Merge branch 'feature/tq' into 3.0 2021-11-26 14:22:41 +08:00
Liu Jicong 9f75ad0652 refactor wal 2021-11-26 14:22:16 +08:00
Shengliang Guan 94eac805b9 TD-10430 refact osDir.h and daemon module 2021-11-23 19:54:17 +08:00