Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-4788

LFSCK 3: MDT-MDT consistency verification

        Details

        • Type: New Feature
        • Status: Resolved
        • Priority: Critical
        • Resolution: Fixed
        • Affects Version/s: None
        • Fix Version/s: Lustre 2.7.0
        • Labels:
        • Epic:
        • Project:
          OpenSFS SFS-DEV-001
        • Rank (Obsolete):
          13167

          Description

          In LFSCK 3, we will not only extend the FID-in-dirent and linkEA verification from single MDT to cross-MDTs cases, but also some additional inconsistent check/repair for remote object and striped directory, includes:
          1) Dangling referenced name entry: The name entry exists, but related MDT-object does not exist.
          2) Orphan MDT-object: The MDT-object exists, but there is no name entry to reference it.
          3) Multiple-referenced name entry: More than one MDT-objects point back to the same name entry, but the name entry only references one of them.
          4) Unmatched name entry and MDT-object pairs: The name entry references the MDT-object which has no linkEA for back-reference or it points back to another name entry that does not exists or does not reference the MDT-object.
          5) Redundant or invalid linkEA entries: Repeated linkEA entries, or bad parent FID, or the parent FID is not for MDT-object, or not allocated yet.
          6) Invalid nlink count: The MDT-object's nlink count does not matches the name entries (which reference such MDT-object) count.

            Activity

            Ascending order - Click to sort in descending order
            6 older comments
            Hide
            Permalink
            yong.fan nasf added a comment -

            The total patches list for all LFSCK 3 related patches:
            Landed:
            1) http://review.whamcloud.com/#/c/10030/
            2) http://review.whamcloud.com/#/c/10143/
            3) http://review.whamcloud.com/#/c/10447/
            4) http://review.whamcloud.com/#/c/10733/
            5) http://review.whamcloud.com/#/c/10751/
            6) http://review.whamcloud.com/#/c/10765/
            7) http://review.whamcloud.com/#/c/11275/
            8) http://review.whamcloud.com/#/c/11276/
            9) http://review.whamcloud.com/#/c/11288/
            10) http://review.whamcloud.com/#/c/11407/
            11) http://review.whamcloud.com/#/c/11590/
            12) http://review.whamcloud.com/#/c/10602/
            13) http://review.whamcloud.com/#/c/10493/
            14) http://review.whamcloud.com/#/c/11304/
            15) http://review.whamcloud.com/#/c/11373/
            16) http://review.whamcloud.com/#/c/10986/
            17) http://review.whamcloud.com/#/c/11382/
            18) http://review.whamcloud.com/#/c/11485/
            19) http://review.whamcloud.com/#/c/10987/
            20) http://review.whamcloud.com/#/c/10603/
            21) http://review.whamcloud.com/#/c/10996/
            22) http://review.whamcloud.com/#/c/11317/
            23) http://review.whamcloud.com/#/c/11486/
            24) http://review.whamcloud.com/#/c/11330/
            25) http://review.whamcloud.com/#/c/12247/
            26) http://review.whamcloud.com/#/c/12248/
            27) http://review.whamcloud.com/#/c/12249/
            28) http://review.whamcloud.com/#/c/11391/
            29) http://review.whamcloud.com/#/c/11444/
            30) http://review.whamcloud.com/#/c/11516/
            31) http://review.whamcloud.com/#/c/11536/
            32) http://review.whamcloud.com/#/c/11845/

            To be landed:
            1) http://review.whamcloud.com/#/c/11846/
            2) http://review.whamcloud.com/#/c/11847/
            3) http://review.whamcloud.com/#/c/11848/

            Show
            yong.fan nasf added a comment - The total patches list for all LFSCK 3 related patches: Landed: 1) http://review.whamcloud.com/#/c/10030/ 2) http://review.whamcloud.com/#/c/10143/ 3) http://review.whamcloud.com/#/c/10447/ 4) http://review.whamcloud.com/#/c/10733/ 5) http://review.whamcloud.com/#/c/10751/ 6) http://review.whamcloud.com/#/c/10765/ 7) http://review.whamcloud.com/#/c/11275/ 8) http://review.whamcloud.com/#/c/11276/ 9) http://review.whamcloud.com/#/c/11288/ 10) http://review.whamcloud.com/#/c/11407/ 11) http://review.whamcloud.com/#/c/11590/ 12) http://review.whamcloud.com/#/c/10602/ 13) http://review.whamcloud.com/#/c/10493/ 14) http://review.whamcloud.com/#/c/11304/ 15) http://review.whamcloud.com/#/c/11373/ 16) http://review.whamcloud.com/#/c/10986/ 17) http://review.whamcloud.com/#/c/11382/ 18) http://review.whamcloud.com/#/c/11485/ 19) http://review.whamcloud.com/#/c/10987/ 20) http://review.whamcloud.com/#/c/10603/ 21) http://review.whamcloud.com/#/c/10996/ 22) http://review.whamcloud.com/#/c/11317/ 23) http://review.whamcloud.com/#/c/11486/ 24) http://review.whamcloud.com/#/c/11330/ 25) http://review.whamcloud.com/#/c/12247/ 26) http://review.whamcloud.com/#/c/12248/ 27) http://review.whamcloud.com/#/c/12249/ 28) http://review.whamcloud.com/#/c/11391/ 29) http://review.whamcloud.com/#/c/11444/ 30) http://review.whamcloud.com/#/c/11516/ 31) http://review.whamcloud.com/#/c/11536/ 32) http://review.whamcloud.com/#/c/11845/ To be landed: 1) http://review.whamcloud.com/#/c/11846/ 2) http://review.whamcloud.com/#/c/11847/ 3) http://review.whamcloud.com/#/c/11848/
            Hide
            Permalink
            yong.fan nasf added a comment -

            The total patches list for all LFSCK 3 related patches:
            Landed:
            1) http://review.whamcloud.com/#/c/10030/
            2) http://review.whamcloud.com/#/c/10143/
            3) http://review.whamcloud.com/#/c/10447/
            4) http://review.whamcloud.com/#/c/10733/
            5) http://review.whamcloud.com/#/c/10751/
            6) http://review.whamcloud.com/#/c/10765/
            7) http://review.whamcloud.com/#/c/11275/
            8) http://review.whamcloud.com/#/c/11276/
            9) http://review.whamcloud.com/#/c/11288/
            10) http://review.whamcloud.com/#/c/11407/
            11) http://review.whamcloud.com/#/c/11590/
            12) http://review.whamcloud.com/#/c/10602/
            13) http://review.whamcloud.com/#/c/10493/
            14) http://review.whamcloud.com/#/c/11304/
            15) http://review.whamcloud.com/#/c/11373/
            16) http://review.whamcloud.com/#/c/10986/
            17) http://review.whamcloud.com/#/c/11382/
            18) http://review.whamcloud.com/#/c/11485/
            19) http://review.whamcloud.com/#/c/10987/
            20) http://review.whamcloud.com/#/c/10603/
            21) http://review.whamcloud.com/#/c/10996/
            22) http://review.whamcloud.com/#/c/11317/
            23) http://review.whamcloud.com/#/c/11486/
            24) http://review.whamcloud.com/#/c/11330/
            25) http://review.whamcloud.com/#/c/12247/
            26) http://review.whamcloud.com/#/c/12248/
            27) http://review.whamcloud.com/#/c/12249/
            28) http://review.whamcloud.com/#/c/11391/
            29) http://review.whamcloud.com/#/c/11444/
            30) http://review.whamcloud.com/#/c/11516/
            31) http://review.whamcloud.com/#/c/11536/
            32) http://review.whamcloud.com/#/c/11845/
            33) http://review.whamcloud.com/#/c/11846/
            34) http://review.whamcloud.com/#/c/11847/

            To be landed:
            1) http://review.whamcloud.com/#/c/11848/

            Show
            yong.fan nasf added a comment - The total patches list for all LFSCK 3 related patches: Landed: 1) http://review.whamcloud.com/#/c/10030/ 2) http://review.whamcloud.com/#/c/10143/ 3) http://review.whamcloud.com/#/c/10447/ 4) http://review.whamcloud.com/#/c/10733/ 5) http://review.whamcloud.com/#/c/10751/ 6) http://review.whamcloud.com/#/c/10765/ 7) http://review.whamcloud.com/#/c/11275/ 8) http://review.whamcloud.com/#/c/11276/ 9) http://review.whamcloud.com/#/c/11288/ 10) http://review.whamcloud.com/#/c/11407/ 11) http://review.whamcloud.com/#/c/11590/ 12) http://review.whamcloud.com/#/c/10602/ 13) http://review.whamcloud.com/#/c/10493/ 14) http://review.whamcloud.com/#/c/11304/ 15) http://review.whamcloud.com/#/c/11373/ 16) http://review.whamcloud.com/#/c/10986/ 17) http://review.whamcloud.com/#/c/11382/ 18) http://review.whamcloud.com/#/c/11485/ 19) http://review.whamcloud.com/#/c/10987/ 20) http://review.whamcloud.com/#/c/10603/ 21) http://review.whamcloud.com/#/c/10996/ 22) http://review.whamcloud.com/#/c/11317/ 23) http://review.whamcloud.com/#/c/11486/ 24) http://review.whamcloud.com/#/c/11330/ 25) http://review.whamcloud.com/#/c/12247/ 26) http://review.whamcloud.com/#/c/12248/ 27) http://review.whamcloud.com/#/c/12249/ 28) http://review.whamcloud.com/#/c/11391/ 29) http://review.whamcloud.com/#/c/11444/ 30) http://review.whamcloud.com/#/c/11516/ 31) http://review.whamcloud.com/#/c/11536/ 32) http://review.whamcloud.com/#/c/11845/ 33) http://review.whamcloud.com/#/c/11846/ 34) http://review.whamcloud.com/#/c/11847/ To be landed: 1) http://review.whamcloud.com/#/c/11848/
            Hide
            Permalink
            yong.fan nasf added a comment -

            The total patches list for all LFSCK 3 related patches:

            Landed to Lustre-2.6:
            1) http://review.whamcloud.com/#/c/10030/
            2) http://review.whamcloud.com/#/c/10143/
            3) http://review.whamcloud.com/#/c/10447/
            4) http://review.whamcloud.com/#/c/10733/
            5) http://review.whamcloud.com/#/c/10751/
            6) http://review.whamcloud.com/#/c/10765/

            Landed to Lustre-2.7:
            1) http://review.whamcloud.com/#/c/11275/
            2) http://review.whamcloud.com/#/c/11276/
            3) http://review.whamcloud.com/#/c/11288/
            4) http://review.whamcloud.com/#/c/11407/
            5) http://review.whamcloud.com/#/c/11590/
            6) http://review.whamcloud.com/#/c/10602/
            7) http://review.whamcloud.com/#/c/10493/
            8) http://review.whamcloud.com/#/c/11304/
            9) http://review.whamcloud.com/#/c/11373/
            10) http://review.whamcloud.com/#/c/10986/
            11) http://review.whamcloud.com/#/c/11382/
            12) http://review.whamcloud.com/#/c/11485/
            13) http://review.whamcloud.com/#/c/10987/
            14) http://review.whamcloud.com/#/c/10603/
            15) http://review.whamcloud.com/#/c/10996/
            16) http://review.whamcloud.com/#/c/11317/
            17) http://review.whamcloud.com/#/c/11486/
            18) http://review.whamcloud.com/#/c/11330/
            19) http://review.whamcloud.com/#/c/12247/
            20) http://review.whamcloud.com/#/c/12248/
            21) http://review.whamcloud.com/#/c/12249/
            22) http://review.whamcloud.com/#/c/11391/
            23) http://review.whamcloud.com/#/c/11444/
            24) http://review.whamcloud.com/#/c/11516/
            25) http://review.whamcloud.com/#/c/11536/
            26) http://review.whamcloud.com/#/c/11845/
            27) http://review.whamcloud.com/#/c/11846/
            28) http://review.whamcloud.com/#/c/11847/
            29) http://review.whamcloud.com/#/c/11848/

            Show
            yong.fan nasf added a comment - The total patches list for all LFSCK 3 related patches: Landed to Lustre-2.6: 1) http://review.whamcloud.com/#/c/10030/ 2) http://review.whamcloud.com/#/c/10143/ 3) http://review.whamcloud.com/#/c/10447/ 4) http://review.whamcloud.com/#/c/10733/ 5) http://review.whamcloud.com/#/c/10751/ 6) http://review.whamcloud.com/#/c/10765/ Landed to Lustre-2.7: 1) http://review.whamcloud.com/#/c/11275/ 2) http://review.whamcloud.com/#/c/11276/ 3) http://review.whamcloud.com/#/c/11288/ 4) http://review.whamcloud.com/#/c/11407/ 5) http://review.whamcloud.com/#/c/11590/ 6) http://review.whamcloud.com/#/c/10602/ 7) http://review.whamcloud.com/#/c/10493/ 8) http://review.whamcloud.com/#/c/11304/ 9) http://review.whamcloud.com/#/c/11373/ 10) http://review.whamcloud.com/#/c/10986/ 11) http://review.whamcloud.com/#/c/11382/ 12) http://review.whamcloud.com/#/c/11485/ 13) http://review.whamcloud.com/#/c/10987/ 14) http://review.whamcloud.com/#/c/10603/ 15) http://review.whamcloud.com/#/c/10996/ 16) http://review.whamcloud.com/#/c/11317/ 17) http://review.whamcloud.com/#/c/11486/ 18) http://review.whamcloud.com/#/c/11330/ 19) http://review.whamcloud.com/#/c/12247/ 20) http://review.whamcloud.com/#/c/12248/ 21) http://review.whamcloud.com/#/c/12249/ 22) http://review.whamcloud.com/#/c/11391/ 23) http://review.whamcloud.com/#/c/11444/ 24) http://review.whamcloud.com/#/c/11516/ 25) http://review.whamcloud.com/#/c/11536/ 26) http://review.whamcloud.com/#/c/11845/ 27) http://review.whamcloud.com/#/c/11846/ 28) http://review.whamcloud.com/#/c/11847/ 29) http://review.whamcloud.com/#/c/11848/
            Hide
            Permalink
            yong.fan nasf added a comment -

            All the patches have been landed to master.

            Show
            yong.fan nasf added a comment - All the patches have been landed to master.
            Hide
            Permalink
            gerrit Gerrit Updater added a comment -

            Fan Yong (fan.yong@intel.com) uploaded a new patch: http://review.whamcloud.com/13897
            Subject: LU-4788 lfsck: measure namespace LFSCK performance
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: be5eb5afda0571aed9b6c01d461be5f9922dc276

            Show
            gerrit Gerrit Updater added a comment - Fan Yong (fan.yong@intel.com) uploaded a new patch: http://review.whamcloud.com/13897 Subject: LU-4788 lfsck: measure namespace LFSCK performance Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: be5eb5afda0571aed9b6c01d461be5f9922dc276

              People

              • Assignee:
                yong.fan nasf
                Reporter:
                yong.fan nasf
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: