SysTools Duplicate Finder: Know How it Works!

Choose the Partitions tab to scan specific partitions for duplicate files instead of the entire drive. Select the partitions you want to analyze, review the results carefully before removing duplicates, and make sure to back up any important data before deleting files.

Select Partition to Scan

Select the partition you want to scan by enabling its checkbox. Check the available partitions along with their details and use the advanced scan options to control which types of files and folders are included or excluded during the scan.

Review the partition details to confirm you have selected the correct partition before starting the scan.

Advanced Scan Options

• Exclude System Folders: Skips operating system folders to reduce scan time and avoid scanning essential system files.
• Exclude Hidden Files: Prevents hidden files from being included in the duplicate scan.
• Exclude Temporary Files: Ignores temporary files that are generally not required for duplicate analysis.
• Exclude Restricted Files: Skips files that require special permissions or cannot be accessed by the current user.
• Exclude Corrupted/Unreadable Files: Omits files that are damaged or cannot be read, ensuring a smoother scanning process.
• Exclude Recycle Bin: Excludes files stored in the Recycle Bin from the scan results.

After that, Click on the Next button to begin scanning the selected partition for duplicate files.

Configure Scan Settings allows you to define how the duplicate file scan should be performed. This section lets you choose the comparison method and specify which file types will be included in the scan, ensuring accurate and efficient duplicate detection.

Find By

• File Content: Compares the actual data stored inside files to identify duplicates, regardless of their file names.
• File Name: Identifies duplicate files based solely on their file names, regardless of their contents.
• File Extension: Finds files that share the same file extension, making it useful for grouping similar file types.
• Comparison Method: When File Content is selected, you can choose one of the following methods:
  • MD5 Hash Comparison: Generates and compares MD5 hash values for files. This method is fast and suitable for most duplicate scanning tasks.
  • SHA256 Comparison: Uses SHA256 hash values for comparison, providing a higher level of uniqueness and reliability than MD5.
  • Bit-by-Bit Comparison: Compares every byte of the files to ensure they are exactly identical. This is the most accurate method but may take longer to complete.

Tip: For most users, MD5 Hash Comparison offers the best balance between speed and accuracy. If absolute verification is required, choose Bit-by-Bit Comparison.

File Extensions

• Scan All File Types: Includes every supported file type in the duplicate scan.
• Enter Specific File Types: Limits the scan to selected file extensions (for example, .jpg, .png, .pdf, or .docx), allowing you to focus on particular file categories.

Size Filter allows you to filter files based on their file size.

• Filter by File Size: Enables or disables file size filtering.
• Comparison: Select Greater than or Less than to define the filter condition.
• Size: Enter the file size value to use for filtering.
• Unit: Specifies the size unit (e.g., MB).

Example: Selecting Greater than with 10 MB displays files larger than 10 MB.

File Date Filter allows users to filter records based on a selected date attribute and a specified date range.

• Filter by Date: Enable this checkbox to apply date-based filtering. Uncheck it to ignore the date filter.
• Date Attribute: Select the date field to filter on.
  • Last Modified Date: Filters records based on their most recent modification date.
  • Created Date: Filters records based on their creation date.
• Start Date: Specify the beginning of the date range. Records on or after this date are included.
• End Date: Specify the end of the date range. Records on or before this date are included.
• Date Picker: Use the calendar icon beside each date field to quickly select a valid date.

Note: The filter returns records that match the selected date attribute within the specified start and end date range.

Reference Folder

Use this section to select a folder that will be used as the reference for duplicate detection. When enabled, the tool compares files only against the selected reference folder within the chosen scan folders.

• Reference Folder for Duplicate Detection: Enable this option to use a specific folder as the reference for finding duplicates.
• Reference Folder Path: Displays the path of the selected reference folder. If no folder is selected, it shows "No reference folder selected."
• Browse: Click to open the folder browser and choose the reference folder.

Note: If no reference folder is selected, duplicate detection is performed without a dedicated reference folder.

Additional Settings

Use this section to configure extra scan behavior.

• Prevent system sleep during scan: Keeps the computer awake while the scan is running, preventing interruptions caused by the system entering sleep mode.

Note: It is recommended to keep this option enabled for long scans to ensure they complete without interruption.

Lastly, Click on the Start Scan button.

Next, You will see a Processing Folders window.

Scan Progress displays the real-time status of the duplicate file scanning process. It helps you monitor the scan, track progress, and view key statistics while the tool analyzes the selected storage location.

• Folders Processed: Displays the number of folders scanned so far.
• Files Processed: Indicates how many files have been analyzed.
• Duplicates Found: Shows the total number of duplicate files detected during the scan.
• Data Scanned: Displays the amount of data scanned up to the current point.
• Disk Scan Progress: A progress bar showing the overall scan completion percentage.
• Scan Location: Specifies the selected drive or folder being scanned.
• File Types: Indicates the file types included in the scan (e.g., All Files).
• Comparison Method: Displays the method used to identify duplicates (e.g., MD5 hash comparison).
• Scan Started: Shows the date and time when the scan began.

Note: The displayed values update automatically as the scan progresses until completion.

Scan Completed Successfully indicates that the duplicate file scanning process has finished without any errors. The tool has completed analyzing the selected location and the scan results are now available for review. Now, click on the OK button to proceed.

Click on Next button after the scanning process is successfully completed.

Duplicate Files Results displays the detected duplicate file groups after the scan. You can review the files and choose actions to manage them.

• Delete: Removes the selected duplicate files.
• Move: Moves the selected duplicate files to another location.
• Create Hard Link: Replaces duplicate files with hard links to save disk space.

Toggle the Recursive option to include subfolders in the search.

Choose the USB Drive tab to scan your connected USB drive for duplicate files. Review the results carefully before removing duplicates, and make sure to back up any important data before deleting files.

Select Disk to Scan

Select the disk you want to scan by enabling its checkbox. Check the available storage devices along with their details and provides advanced scan options to control which types of files and folders are included or excluded during the scan.

Review the disk details to confirm you have selected the correct storage device.

Advanced Scan Options

• Exclude System Folders: Skips operating system folders to reduce scan time and avoid scanning essential system files.
• Exclude Restricted Files: Skips files that require special permissions or cannot be accessed by the current user.

After that, Click on the Next button to begin scanning the selected USB Drive for duplicate files.

Configure Scan Settings allows you to define how the duplicate file scan should be performed. This section lets you choose the comparison method and specify which file types will be included in the scan, ensuring accurate and efficient duplicate detection.

Find By

• File Content: Compares the actual data stored inside files to identify duplicates, regardless of their file names.
• File Name: Identifies duplicate files based solely on their file names, regardless of their contents.
• File Extension: Finds files that share the same file extension, making it useful for grouping similar file types.
• Comparison Method: When File Content is selected, you can choose one of the following methods:
  • MD5 Hash Comparison: Generates and compares MD5 hash values for files. This method is fast and suitable for most duplicate scanning tasks.
  • SHA256 Comparison: Uses SHA256 hash values for comparison, providing a higher level of uniqueness and reliability than MD5.
  • Bit-by-Bit Comparison: Compares every byte of the files to ensure they are exactly identical. This is the most accurate method but may take longer to complete.

Tip: For most users, MD5 Hash Comparison offers the best balance between speed and accuracy. If absolute verification is required, choose Bit-by-Bit Comparison.

File Extensions

• Scan All File Types: Includes every supported file type in the duplicate scan.
• Enter Specific File Types: Limits the scan to selected file extensions (for example, .jpg, .png, .pdf, or .docx), allowing you to focus on particular file categories.

Size Filter allows you to filter files based on their file size.

• Filter by File Size: Enables or disables file size filtering.
• Comparison: Select Greater than or Less than to define the filter condition.
• Size: Enter the file size value to use for filtering.
• Unit: Specifies the size unit (e.g., MB).

Example: Selecting Greater than with 10 MB displays files larger than 10 MB.

File Date Filter allows users to filter records based on a selected date attribute and a specified date range.

• Filter by Date: Enable this checkbox to apply date-based filtering. Uncheck it to ignore the date filter.
• Date Attribute: Select the date field to filter on.
  • Last Modified Date: Filters records based on their most recent modification date.
  • Created Date: Filters records based on their creation date.
• Start Date: Specify the beginning of the date range. Records on or after this date are included.
• End Date: Specify the end of the date range. Records on or before this date are included.
• Date Picker: Use the calendar icon beside each date field to quickly select a valid date.

Note: The filter returns records that match the selected date attribute within the specified start and end date range.

Reference Folder

Use this section to select a folder that will be used as the reference for duplicate detection. When enabled, the tool compares files only against the selected reference folder within the chosen scan folders.

• Reference Folder for Duplicate Detection: Enable this option to use a specific folder as the reference for finding duplicates.
• Reference Folder Path: Displays the path of the selected reference folder. If no folder is selected, it shows "No reference folder selected."
• Browse: Click to open the folder browser and choose the reference folder.

Note: If no reference folder is selected, duplicate detection is performed without a dedicated reference folder.

Additional Settings

Use this section to configure extra scan behavior.

• Prevent system sleep during scan: Keeps the computer awake while the scan is running, preventing interruptions caused by the system entering sleep mode.

Note: It is recommended to keep this option enabled for long scans to ensure they complete without interruption.

Lastly, Click on the Start Scan button.

Next, You will see a Processing Folders window.

Scan Progress displays the real-time status of the duplicate file scanning process. It helps you monitor the scan, track progress, and view key statistics while the tool analyzes the selected storage location.

• Folders Processed: Displays the number of folders scanned so far.
• Files Processed: Indicates how many files have been analyzed.
• Duplicates Found: Shows the total number of duplicate files detected during the scan.
• Data Scanned: Displays the amount of data scanned up to the current point.
• Disk Scan Progress: A progress bar showing the overall scan completion percentage.
• Scan Location: Specifies the selected drive or folder being scanned.
• File Types: Indicates the file types included in the scan (e.g., All Files).
• Comparison Method: Displays the method used to identify duplicates (e.g., MD5 hash comparison).
• Scan Started: Shows the date and time when the scan began.

Note: The displayed values update automatically as the scan progresses until completion.

Scan Completed Successfully indicates that the duplicate file scanning process has finished without any errors. The tool has completed analyzing the selected location and the scan results are now available for review. Now, click on the OK button to proceed. Now, click on the OK button to proceed.

Click on Next button after the scanning process is successfully completed.

Duplicate Files Results displays the detected duplicate file groups after the scan. You can review the files and choose actions to manage them.

• Delete: Removes the selected duplicate files.
• Move: Moves the selected duplicate files to another location.
• Create Hard Link: Replaces duplicate files with hard links to save disk space.

Toggle the Recursive option to include subfolders in the search.

Choose the Folder tab to scan a specific folder for duplicate files. Review the results carefully before removing duplicates, and make sure to back up any important data before deleting files.

Select Folders to Scan

• Add Folder: Browse and add one or more folders to the scan list.
• Remove: Removes the selected folder from the list.
• Remove All: Clears all folders from the scan list.
• Find Duplicates In: Choose the scan scope:
  • Root and Sub Folders: Scans the selected folder and all its subfolders.
  • Root Folder Only: Scans only the selected folder without including subfolders.

Once you are done with the Setthings, Click on the Next button.

Configure Scan Settings allows you to define how the duplicate file scan should be performed. This section lets you choose the comparison method and specify which file types will be included in the scan, ensuring accurate and efficient duplicate detection.

Find By

• File Content: Compares the actual data stored inside files to identify duplicates, regardless of their file names.
• File Name: Identifies duplicate files based solely on their file names, regardless of their contents.
• File Extension: Finds files that share the same file extension, making it useful for grouping similar file types.
• Comparison Method: When File Content is selected, you can choose one of the following methods:
  • MD5 Hash Comparison: Generates and compares MD5 hash values for files. This method is fast and suitable for most duplicate scanning tasks.
  • SHA256 Comparison: Uses SHA256 hash values for comparison, providing a higher level of uniqueness and reliability than MD5.
  • Bit-by-Bit Comparison: Compares every byte of the files to ensure they are exactly identical. This is the most accurate method but may take longer to complete.

Tip: For most users, MD5 Hash Comparison offers the best balance between speed and accuracy. If absolute verification is required, choose Bit-by-Bit Comparison.

File Extensions

• Scan All File Types: Includes every supported file type in the duplicate scan.
• Enter Specific File Types: Limits the scan to selected file extensions (for example, .jpg, .png, .pdf, or .docx), allowing you to focus on particular file categories.

Size Filter allows you to filter files based on their file size.

• Filter by File Size: Enables or disables file size filtering.
• Comparison: Select Greater than or Less than to define the filter condition.
• Size: Enter the file size value to use for filtering.
• Unit: Specifies the size unit (e.g., MB).

Example: Selecting Greater than with 10 MB displays files larger than 10 MB.

File Date Filter allows users to filter records based on a selected date attribute and a specified date range.

• Filter by Date: Enable this checkbox to apply date-based filtering. Uncheck it to ignore the date filter.
• Date Attribute: Select the date field to filter on.
  • Last Modified Date: Filters records based on their most recent modification date.
  • Created Date: Filters records based on their creation date.
• Start Date: Specify the beginning of the date range. Records on or after this date are included.
• End Date: Specify the end of the date range. Records on or before this date are included.
• Date Picker: Use the calendar icon beside each date field to quickly select a valid date.

Note: The filter returns records that match the selected date attribute within the specified start and end date range.

Reference Folder

Use this section to select a folder that will be used as the reference for duplicate detection. When enabled, the tool compares files only against the selected reference folder within the chosen scan folders.

• Reference Folder for Duplicate Detection: Enable this option to use a specific folder as the reference for finding duplicates.
• Reference Folder Path: Displays the path of the selected reference folder. If no folder is selected, it shows "No reference folder selected."
• Browse: Click to open the folder browser and choose the reference folder.

Note: If no reference folder is selected, duplicate detection is performed without a dedicated reference folder.

Additional Settings

Use this section to configure extra scan behavior.

• Prevent system sleep during scan: Keeps the computer awake while the scan is running, preventing interruptions caused by the system entering sleep mode.

Note: It is recommended to keep this option enabled for long scans to ensure they complete without interruption.

Lastly, Click on the Start Scan button.

Next, You will see a Processing Folders window.

Scan Progress displays the real-time status of the duplicate file scanning process. It helps you monitor the scan, track progress, and view key statistics while the tool analyzes the selected storage location.

• Folders Processed: Displays the number of folders scanned so far.
• Files Processed: Indicates how many files have been analyzed.
• Duplicates Found: Shows the total number of duplicate files detected during the scan.
• Data Scanned: Displays the amount of data scanned up to the current point.
• Disk Scan Progress: A progress bar showing the overall scan completion percentage.
• Scan Location: Specifies the selected drive or folder being scanned.
• File Types: Indicates the file types included in the scan (e.g., All Files).
• Comparison Method: Displays the method used to identify duplicates (e.g., MD5 hash comparison).
• Scan Started: Shows the date and time when the scan began.

Note: The displayed values update automatically as the scan progresses until completion.

Scan Completed Successfully indicates that the duplicate file scanning process has finished without any errors. The tool has completed analyzing the selected location and the scan results are now available for review. Now, click on the OK button to proceed. Now, click on the OK button to proceed.

Click on Next button after the scanning process is successfully completed.

Duplicate Files Results displays the detected duplicate file groups after the scan. You can review the files and choose actions to manage them.

• Delete: Removes the selected duplicate files.
• Move: Moves the selected duplicate files to another location.
• Create Hard Link: Replaces duplicate files with hard links to save disk space.

Toggle the Recursive option to include subfolders in the search.