Why is the function remove duplicates not working
Tutor 5 (87 Reviews)
Excel Tutor
Still stuck with a Excel question
Ask this expertAnswer
Remove Duplicates does not work when Excel cannot correctly identify duplicate values. Excel checks duplicates based on exact cell content. Any difference in formatting, spacing, data type, or hidden characters stops Excel from treating values as duplicates.
1.1. Common Causes and Fixes
1.2 Hidden Spaces or Non-Printable Characters
Excel treats “Data” and “Data␣” as different values. A trailing or leading space blocks duplicate detection.
Fix:
Select a helper column.
Use the TRIM function:
=TRIM(A1).Copy and paste values back into the original column.
Run Remove Duplicates again.
2.2 Mixed Data Types (Text vs. Numbers)
A number stored as text is not recognized as the same value as a number stored as a numeric field.
Example: “123” (text) and 123 (number).
Fix (Windows or Mac):
Select the affected column.
Go to Data → Text to Columns → Finish.
Excel converts text numbers into numeric values.
2.3 Applied Filters Blocking Removal
Filtered rows hide duplicates that Remove Duplicates evaluates. Excel scans the whole dataset and does not ignore hidden rows unless they are manually hidden, not filtered.
Fix:
Clear filters under the Data tab.
Apply Remove Duplicates again.
2.4 Merged Cells Prevent the Operation
Merged cells interrupt row comparison. Excel stops the process because each column must contain one value per row.
Fix:
Select the range.
Use Home → Merge & Center → Unmerge Cells.
Re-run the tool.
2.5 Selection Does Not Cover All Relevant Columns
Excel only removes duplicates based on the columns you select. Missing one column changes the comparison rules and may give no results.
Fix:
Select the entire dataset before using Remove Duplicates.
In the dialog box, choose all columns that define a “duplicate.”
2.6 Table Formatting Issues
Excel tables behave differently from normal ranges. Incorrect header detection affects removal.
Fix:
Click inside the table.
Go to Table Design and confirm header row settings.
Try removing duplicates again using the table tool.
2.7 Formulas Instead of Values
Cells with formulas that display the same result are not duplicates unless the formula output is identical and stored as a static value.
Fix:
Convert formulas to values using Copy → Paste Values.
Run the duplicate removal.
2.8 External Links or Imported Data
Imported data often carries invisible characters, inconsistent formatting, or encoding issues.
Fix:
Clean the data with TRIM and CLEAN in a helper column.
Convert text to numbers.
Try Remove Duplicates again.
3. Detailed Troubleshooting Checklist
Confirm no leading or trailing spaces exist.
Confirm all numbers are numbers and not text.
Confirm filters are cleared.
Confirm merged cells are removed.
Confirm the full dataset is selected.
Confirm headers are correctly recognized.
Confirm formulas are converted to values.
Confirm imported data is cleaned.
4. When to Use a Formula Instead
Remove Duplicates works for static data. A formula works better when you need dynamic detection.
A common approach uses COUNTIF to flag repeating entries, though formulas are not required for the core issue.
. Was this Helpful?Get Online Tutoring or Questions answered by Experts.
You can post a question for a tutor or set up a tutoring session
Answers · 1
How to show duplicates in red
Answers · 1
How to apply duplicate conditional formatting rule
Answers · 1
How to duplicate conditional formatting excel
Answers · 1
What is excel conditional formatting duplicates
Answers · 1