Duplicates and similar photos: which copy SiftMac keeps
- Byte for byte. SiftMac calls a file a duplicate only when its whole contents match another file’s, checked with SHA-256 on your Mac.
- One copy always stays: the one outside Downloads, not named like a copy and not in a backup folder, then the oldest. Extras start unticked and wait on the Undo Shelf if you remove them.
- Similar photos finds near-identical shots with Apple’s Vision framework, keeps the best of each group, and never looks inside the Photos library.
1. How duplicates are found
SiftMac looks in your own folders: Desktop, Documents, Downloads, Movies, Music and Pictures. It skips hidden files, apps and other packages (the Photos library is one), code projects (any folder with a .git, plus node_modules, venv, .venv, Pods, DerivedData and __pycache__), the Music and TV apps’ own libraries, iCloud files that aren’t downloaded (reading them would download them), files under 1 MB, and anything another category already lists.
What’s left is compared in three passes, each one cheap enough to run on more files than the next:
- Same size. A file whose size nothing else shares can’t have a duplicate. Two names for one file, a hard link, count as one.
- Same start and end. A SHA-256 fingerprint of the first and last 64 KB, plus the size.
- Same contents. A SHA-256 hash of the whole file, read 1 MB at a time. A file that can’t be read is never called a duplicate.
Copies that are APFS clones of each other share their space, so removing one frees nothing, and they aren’t listed. Every other extra copy is listed beside the copy that stays, as “Same as ~/Documents/report.pdf”, with the number of copies in the group.
Which copy stays
In each group SiftMac keeps one copy, and never lists or touches it. It prefers, in this order:
- a copy outside Downloads;
- a copy not named like one, so
report.pdfstays overreport copy.pdf,report copy 2.pdforreport (1).pdf; - a copy not in a folder that sounds like a backup or old stuff, such as “Backup”, “Old”, “Archive 2023” or “Copy of …”, matched on whole words, so “Folder” isn’t “old”;
- the oldest copy, by the date it was created;
- the shortest path.
Right before cleaning, SiftMac checks that the kept copy is still there and still the same size. If it has moved or changed, the extra copy stays too.
Similar photos
Similar photos, in the Detailed view’s sidebar, runs when you press Find similar photos, since comparing takes a while. It looks at HEIC, JPEG and PNG photos of at least 80 KB in Pictures, Desktop, Downloads and Documents, newest first, up to 5,000. Apple’s Vision framework turns a small thumbnail of each photo into a feature print, on your Mac. Photos are sorted by date and each is compared with the 24 on either side of it, where bursts and edits sit, and close matches form a group.
Each group keeps its best shot: the most pixels, then the biggest file, then the newest. It’s marked KEEP, the extras sit beside it, and ticking a group moves only the extras onto the Undo Shelf. The kept shot never moves.
2. Why it’s this careful
A duplicate finder is only as good as two decisions: what counts as the same, and which copy to keep. Matching on name or size alone flags files that only look alike. Keeping the wrong copy can leave you with the one in Downloads while the one your project uses disappears.
So SiftMac matches whole files, keeps the copy most likely to be the one in use, and still ticks nothing for you, because a duplicate may be a deliberate backup or part of a project. Whatever you remove waits on the Undo Shelf for 7 days, and Put back returns it to its folder.
3. What it doesn’t do
- It never looks inside the Photos library. Photos has its own Duplicates album for its library; SiftMac only compares files and photos outside it.
- It only compares your own files of 1 MB or more, never anything in Library, hidden folders, code projects, apps, or the Music and TV libraries.
- Files must be identical. A re-saved or re-exported file with different bytes isn’t a duplicate. Near matches apply only to photos, in Similar photos.
- Similar photos has limits of its own. HEIC, JPEG and PNG only, up to the 5,000 newest, and only compared with photos close to them in date, so two similar shots years apart aren’t grouped.
- Nothing is ticked or deleted for you. Extras go onto the Undo Shelf, not away.
- Without Full Disk Access, Desktop, Documents and Downloads are left out, so macOS doesn’t ask about each folder.
Questions
Which duplicate does SiftMac keep?
The copy outside Downloads, not named like a copy, not in a backup or old-stuff folder, then the oldest, then the one with the shortest path. It’s shown as the kept copy next to every extra, and it’s never touched.
Are SiftMac’s duplicates really identical?
Yes. A file is listed only when a SHA-256 hash of its whole contents matches another file’s. The same name or the same size isn’t enough.
Does SiftMac find duplicates in my Photos library?
No. It never reads inside the Photos library, for duplicates or for similar photos. Use the Duplicates album in Photos for that.
Are my photos uploaded to compare them?
No. Similar photos uses Apple’s Vision framework on your Mac, and nothing leaves it.
What if I move the kept copy before I clean?
SiftMac checks the kept copy again right before it removes anything. If it’s gone or its size has changed, the extra copy is kept too.
How SiftMac handles it. Duplicates lists each extra copy beside the copy that stays, unticked, and Similar photos groups near-identical shots with the best one marked KEEP; both send what you remove to the Undo Shelf for 7 days. Neither looks inside the Photos library.
Download SiftMac · scanning is free, and so is your first 2 GB of cleaning · See how it works