SiftMac
Who it’s for · Updated 21 November 2026

What fills a data scientist’s Mac: environments, caches and datasets

By Mohit Nippanikar, who makes SiftMac

The short answer
On this page
  1. What fills a data scientist’s Mac
  2. What’s safe to clear, and what to keep
  3. How SiftMac helps a data scientist
  4. A cleanup routine for a data scientist’s Mac
  5. Questions

1. What fills a data scientist’s Mac

Every experiment leaves an environment, a cache and some data behind, and each tool keeps them in its own place:

WhatWhere it livesComes back?More
conda’s package cachepkgs in your conda install, such as ~/miniconda3/pkgs or ~/miniforge3/pkgsYes, downloaded againconda
conda environmentsenvs in the same folderFrom an environment.yml, if you kept oneconda
Project virtual environments.venv or venv in each projectFrom requirements.txt, pyproject.toml or a lockfilePython environments
pip and uv caches~/Library/Caches/pip, ~/.cache/uvYespip, uv
Hugging Face datasets~/.cache/huggingface/hub for downloads, ~/.cache/huggingface/datasets for Arrow filesYes, while they’re on the HubHugging Face cache
scikit-learn sample datasets~/scikit_learn_dataDownloaded again—
Raw downloads and their unzipped copiesDownloads, project data foldersOnly from the sourceDownloads
Notebook checkpoints and embedded outputs.ipynb_checkpoints, plots saved inside .ipynb filesCheckpoints yes; outputs by running again—
Experiment logs and model checkpointsmlruns, wandb, saved weightsNo: they record your runs—
Compiled bytecode__pycache__ next to your modulesYes, on the next runpycache folders

Measure the shared parts, biggest last, then list your conda environments:

du -sh ~/miniconda3/pkgs ~/miniforge3/pkgs ~/anaconda3/pkgs ~/Library/Caches/pip ~/.cache/uv ~/.cache/huggingface ~/scikit_learn_data 2>/dev/null | sort -h
conda env list

And find data files over 500 MB in your usual folders (add your project folders to the list):

find ~/Documents ~/Downloads -type f -size +500M 2>/dev/null

2. What’s safe to clear, and what to keep

Environments and caches

Data: decide file by file

3. How SiftMac helps a data scientist

SiftMac’s developer files list a Python environment, whatever it’s called, when it has a pyvenv.cfg and a list of its packages beside it: requirements.txt, pyproject.toml, environment.yml, uv.lock, poetry.lock, Pipfile or setup.py. The project must be unchanged for 1, 3 or 6 months, and an environment a Python process is running from is skipped. conda environments in conda’s own folder aren’t listed.

4. A cleanup routine for a data scientist’s Mac

  1. Write down every environment you need: conda env export, pip freeze > requirements.txt or uv lock.
  2. Run conda clean --all, after a dry run.
  3. Remove conda environments and virtual environments of finished projects.
  4. Clear the pip and uv caches.
  5. Sort data: keep raw and final versions, delete intermediate copies and unzipped duplicates.
  6. Remove Hugging Face datasets you no longer load.
  7. Archive the experiment folders you report on to an external drive, then remove them locally.

Questions

Is it safe to delete conda’s pkgs folder by hand?

Better not. Environments can link back to packages in it, and deleting by hand can break them. conda clean --all removes only what no listed environment uses.

Can I delete .ipynb_checkpoints folders?

Yes. They’re Jupyter’s autosaved copies of your notebooks; deleting them only removes the option to revert to the last checkpoint. They’re usually small, so they’re rarely the space problem.

Why doesn’t SiftMac find duplicates in my data folders?

If the data lives inside a git repository, SiftMac skips the whole repository on purpose, because files that look identical in projects often belong there. Data in ordinary folders under Documents, Downloads or Desktop is compared.

How SiftMac handles it. SiftMac lists Python environments in projects you haven’t changed for months when the file that rebuilds them is present, lists Hugging Face models one by one, and finds duplicate and large data files in your own folders, sending those to the Undo Shelf first.

Download SiftMac · scanning is free, and so is your first 2 GB of cleaning · See how it works