Prerequisites and supported software/hardware

Operating system

Ubuntu 22.04 LTS
Ubuntu 20.04 LTS
Ubuntu 18.04 LTS
Mac OSX M1 Chip (tested on Big Sur)
Mac OSX M2 Chip (tested on Ventura)
Mac Intel Chip (tested on Mojave)
CentOS 7.9 (via stable release)
Amazon Linux 2 (via stable release)
Windows 10 Server (via WSL)

Software versions

Python 3.8, 3.9, 3.10, 3.11, 3.12 (via pip)
Note: conda is not recommended
pyenv installed python is not working on Mac, install python using brew install [email protected]

Hardware support

CPU (GPU not needed!)

Installing fastdup

macOS

This is the recommended installation method for all Mac, Ubuntu 18-20, Debian 10, Windows Server 10.
Will not work for Centos 7.9, RedHat 4.8.

python3.10 -m pip install -U pip
python3.10 -m pip install fastdup

Notes:

If you are using macOS, you may need to install python with brew using brew install [[email protected]](mailto:[email protected])
You may need to upgrade your pip, using the command python3.10 -m pip install -U pip

Ubuntu 22.04/20.04/18.04 LTS Machine Setup

Required machine setup

sudo apt update
sudo apt -y install software-properties-common
sudo add-apt-repository -y ppa:deadsnakes/ppa
sudo apt update
sudo apt -y install python3.x
sudo apt -y install python3-pip
sudo apt -y install libgl1-mesa-glx
python3.x -m pip install --upgrade pip

Using stable release

This is mandatory for CentOS 7.9 / RedHat 4.8 and similar OS.

download the latest wheel for your system from our release page. Assuming the wheel file is found in your working folder, run:

python3.x -m pip install *.whl

CentOS 7 Setup / Amazon Linux 2 / RedHat 4.8

sudo yum -y install epel-release
sudo yum -y update
sudo yum -y groupinstall "Development Tools"
sudo yum -y install openssl-devel bzip2-devel libffi-devel xz-devel
sudo yum -y install wget
sudo yum install redhat-lsb-core # for lsb_release
sudo yum install -y ffmpeg ffmpeg-devel # for video support

Download and istall CentOS 7 whl image from our release page.

python3.7 -m pip install <path of the downloaded whl>

Windows 10/11 (Using WSL)

To install WSL follow the instructions here.

Enable WSL on your machine (Search -> powershell-> right click -> run as administrator)

wsl --install

Reboot your machine
Inside the Ubuntu shell, run the following installers (you will be asked for password you entered before).

sudo apt update
sudo apt -y install software-properties-common
sudo add-apt-repository -y ppa:deadsnakes/ppa
sudo apt update
sudo apt -y install python3.x
sudo apt -y install python3-pip
sudo apt -y install libgl1-mesa-glx
pip3 install --upgrade pip
python3.x -m pip install fastdup

Upgrading fastdup

You can upgrade an existing fastdup installation by passing the -U option to pip install:

python3.10 -m pip install -U fastdup

Uninstalling fastdup

You can uninstall fastdup using the following command:

python3.10 -m pip uninstall fastdup