This directory is needed only for development and CI\CD.
We have to download and install all the PostgreSQL versions from 12 to 18, MySQL versions 5.7, 8.0, 8.4, 9, MariaDB client tools and MongoDB Database Tools locally. This is needed so we can call pg_dump, pg_restore, mysqldump, mysql, mariadb-dump, mariadb, mongodump, mongorestore, etc. on each version of the database.
You do not need to install the databases fully with all the components. We only need the client tools for each version.
Required Versions
PostgreSQL
- PostgreSQL 12
- PostgreSQL 13
- PostgreSQL 14
- PostgreSQL 15
- PostgreSQL 16
- PostgreSQL 17
- PostgreSQL 18
MySQL
- MySQL 5.7
- MySQL 8.0
- MySQL 8.4
- MySQL 9
MariaDB
MariaDB uses two client versions to support all server versions:
- MariaDB 10.6 (legacy client - for older servers 5.5 and 10.1)
- MariaDB 12.1 (modern client - for servers 10.2+)
The reason for two versions is that MariaDB 12.1 client uses SQL queries that reference the generation_expression column in information_schema.columns, which was only added in MariaDB 10.2. Older servers (5.5, 10.1) don't have this column and fail with newer clients.
MongoDB
MongoDB Database Tools are backward compatible - a single version supports all server versions:
- MongoDB Database Tools 100.10.0 (supports MongoDB servers 4.0-8.0)
The MongoDB Database Tools (mongodump, mongorestore) are designed to be backward compatible with all MongoDB server versions, so only one client version is needed.
Installation
Run the appropriate download script for your platform:
Windows
download_windows.bat
Linux (Debian/Ubuntu)
chmod +x download_linux.sh
./download_linux.sh
MacOS
chmod +x download_macos.sh
./download_macos.sh
Platform-Specific Notes
Windows
- Downloads official PostgreSQL installers from EnterpriseDB
- Downloads official MySQL ZIP archives from dev.mysql.com
- Installs client tools only (no server components)
- May require administrator privileges during PostgreSQL installation
Linux (Debian/Ubuntu)
- Uses the official PostgreSQL APT repository
- Downloads MySQL client tools from official archives
- Installs MariaDB client from official MariaDB repository
- Requires sudo privileges to install packages
- Creates symlinks in version-specific directories for consistency
MacOS
- Requires Homebrew to be installed
- Compiles PostgreSQL from source (client tools only)
- Downloads pre-built MySQL binaries from dev.mysql.com
- Downloads pre-built MariaDB binaries or installs via Homebrew
- Takes longer than other platforms due to PostgreSQL compilation
- Supports both Intel (x86_64) and Apple Silicon (arm64)
Manual Installation
If something goes wrong with the automated scripts, install manually. The final directory structure should match:
PostgreSQL
./tools/postgresql/postgresql-{version}/bin/pg_dump
./tools/postgresql/postgresql-{version}/bin/pg_dumpall
./tools/postgresql/postgresql-{version}/bin/psql
./tools/postgresql/postgresql-{version}/bin/pg_restore
For example:
./tools/postgresql/postgresql-12/bin/pg_dump./tools/postgresql/postgresql-13/bin/pg_dump./tools/postgresql/postgresql-14/bin/pg_dump./tools/postgresql/postgresql-15/bin/pg_dump./tools/postgresql/postgresql-16/bin/pg_dump./tools/postgresql/postgresql-17/bin/pg_dump./tools/postgresql/postgresql-18/bin/pg_dump
MySQL
./tools/mysql/mysql-{version}/bin/mysqldump
./tools/mysql/mysql-{version}/bin/mysql
For example:
./tools/mysql/mysql-5.7/bin/mysqldump./tools/mysql/mysql-8.0/bin/mysqldump./tools/mysql/mysql-8.4/bin/mysqldump./tools/mysql/mysql-9/bin/mysqldump
MariaDB
MariaDB uses two client versions to handle compatibility with all server versions:
./tools/mariadb/mariadb-{client-version}/bin/mariadb-dump
./tools/mariadb/mariadb-{client-version}/bin/mariadb
For example:
./tools/mariadb/mariadb-10.6/bin/mariadb-dump(legacy - for servers 5.5, 10.1)./tools/mariadb/mariadb-12.1/bin/mariadb-dump(modern - for servers 10.2+)
MongoDB
MongoDB Database Tools use a single version that supports all server versions:
./tools/mongodb/bin/mongodump
./tools/mongodb/bin/mongorestore
Usage
After installation, you can use version-specific tools:
# Windows - PostgreSQL
./postgresql/postgresql-15/bin/pg_dump.exe --version
# Windows - MySQL
./mysql/mysql-8.0/bin/mysqldump.exe --version
# Windows - MariaDB
./mariadb/mariadb-12.1/bin/mariadb-dump.exe --version
# Windows - MongoDB
./mongodb/bin/mongodump.exe --version
# Linux/MacOS - PostgreSQL
./postgresql/postgresql-15/bin/pg_dump --version
# Linux/MacOS - MySQL
./mysql/mysql-8.0/bin/mysqldump --version
# Linux/MacOS - MariaDB
./mariadb/mariadb-12.1/bin/mariadb-dump --version
# Linux/MacOS - MongoDB
./mongodb/bin/mongodump --version
Environment Variables
The application expects these environment variables to be set (or uses defaults):
# PostgreSQL tools directory (default: ./tools/postgresql)
POSTGRES_INSTALL_DIR=C:\path\to\tools\postgresql
# MySQL tools directory (default: ./tools/mysql)
MYSQL_INSTALL_DIR=C:\path\to\tools\mysql
# MariaDB tools directory (default: ./tools/mariadb)
# Contains subdirectories: mariadb-10.6 and mariadb-12.1
MARIADB_INSTALL_DIR=C:\path\to\tools\mariadb
# MongoDB tools directory (default: ./tools/mongodb)
# Contains bin subdirectory with mongodump and mongorestore
MONGODB_INSTALL_DIR=C:\path\to\tools\mongodb
Troubleshooting
MySQL 5.7 on Apple Silicon (M1/M2/M3)
MySQL 5.7 does not have native ARM64 binaries for macOS. The script will attempt to download the x86_64 version, which may work under Rosetta 2. If you encounter issues:
- Ensure Rosetta 2 is installed:
softwareupdate --install-rosetta - Or skip MySQL 5.7 if you don't need to support that version
Permission Errors on Linux
If you encounter permission errors, ensure you have sudo privileges:
sudo ./download_linux.sh
Download Failures
If downloads fail, you can manually download the files:
- PostgreSQL: https://www.postgresql.org/ftp/source/
- MySQL: https://dev.mysql.com/downloads/mysql/
- MariaDB: https://mariadb.org/download/ or https://archive.mariadb.org/
- MongoDB Database Tools: https://www.mongodb.com/try/download/database-tools
MariaDB Client Compatibility
MariaDB client tools require different versions depending on the server:
Legacy client (10.6) - Required for:
- MariaDB 5.5
- MariaDB 10.1
Modern client (12.1) - Works with:
- MariaDB 10.2 - 10.6
- MariaDB 10.11
- MariaDB 11.4, 11.8
- MariaDB 12.0
The reason is that MariaDB 12.1 client uses SQL queries referencing the generation_expression column in information_schema.columns, which was added in MariaDB 10.2. The application automatically selects the appropriate client version based on the target server version.
MongoDB Database Tools Compatibility
MongoDB Database Tools are backward compatible - a single version supports all server versions:
Supported MongoDB server versions:
- MongoDB 4.0, 4.2, 4.4 (EOL but still supported)
- MongoDB 5.0
- MongoDB 6.0
- MongoDB 7.0 (LTS)
- MongoDB 8.0 (Current)
The application uses MongoDB Database Tools version 100.10.0, which supports all the above server versions.