32-bit ARM builds fail as single process uses >3 GiB memory #1243

New Issue

MrUnknownDE · 2026-04-06T01:41:33+02:00

MrUnknownDE commented

2026-04-06 01:41:33 +02:00

Originally created by @MichaIng on 2/5/2024

Subject of the issue

When building vaultwarden on 32-bit ARM systems, it fails at the last compilation step, when assembling/linking the final vaultwarden binary. I first recognised that our GitHub Actions workflow failed building vaultwarden v1.30.3. This compiles on the public GitHub Actions runners within a QEMU-emulated container, throwing the following errors:

fatal runtime error: Rust cannot catch foreign exceptions
qemu: uncaught target signal 6 (Aborted) - core dumped
error: could not compile `vaultwarden` (bin "vaultwarden")

Caused by:
  process didn't exit successfully: `/root/.rustup/toolchains/1.75.0-armv7-unknown-linux-gnueabihf/bin/rustc --crate-name vaultwarden --edition=2021 src/main.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C opt-level=3 -C lto=fat -C codegen-units=1 --cfg 'feature="libsqlite3-sys"' --cfg 'feature="sqlite"' -C metadata=1d58e77e878ebff3 -C extra-filename=-1d58e77e878ebff3 --out-dir /tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps -C strip=debuginfo -L dependency=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps --extern argon2=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libargon2-b3c0e2fb66f02f2d.rlib --extern bigdecimal=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libbigdecimal-5c86038a6cda2357.rlib --extern bytes=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libbytes-96d5c91a8970d3e0.rlib --extern cached=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libcached-821a263ab8ba999e.rlib --extern chrono=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libchrono-15dfa97106ea9ebc.rlib --extern chrono_tz=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libchrono_tz-78b03a250f1270bd.rlib --extern cookie=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libcookie-043627deeb63f29d.rlib --extern cookie_store=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libcookie_store-669046e1dd142dcd.rlib --extern dashmap=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libdashmap-4e900a06ccdaf881.rlib --extern data_encoding=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libdata_encoding-2d1c20ef5ab53b9f.rlib --extern data_url=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libdata_url-b52f35a304c403e4.rlib --extern diesel=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libdiesel-ca0c77a5a320c634.rlib --extern diesel_migrations=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libdiesel_migrations-16e3489a14ca359f.rlib --extern dotenvy=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libdotenvy-0639e1593ada03c1.rlib --extern email_address=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libemail_address-ef15593c949ba84d.rlib --extern fern=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libfern-a911570f27da85c4.rlib --extern futures=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libfutures-e89e3ce9357840c0.rlib --extern governor=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libgovernor-4f4ba3b235183b38.rlib --extern handlebars=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libhandlebars-c7fd7cd5e66214d0.rlib --extern html5gum=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libhtml5gum-f30a2504d52ce515.rlib --extern job_scheduler_ng=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libjob_scheduler_ng-9ad45ce09bc25744.rlib --extern jsonwebtoken=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libjsonwebtoken-450434a1f9394291.rlib --extern lettre=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/liblettre-452bf5ebf537ccf1.rlib --extern libsqlite3_sys=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/liblibsqlite3_sys-31047204d554a120.rlib --extern log=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/liblog-546ced36359b5ce9.rlib --extern num_derive=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libnum_derive-5e15818039b17888.so --extern num_traits=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libnum_traits-92bc955e64bc391c.rlib --extern once_cell=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libonce_cell-49d951a6756b3fe0.rlib --extern openssl=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libopenssl-f81ff30d71ee3f77.rlib --extern paste=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libpaste-a79e4674c1034386.so --extern percent_encoding=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libpercent_encoding-39b0e9fee14dda0f.rlib --extern pico_args=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libpico_args-1ee48336305d6717.rlib --extern rand=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/librand-f0cff6ea6faef3d8.rlib --extern regex=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libregex-527e30f8b0362c21.rlib --extern reqwest=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libreqwest-ea7db8ba6bf40739.rlib --extern ring=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libring-777c51b0c3d288c0.rlib --extern rmpv=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/librmpv-fdaa6bd5760011c9.rlib --extern rocket=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/librocket-4ee1c8e28bd14c24.rlib --extern rocket_ws=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/librocket_ws-2f177dcbabdf5516.rlib --extern rpassword=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/librpassword-c8818deb34b76ea8.rlib --extern semver=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libsemver-60d3d6cb5a7e3505.rlib --extern serde=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libserde-9cc93a7189128f25.rlib --extern serde_json=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libserde_json-86d2120e19427cc1.rlib --extern syslog=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libsyslog-5c152346c1ce8d61.rlib --extern time=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libtime-56441102515dd14f.rlib --extern tokio=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libtokio-5dfae61c8444c1a0.rlib --extern tokio_tungstenite=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libtokio_tungstenite-e58dabcf1dceb921.rlib --extern totp_lite=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libtotp_lite-2df5b536107c4b4f.rlib --extern tracing=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libtracing-ceeaccc151504516.rlib --extern url=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/liburl-16c84f7f7f3fb00c.rlib --extern uuid=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libuuid-73a3a4756b8fa3b6.rlib --extern webauthn_rs=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libwebauthn_rs-df1e3b8e026399eb.rlib --extern which=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libwhich-19dbf4ddca88d868.rlib --extern yubico=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libyubico-72696a30719f44e6.rlib -L native=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/build/libsqlite3-sys-23d986867762c654/out -L native=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/build/ring-74ae6fe0630f3cbf/out -L native=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/build/psm-af7ee5a81c4a19fd/out --cfg sqlite` (signal: 6, SIGABRT: process abort signal)

I then tested it natively on an Odroid XU4, which fails with:

LLVM ERROR: out of memory
Allocation failed
error: could not compile `vaultwarden` (bin "vaultwarden")

Caused by:
  process didn't exit successfully: `/root/.rustup/toolchains/1.75.0-armv7-unknown-linux-gnueabihf/bin/rustc --crate-name vaultwarden --edition=2021 src/main.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C opt-level=3 -C lto=fat -C codegen-units=1 --cfg 'feature="libsqlite3-sys"' --cfg 'feature="sqlite"' -C metadata=1d58e77e878ebff3 -C extra-filename=-1d58e77e878ebff3 --out-dir /root/vaultwarden-1.30.3/target/release/deps -C strip=debuginfo -L dependency=/root/vaultwarden-1.30.3/target/release/deps --extern argon2=/root/vaultwarden-1.30.3/target/release/deps/libargon2-b3c0e2fb66f02f2d.rlib --extern bigdecimal=/root/vaultwarden-1.30.3/target/release/deps/libbigdecimal-5c86038a6cda2357.rlib --extern bytes=/root/vaultwarden-1.30.3/target/release/deps/libbytes-96d5c91a8970d3e0.rlib --extern cached=/root/vaultwarden-1.30.3/target/release/deps/libcached-821a263ab8ba999e.rlib --extern chrono=/root/vaultwarden-1.30.3/target/release/deps/libchrono-15dfa97106ea9ebc.rlib --extern chrono_tz=/root/vaultwarden-1.30.3/target/release/deps/libchrono_tz-78b03a250f1270bd.rlib --extern cookie=/root/vaultwarden-1.30.3/target/release/deps/libcookie-043627deeb63f29d.rlib --extern cookie_store=/root/vaultwarden-1.30.3/target/release/deps/libcookie_store-669046e1dd142dcd.rlib --extern dashmap=/root/vaultwarden-1.30.3/target/release/deps/libdashmap-4e900a06ccdaf881.rlib --extern data_encoding=/root/vaultwarden-1.30.3/target/release/deps/libdata_encoding-2d1c20ef5ab53b9f.rlib --extern data_url=/root/vaultwarden-1.30.3/target/release/deps/libdata_url-b52f35a304c403e4.rlib --extern diesel=/root/vaultwarden-1.30.3/target/release/deps/libdiesel-ca0c77a5a320c634.rlib --extern diesel_migrations=/root/vaultwarden-1.30.3/target/release/deps/libdiesel_migrations-16e3489a14ca359f.rlib --extern dotenvy=/root/vaultwarden-1.30.3/target/release/deps/libdotenvy-0639e1593ada03c1.rlib --extern email_address=/root/vaultwarden-1.30.3/target/release/deps/libemail_address-ef15593c949ba84d.rlib --extern fern=/root/vaultwarden-1.30.3/target/release/deps/libfern-a911570f27da85c4.rlib --extern futures=/root/vaultwarden-1.30.3/target/release/deps/libfutures-e89e3ce9357840c0.rlib --extern governor=/root/vaultwarden-1.30.3/target/release/deps/libgovernor-4f4ba3b235183b38.rlib --extern handlebars=/root/vaultwarden-1.30.3/target/release/deps/libhandlebars-c7fd7cd5e66214d0.rlib --extern html5gum=/root/vaultwarden-1.30.3/target/release/deps/libhtml5gum-f30a2504d52ce515.rlib --extern job_scheduler_ng=/root/vaultwarden-1.30.3/target/release/deps/libjob_scheduler_ng-9ad45ce09bc25744.rlib --extern jsonwebtoken=/root/vaultwarden-1.30.3/target/release/deps/libjsonwebtoken-450434a1f9394291.rlib --extern lettre=/root/vaultwarden-1.30.3/target/release/deps/liblettre-452bf5ebf537ccf1.rlib --extern libsqlite3_sys=/root/vaultwarden-1.30.3/target/release/deps/liblibsqlite3_sys-31047204d554a120.rlib --extern log=/root/vaultwarden-1.30.3/target/release/deps/liblog-546ced36359b5ce9.rlib --extern num_derive=/root/vaultwarden-1.30.3/target/release/deps/libnum_derive-5e15818039b17888.so --extern num_traits=/root/vaultwarden-1.30.3/target/release/deps/libnum_traits-92bc955e64bc391c.rlib --extern once_cell=/root/vaultwarden-1.30.3/target/release/deps/libonce_cell-49d951a6756b3fe0.rlib --extern openssl=/root/vaultwarden-1.30.3/target/release/deps/libopenssl-f81ff30d71ee3f77.rlib --extern paste=/root/vaultwarden-1.30.3/target/release/deps/libpaste-a79e4674c1034386.so --extern percent_encoding=/root/vaultwarden-1.30.3/target/release/deps/libpercent_encoding-39b0e9fee14dda0f.rlib --extern pico_args=/root/vaultwarden-1.30.3/target/release/deps/libpico_args-1ee48336305d6717.rlib --extern rand=/root/vaultwarden-1.30.3/target/release/deps/librand-f0cff6ea6faef3d8.rlib --extern regex=/root/vaultwarden-1.30.3/target/release/deps/libregex-527e30f8b0362c21.rlib --extern reqwest=/root/vaultwarden-1.30.3/target/release/deps/libreqwest-ea7db8ba6bf40739.rlib --extern ring=/root/vaultwarden-1.30.3/target/release/deps/libring-777c51b0c3d288c0.rlib --extern rmpv=/root/vaultwarden-1.30.3/target/release/deps/librmpv-fdaa6bd5760011c9.rlib --extern rocket=/root/vaultwarden-1.30.3/target/release/deps/librocket-4ee1c8e28bd14c24.rlib --extern rocket_ws=/root/vaultwarden-1.30.3/target/release/deps/librocket_ws-2f177dcbabdf5516.rlib --extern rpassword=/root/vaultwarden-1.30.3/target/release/deps/librpassword-c8818deb34b76ea8.rlib --extern semver=/root/vaultwarden-1.30.3/target/release/deps/libsemver-60d3d6cb5a7e3505.rlib --extern serde=/root/vaultwarden-1.30.3/target/release/deps/libserde-9cc93a7189128f25.rlib --extern serde_json=/root/vaultwarden-1.30.3/target/release/deps/libserde_json-86d2120e19427cc1.rlib --extern syslog=/root/vaultwarden-1.30.3/target/release/deps/libsyslog-5c152346c1ce8d61.rlib --extern time=/root/vaultwarden-1.30.3/target/release/deps/libtime-56441102515dd14f.rlib --extern tokio=/root/vaultwarden-1.30.3/target/release/deps/libtokio-5dfae61c8444c1a0.rlib --extern tokio_tungstenite=/root/vaultwarden-1.30.3/target/release/deps/libtokio_tungstenite-e58dabcf1dceb921.rlib --extern totp_lite=/root/vaultwarden-1.30.3/target/release/deps/libtotp_lite-2df5b536107c4b4f.rlib --extern tracing=/root/vaultwarden-1.30.3/target/release/deps/libtracing-ceeaccc151504516.rlib --extern url=/root/vaultwarden-1.30.3/target/release/deps/liburl-16c84f7f7f3fb00c.rlib --extern uuid=/root/vaultwarden-1.30.3/target/release/deps/libuuid-73a3a4756b8fa3b6.rlib --extern webauthn_rs=/root/vaultwarden-1.30.3/target/release/deps/libwebauthn_rs-df1e3b8e026399eb.rlib --extern which=/root/vaultwarden-1.30.3/target/release/deps/libwhich-19dbf4ddca88d868.rlib --extern yubico=/root/vaultwarden-1.30.3/target/release/deps/libyubico-72696a30719f44e6.rlib -L native=/root/vaultwarden-1.30.3/target/release/build/libsqlite3-sys-23d986867762c654/out -L native=/root/vaultwarden-1.30.3/target/release/build/ring-74ae6fe0630f3cbf/out -L native=/root/vaultwarden-1.30.3/target/release/build/psm-af7ee5a81c4a19fd/out --cfg sqlite` (signal: 6, SIGABRT: process abort signal)

I suspect both to be the same underlying issues, but the build inside the container is probably aborted by the host/container engine.

The same works well with x86_64 and aarch64 builds, natively and within the same QEMU container setup.

I monitored some stats during the build on the Odroid XU4:

6832 | CPU: 19.2% 56°C | RAM: 99% | Swap: 13%
6833 | CPU: 18.0% 56°C | RAM: 99% | Swap: 13%
6834 | CPU: 14.8% 56°C | RAM: 99% | Swap: 13%
6835 | CPU: 17.5% 57°C | RAM: 99% | Swap: 13%
6836 | CPU: 14.7% 55°C | RAM: 74% | Swap: 8%
6837 | CPU: 16.3% 55°C | RAM: 33% | Swap: 1%
6838 | CPU: 2.9% 55°C | RAM: 7% | Swap: 1%
6839 | CPU: 4.6% 54°C | RAM: 7% | Swap: 0%
6840 | CPU: 8.7% 54°C | RAM: 6% | Swap: 0%
6841 | CPU: 6.4% 54°C | RAM: 6% | Swap: 0%

These are the seconds around the failure. RAM size is 2 GiB, and I created an 8 GiB swap space. The last build step of the vaultwarden crate/binary utilises a single CPU core (the XU4 has 8 cores, so 1 core maxed is 12.5% CPU usage, the way I obtained it above) with a single process, and RAM + swap usage seems to crack the 3 GiB limit for a single process, which would explain the issue. LPAE allows an overall larger memory size/usage, but the utilisation for a single process is still limited.

I verified this again by monitoring the process resident and virtual memory usage in htop:

One rustc process during the last build step, with 4 threads. And the build fails when the virtual memory usage crosses 3052 MiB, i.e. quite precisely the 32-bit per-process memory limit.

Since we have successful builds/packages with vaultwarden v1.30.1, I tried building v1.30.2, which expectedly fails the same way, as it differs with just 2 tiny surely unrelated commits from v1.30.3. v1.30.1 still builds fine, so the culprit is to be found between v1.30.1 and v1.30.2, probably just dependency crates which raised in size.

Not sure whether there is an easy solution/workaround. Of course we could try cross-compiling, but I actually would like to avoid that, as it is difficult to assure that correctly shared libraries are linked, especially when building for ARMv6 Raspbian systems.

Deployment environment

vaultwarden version: 1.30.3

Install method: source build
Clients used:
Reverse proxy and version:
MySQL/MariaDB or PostgreSQL version:
Other relevant details:

Steps to reproduce

On Debian (any version):

apt install gcc libc6-dev pkg-config libssl-dev git
curl -sSfo rustup-init.sh 'https://sh.rustup.rs'
chmod +x rustup-init.sh
# ARMv7: Workaround for failing crates index update in emulated 32-bit ARM environments: https://github.com/rust-lang/cargo/issues/8719#issuecomment-1516492970
# ARMv8: Workaround for increased cargo fetch RAM usage: https://github.com/rust-lang/cargo/issues/10583
export CARGO_REGISTRIES_CRATES_IO_PROTOCOL='sparse' CARGO_NET_GIT_FETCH_WITH_CLI='true'
./rustup-init.sh -y --profile minimal --default-toolchain none
rm rustup-init.sh
export PATH="$HOME/.cargo/bin:$PATH"
curl -fLO 'https://github.com/dani-garcia/vaultwarden/archive/1.30.3.tar.gz'
tar xf '1.30.3.tar.gz'
rm '1.30.3.tar.gz'
cd 'vaultwarden-1.30.3'
cargo build --features sqlite --release

Expected behaviour

Actual behaviour

Troubleshooting data

*Originally created by @MichaIng on 2/5/2024*   ### Subject of the issue When building vaultwarden on 32-bit ARM systems, it fails at the last compilation step, when assembling/linking the final `vaultwarden` binary. I first recognised that our GitHub Actions workflow failed building vaultwarden v1.30.3. This compiles on the public GitHub Actions runners within a QEMU-emulated container, throwing the following errors: ``` fatal runtime error: Rust cannot catch foreign exceptions qemu: uncaught target signal 6 (Aborted) - core dumped error: could not compile `vaultwarden` (bin "vaultwarden") Caused by: process didn't exit successfully: `/root/.rustup/toolchains/1.75.0-armv7-unknown-linux-gnueabihf/bin/rustc --crate-name vaultwarden --edition=2021 src/main.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C opt-level=3 -C lto=fat -C codegen-units=1 --cfg 'feature="libsqlite3-sys"' --cfg 'feature="sqlite"' -C metadata=1d58e77e878ebff3 -C extra-filename=-1d58e77e878ebff3 --out-dir /tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps -C strip=debuginfo -L dependency=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps --extern argon2=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libargon2-b3c0e2fb66f02f2d.rlib --extern bigdecimal=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libbigdecimal-5c86038a6cda2357.rlib --extern bytes=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libbytes-96d5c91a8970d3e0.rlib --extern cached=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libcached-821a263ab8ba999e.rlib --extern chrono=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libchrono-15dfa97106ea9ebc.rlib --extern chrono_tz=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libchrono_tz-78b03a250f1270bd.rlib --extern cookie=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libcookie-043627deeb63f29d.rlib --extern cookie_store=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libcookie_store-669046e1dd142dcd.rlib --extern dashmap=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libdashmap-4e900a06ccdaf881.rlib --extern data_encoding=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libdata_encoding-2d1c20ef5ab53b9f.rlib --extern data_url=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libdata_url-b52f35a304c403e4.rlib --extern diesel=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libdiesel-ca0c77a5a320c634.rlib --extern diesel_migrations=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libdiesel_migrations-16e3489a14ca359f.rlib --extern dotenvy=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libdotenvy-0639e1593ada03c1.rlib --extern email_address=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libemail_address-ef15593c949ba84d.rlib --extern fern=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libfern-a911570f27da85c4.rlib --extern futures=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libfutures-e89e3ce9357840c0.rlib --extern governor=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libgovernor-4f4ba3b235183b38.rlib --extern handlebars=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libhandlebars-c7fd7cd5e66214d0.rlib --extern html5gum=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libhtml5gum-f30a2504d52ce515.rlib --extern job_scheduler_ng=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libjob_scheduler_ng-9ad45ce09bc25744.rlib --extern jsonwebtoken=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libjsonwebtoken-450434a1f9394291.rlib --extern lettre=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/liblettre-452bf5ebf537ccf1.rlib --extern libsqlite3_sys=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/liblibsqlite3_sys-31047204d554a120.rlib --extern log=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/liblog-546ced36359b5ce9.rlib --extern num_derive=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libnum_derive-5e15818039b17888.so --extern num_traits=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libnum_traits-92bc955e64bc391c.rlib --extern once_cell=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libonce_cell-49d951a6756b3fe0.rlib --extern openssl=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libopenssl-f81ff30d71ee3f77.rlib --extern paste=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libpaste-a79e4674c1034386.so --extern percent_encoding=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libpercent_encoding-39b0e9fee14dda0f.rlib --extern pico_args=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libpico_args-1ee48336305d6717.rlib --extern rand=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/librand-f0cff6ea6faef3d8.rlib --extern regex=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libregex-527e30f8b0362c21.rlib --extern reqwest=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libreqwest-ea7db8ba6bf40739.rlib --extern ring=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libring-777c51b0c3d288c0.rlib --extern rmpv=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/librmpv-fdaa6bd5760011c9.rlib --extern rocket=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/librocket-4ee1c8e28bd14c24.rlib --extern rocket_ws=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/librocket_ws-2f177dcbabdf5516.rlib --extern rpassword=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/librpassword-c8818deb34b76ea8.rlib --extern semver=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libsemver-60d3d6cb5a7e3505.rlib --extern serde=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libserde-9cc93a7189128f25.rlib --extern serde_json=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libserde_json-86d2120e19427cc1.rlib --extern syslog=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libsyslog-5c152346c1ce8d61.rlib --extern time=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libtime-56441102515dd14f.rlib --extern tokio=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libtokio-5dfae61c8444c1a0.rlib --extern tokio_tungstenite=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libtokio_tungstenite-e58dabcf1dceb921.rlib --extern totp_lite=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libtotp_lite-2df5b536107c4b4f.rlib --extern tracing=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libtracing-ceeaccc151504516.rlib --extern url=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/liburl-16c84f7f7f3fb00c.rlib --extern uuid=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libuuid-73a3a4756b8fa3b6.rlib --extern webauthn_rs=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libwebauthn_rs-df1e3b8e026399eb.rlib --extern which=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libwhich-19dbf4ddca88d868.rlib --extern yubico=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/deps/libyubico-72696a30719f44e6.rlib -L native=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/build/libsqlite3-sys-23d986867762c654/out -L native=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/build/ring-74ae6fe0630f3cbf/out -L native=/tmp/DietPi-Software/vaultwarden-1.30.3/target/release/build/psm-af7ee5a81c4a19fd/out --cfg sqlite` (signal: 6, SIGABRT: process abort signal) ``` I then tested it natively on an Odroid XU4, which fails with: ``` LLVM ERROR: out of memory Allocation failed error: could not compile `vaultwarden` (bin "vaultwarden") Caused by: process didn't exit successfully: `/root/.rustup/toolchains/1.75.0-armv7-unknown-linux-gnueabihf/bin/rustc --crate-name vaultwarden --edition=2021 src/main.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C opt-level=3 -C lto=fat -C codegen-units=1 --cfg 'feature="libsqlite3-sys"' --cfg 'feature="sqlite"' -C metadata=1d58e77e878ebff3 -C extra-filename=-1d58e77e878ebff3 --out-dir /root/vaultwarden-1.30.3/target/release/deps -C strip=debuginfo -L dependency=/root/vaultwarden-1.30.3/target/release/deps --extern argon2=/root/vaultwarden-1.30.3/target/release/deps/libargon2-b3c0e2fb66f02f2d.rlib --extern bigdecimal=/root/vaultwarden-1.30.3/target/release/deps/libbigdecimal-5c86038a6cda2357.rlib --extern bytes=/root/vaultwarden-1.30.3/target/release/deps/libbytes-96d5c91a8970d3e0.rlib --extern cached=/root/vaultwarden-1.30.3/target/release/deps/libcached-821a263ab8ba999e.rlib --extern chrono=/root/vaultwarden-1.30.3/target/release/deps/libchrono-15dfa97106ea9ebc.rlib --extern chrono_tz=/root/vaultwarden-1.30.3/target/release/deps/libchrono_tz-78b03a250f1270bd.rlib --extern cookie=/root/vaultwarden-1.30.3/target/release/deps/libcookie-043627deeb63f29d.rlib --extern cookie_store=/root/vaultwarden-1.30.3/target/release/deps/libcookie_store-669046e1dd142dcd.rlib --extern dashmap=/root/vaultwarden-1.30.3/target/release/deps/libdashmap-4e900a06ccdaf881.rlib --extern data_encoding=/root/vaultwarden-1.30.3/target/release/deps/libdata_encoding-2d1c20ef5ab53b9f.rlib --extern data_url=/root/vaultwarden-1.30.3/target/release/deps/libdata_url-b52f35a304c403e4.rlib --extern diesel=/root/vaultwarden-1.30.3/target/release/deps/libdiesel-ca0c77a5a320c634.rlib --extern diesel_migrations=/root/vaultwarden-1.30.3/target/release/deps/libdiesel_migrations-16e3489a14ca359f.rlib --extern dotenvy=/root/vaultwarden-1.30.3/target/release/deps/libdotenvy-0639e1593ada03c1.rlib --extern email_address=/root/vaultwarden-1.30.3/target/release/deps/libemail_address-ef15593c949ba84d.rlib --extern fern=/root/vaultwarden-1.30.3/target/release/deps/libfern-a911570f27da85c4.rlib --extern futures=/root/vaultwarden-1.30.3/target/release/deps/libfutures-e89e3ce9357840c0.rlib --extern governor=/root/vaultwarden-1.30.3/target/release/deps/libgovernor-4f4ba3b235183b38.rlib --extern handlebars=/root/vaultwarden-1.30.3/target/release/deps/libhandlebars-c7fd7cd5e66214d0.rlib --extern html5gum=/root/vaultwarden-1.30.3/target/release/deps/libhtml5gum-f30a2504d52ce515.rlib --extern job_scheduler_ng=/root/vaultwarden-1.30.3/target/release/deps/libjob_scheduler_ng-9ad45ce09bc25744.rlib --extern jsonwebtoken=/root/vaultwarden-1.30.3/target/release/deps/libjsonwebtoken-450434a1f9394291.rlib --extern lettre=/root/vaultwarden-1.30.3/target/release/deps/liblettre-452bf5ebf537ccf1.rlib --extern libsqlite3_sys=/root/vaultwarden-1.30.3/target/release/deps/liblibsqlite3_sys-31047204d554a120.rlib --extern log=/root/vaultwarden-1.30.3/target/release/deps/liblog-546ced36359b5ce9.rlib --extern num_derive=/root/vaultwarden-1.30.3/target/release/deps/libnum_derive-5e15818039b17888.so --extern num_traits=/root/vaultwarden-1.30.3/target/release/deps/libnum_traits-92bc955e64bc391c.rlib --extern once_cell=/root/vaultwarden-1.30.3/target/release/deps/libonce_cell-49d951a6756b3fe0.rlib --extern openssl=/root/vaultwarden-1.30.3/target/release/deps/libopenssl-f81ff30d71ee3f77.rlib --extern paste=/root/vaultwarden-1.30.3/target/release/deps/libpaste-a79e4674c1034386.so --extern percent_encoding=/root/vaultwarden-1.30.3/target/release/deps/libpercent_encoding-39b0e9fee14dda0f.rlib --extern pico_args=/root/vaultwarden-1.30.3/target/release/deps/libpico_args-1ee48336305d6717.rlib --extern rand=/root/vaultwarden-1.30.3/target/release/deps/librand-f0cff6ea6faef3d8.rlib --extern regex=/root/vaultwarden-1.30.3/target/release/deps/libregex-527e30f8b0362c21.rlib --extern reqwest=/root/vaultwarden-1.30.3/target/release/deps/libreqwest-ea7db8ba6bf40739.rlib --extern ring=/root/vaultwarden-1.30.3/target/release/deps/libring-777c51b0c3d288c0.rlib --extern rmpv=/root/vaultwarden-1.30.3/target/release/deps/librmpv-fdaa6bd5760011c9.rlib --extern rocket=/root/vaultwarden-1.30.3/target/release/deps/librocket-4ee1c8e28bd14c24.rlib --extern rocket_ws=/root/vaultwarden-1.30.3/target/release/deps/librocket_ws-2f177dcbabdf5516.rlib --extern rpassword=/root/vaultwarden-1.30.3/target/release/deps/librpassword-c8818deb34b76ea8.rlib --extern semver=/root/vaultwarden-1.30.3/target/release/deps/libsemver-60d3d6cb5a7e3505.rlib --extern serde=/root/vaultwarden-1.30.3/target/release/deps/libserde-9cc93a7189128f25.rlib --extern serde_json=/root/vaultwarden-1.30.3/target/release/deps/libserde_json-86d2120e19427cc1.rlib --extern syslog=/root/vaultwarden-1.30.3/target/release/deps/libsyslog-5c152346c1ce8d61.rlib --extern time=/root/vaultwarden-1.30.3/target/release/deps/libtime-56441102515dd14f.rlib --extern tokio=/root/vaultwarden-1.30.3/target/release/deps/libtokio-5dfae61c8444c1a0.rlib --extern tokio_tungstenite=/root/vaultwarden-1.30.3/target/release/deps/libtokio_tungstenite-e58dabcf1dceb921.rlib --extern totp_lite=/root/vaultwarden-1.30.3/target/release/deps/libtotp_lite-2df5b536107c4b4f.rlib --extern tracing=/root/vaultwarden-1.30.3/target/release/deps/libtracing-ceeaccc151504516.rlib --extern url=/root/vaultwarden-1.30.3/target/release/deps/liburl-16c84f7f7f3fb00c.rlib --extern uuid=/root/vaultwarden-1.30.3/target/release/deps/libuuid-73a3a4756b8fa3b6.rlib --extern webauthn_rs=/root/vaultwarden-1.30.3/target/release/deps/libwebauthn_rs-df1e3b8e026399eb.rlib --extern which=/root/vaultwarden-1.30.3/target/release/deps/libwhich-19dbf4ddca88d868.rlib --extern yubico=/root/vaultwarden-1.30.3/target/release/deps/libyubico-72696a30719f44e6.rlib -L native=/root/vaultwarden-1.30.3/target/release/build/libsqlite3-sys-23d986867762c654/out -L native=/root/vaultwarden-1.30.3/target/release/build/ring-74ae6fe0630f3cbf/out -L native=/root/vaultwarden-1.30.3/target/release/build/psm-af7ee5a81c4a19fd/out --cfg sqlite` (signal: 6, SIGABRT: process abort signal) ``` I suspect both to be the same underlying issues, but the build inside the container is probably aborted by the host/container engine. The same works well with `x86_64` and `aarch64` builds, natively and within the same QEMU container setup. I monitored some stats during the build on the Odroid XU4: ``` 6832 | CPU: 19.2% 56°C | RAM: 99% | Swap: 13% 6833 | CPU: 18.0% 56°C | RAM: 99% | Swap: 13% 6834 | CPU: 14.8% 56°C | RAM: 99% | Swap: 13% 6835 | CPU: 17.5% 57°C | RAM: 99% | Swap: 13% 6836 | CPU: 14.7% 55°C | RAM: 74% | Swap: 8% 6837 | CPU: 16.3% 55°C | RAM: 33% | Swap: 1% 6838 | CPU: 2.9% 55°C | RAM: 7% | Swap: 1% 6839 | CPU: 4.6% 54°C | RAM: 7% | Swap: 0% 6840 | CPU: 8.7% 54°C | RAM: 6% | Swap: 0% 6841 | CPU: 6.4% 54°C | RAM: 6% | Swap: 0% ``` These are the seconds around the failure. RAM size is 2 GiB, and I created an 8 GiB swap space. The last build step of the `vaultwarden` crate/binary utilises a single CPU core (the XU4 has 8 cores, so 1 core maxed is 12.5% CPU usage, the way I obtained it above) with a single process, and RAM + swap usage seems to crack the 3 GiB limit for a single process, which would explain the issue. LPAE allows an overall larger memory size/usage, but the utilisation for a single process is still limited. I verified this again by monitoring the process resident and virtual memory usage in `htop`: ![image](https://github.com/dani-garcia/vaultwarden/assets/28480705/ccc94fca-53cf-475c-b2fa-ff840df798f2) One `rustc` process during the last build step, with 4 threads. And the build fails when the virtual memory usage crosses 3052 MiB, i.e. quite precisely the 32-bit per-process memory limit. Since we have successful builds/packages with vaultwarden v1.30.1, I tried building v1.30.2, which expectedly fails the same way, as it differs with just [2 tiny surely unrelated commits](https://github.com/dani-garcia/vaultwarden/compare/1.30.2...1.30.3) from v1.30.3. v1.30.1 still builds fine, so the culprit is to be found between v1.30.1 and v1.30.2, probably just dependency crates which raised in size. Not sure whether there is an easy solution/workaround. Of course we could try cross-compiling, but I actually would like to avoid that, as it is difficult to assure that correctly shared libraries are linked, especially when building for ARMv6 Raspbian systems. ### Deployment environment     * vaultwarden version: [1.30.3](https://github.com/dani-garcia/vaultwarden/releases/tag/1.30.3)  * Install method: source build * Clients used:  * Reverse proxy and version:  * MySQL/MariaDB or PostgreSQL version:  * Other relevant details: ### Steps to reproduce  On Debian (any version): ```sh apt install gcc libc6-dev pkg-config libssl-dev git curl -sSfo rustup-init.sh 'https://sh.rustup.rs' chmod +x rustup-init.sh # ARMv7: Workaround for failing crates index update in emulated 32-bit ARM environments: https://github.com/rust-lang/cargo/issues/8719#issuecomment-1516492970 # ARMv8: Workaround for increased cargo fetch RAM usage: https://github.com/rust-lang/cargo/issues/10583 export CARGO_REGISTRIES_CRATES_IO_PROTOCOL='sparse' CARGO_NET_GIT_FETCH_WITH_CLI='true' ./rustup-init.sh -y --profile minimal --default-toolchain none rm rustup-init.sh export PATH="$HOME/.cargo/bin:$PATH" curl -fLO 'https://github.com/dani-garcia/vaultwarden/archive/1.30.3.tar.gz' tar xf '1.30.3.tar.gz' rm '1.30.3.tar.gz' cd 'vaultwarden-1.30.3' cargo build --features sqlite --release ``` ### Expected behaviour  ### Actual behaviour  ### Troubleshooting data

MrUnknownDE closed this issue

2026-04-06 01:41:33 +02:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github/vaultwarden#1243