Out of memory generating docker image #3142

tonivade · 2025-01-18T08:29:33Z

tonivade
Jan 18, 2025

Hi,

First of all, thank a lot for your work building elk.

I'm trying to build the docker image but it fails always with the same error. I could generate it some time ago, but it stop working with the latest updates in master branch.

The error is always the same out of memory in the step pnpm build of the Dockerfile.

292.8 <--- Last few GCs --->
292.8 
292.8 [17:0xffff85730000]   289429 ms: Mark-Compact 1985.6 (2032.2) -> 1984.2 (2032.9) MB, pooled: 0 MB, 1057.58 / 0.00 ms  (average mu = 0.190, current mu = 0.011) allocation failure; scavenge might not succeed
292.8 [17:0xffff85730000]   290681 ms: Mark-Compact 1986.5 (2033.2) -> 1985.5 (2034.2) MB, pooled: 0 MB, 1242.35 / 0.00 ms  (average mu = 0.107, current mu = 0.008) allocation failure; scavenge might not succeed
292.8 
292.8 
292.8 <--- JS stacktrace --->
292.8 
292.8 FATAL ERROR: Reached heap limit Allocation failed - JavaScript heap out of memory
292.8 ----- Native stack trace -----
292.8 
595.0  ELIFECYCLE  Command failed with exit code 129.

I tried to increase the heap size using the --max-old-space-size parameter using NODE_OPTIONS environment variable. But it doesn't work.

Any idea?

Answered by tonivade

Jan 19, 2025

@shuuji3 thanks for your help!

Finally I managed to fix the issue adding to this to the Dockerfile:

ENV NODE_OPTIONS="--max-old-space-size=4096"

I'm running elk on a rpi5 with only 4GB of RAM and to make it work I need to stop most of the other services running to make room for the image generation.

View full answer

shuuji3 · 2025-01-18T12:10:42Z

shuuji3
Jan 18, 2025
Maintainer

Hi @tonivade 🙂 I encountered the same error on the netlify build for #3059. Here's the netlify log:

11:09:38 AM: $ pnpm run build
11:09:38 AM: > @elk-zone/[email protected] build /opt/build/repo
11:09:38 AM: > nuxi build

(...)

11:10:45 AM: ✓ built in 161ms
11:10:45 AM: PWA v0.20.5
11:10:45 AM: mode      injectManifest
11:10:45 AM: format:   es
11:10:45 AM: precache  509 entries (14939.17 KiB)
11:10:45 AM: files generated
11:10:45 AM:   dist/elk-sw.js
11:10:45 AM: [info] [nitro] Building Nuxt Nitro server (preset: `netlify`, compatibility date: `2024-09-11`)
11:11:21 AM: <--- Last few GCs --->
11:11:21 AM: [6393:0x3ee0f4e0]   103135 ms: Scavenge 2030.9 (2082.8) -> 2023.1 (2083.0) MB, 2.20 / 0.00 ms  (average mu = 0.401, current mu = 0.290) allocation failure;
11:11:21 AM: [6393:0x3ee0f4e0]   103147 ms: Scavenge 2030.3 (2083.0) -> 2023.9 (2083.5) MB, 3.08 / 0.00 ms  (average mu = 0.401, current mu = 0.290) task;
11:11:21 AM: [6393:0x3ee0f4e0]   103166 ms: Scavenge 2031.2 (2083.5) -> 2023.9 (2099.5) MB, 4.31 / 0.01 ms  (average mu = 0.401, current mu = 0.290) allocation failure;
11:11:21 AM: <--- JS stacktrace --->
11:11:21 AM: FATAL ERROR: Reached heap limit Allocation failed - JavaScript heap out of memory
11:11:21 AM: ----- Native stack trace -----
11:11:21 AM:  1: 0xb8d0a3 node::OOMErrorHandler(char const*, v8::OOMDetails const&) [node]
11:11:21 AM:  2: 0xf06250 v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, v8::OOMDetails const&) [node]
11:11:21 AM:  3: 0xf06537 v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, v8::OOMDetails const&) [node]
11:11:21 AM:  4: 0x11180d5  [node]
11:11:21 AM:  5: 0x112ff58 v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [node]
11:11:21 AM:  6: 0x1106071 v8::internal::HeapAllocator::AllocateRawWithLightRetrySlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment) [node]
11:11:21 AM:  7: 0x1107205 v8::internal::HeapAllocator::AllocateRawWithRetryOrFailSlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment) [node]
11:11:21 AM:  8: 0x10e4856 v8::internal::Factory::NewFillerObject(int, v8::internal::AllocationAlignment, v8::internal::AllocationType, v8::internal::AllocationOrigin) [node]
11:11:21 AM:  9: 0x1540686 v8::internal::Runtime_AllocateInYoungGeneration(int, unsigned long*, v8::internal::Isolate*) [node]
11:11:21 AM: 10: 0x1979ef6  [node]
11:11:23 AM: Failed during stage 'building site': Build script returned non-zero exit code: 2 (https://ntl.fyi/exit-code-2)
11:11:23 AM:  ELIFECYCLE  Command failed with exit code 129. (https://ntl.fyi/exit-code-129)
11:11:23 AM: 
11:11:23 AM: "build.command" failed                                        
11:11:23 AM: ────────────────────────────────────────────────────────────────
11:11:23 AM: 
11:11:23 AM:   Error message
11:11:23 AM:   Command failed with exit code 129: pnpm run build (https://ntl.fyi/exit-code-129)
11:11:23 AM: 
11:11:23 AM:   Error location
11:11:23 AM:   In build.command from netlify.toml:
11:11:23 AM:   pnpm run build
11:11:23 AM: 
11:11:23 AM:   Resolved config
11:11:23 AM:   build:
11:11:23 AM:     command: pnpm run build
11:11:23 AM:     commandOrigin: config
11:11:23 AM:     environment:
11:11:23 AM:       - MOCK_USER
11:11:23 AM:       - NUXT_ADMIN_KEY
11:11:23 AM:       - NUXT_CLOUDFLARE_ACCOUNT_ID
11:11:23 AM:       - NUXT_CLOUDFLARE_API_TOKEN
11:11:23 AM:       - NUXT_CLOUDFLARE_NAMESPACE_ID
11:11:23 AM:       - NUXT_PUBLIC_PRIVACY_POLICY_URL
11:11:23 AM:       - NUXT_PUBLIC_TRANSLATE_API
11:11:23 AM:       - NUXT_STORAGE_DRIVER
11:11:23 AM:       - REVIEW_ID
11:11:23 AM:     publish: /opt/build/repo/dist
11:11:23 AM:     publishOrigin: config
11:11:23 AM:   redirects:
11:11:23 AM:     - force: true
11:11:23 AM:       from: https://chat.elk.zone/
11:11:23 AM:       status: 301
11:11:23 AM:       to: https://discord.gg/vAZSDU9J
11:11:23 AM:   redirectsOrigin: config
11:11:23 AM: Build failed due to a user error: Build script returned non-zero exit code: 2
11:11:23 AM: Failing build: Failed to build site
11:11:23 AM: Finished processing build request in 2m18.832s

https://app.netlify.com/sites/elk-zone/deploys/67428a83f7f4350008f3c509#L975

To fix this, we set the same Node options here to 4GB:

elk/netlify.toml

Line 6 in f5cada0

NODE_OPTIONS = '--max-old-space-size=4096'

ref. Command-line API | Node.js v23.6.0 Documentation - https://nodejs.org/api/cli.html#--max-old-space-sizesize-in-mib

0 replies

tonivade · 2025-01-19T10:00:16Z

tonivade
Jan 19, 2025
Author

@shuuji3 thanks for your help!

Finally I managed to fix the issue adding to this to the Dockerfile:

ENV NODE_OPTIONS="--max-old-space-size=4096"

I'm running elk on a rpi5 with only 4GB of RAM and to make it work I need to stop most of the other services running to make room for the image generation.

4 replies

shuuji3 Jan 19, 2025
Maintainer

Ah, that sounds a bit painful 😅 I tested other values just now, and it seems 2560 MB (2.5 GiB) is enough for the current build.

1024MB (failed)

(...)

 => ERROR [builder 11/11] RUN pnpm build                                                                      16.0s 
------                                                                                                              
 > [builder 11/11] RUN pnpm build:                                                                                  
0.426                                                                                                               
0.426 > @elk-zone/[email protected] build /elk                                                                             
0.426 > nuxi build                                                                                                  
0.426                                                                                                               
0.614 Nuxt 3.13.2 with Nitro 2.10.4
4.343 ℹ Building client...
4.484 ℹ vite v5.4.5 building for production...
4.504 ℹ transforming...
14.32 ℹ ✓ 1534 modules transformed.
15.63 
15.63 <--- Last few GCs --->
15.63 
15.63 [17:0x79dd65c5a000]    14945 ms: Scavenge (interleaved) 1017.4 (1042.5) -> 1017.1 (1047.3) MB, pooled: 0 MB, 5.11 / 0.00 ms  (average mu = 0.881, current mu = 0.454) allocation failure; 
15.63 [17:0x79dd65c5a000]    15187 ms: Mark-Compact (reduce) 1020.3 (1047.3) -> 1019.1 (1043.3) MB, pooled: 0 MB, 218.65 / 0.00 ms  (+ 0.2 ms in 0 steps since start of marking, biggest step 0.0 ms, walltime since start of marking 225 ms) (average mu = 0.749, cu
15.63 
15.63 <--- JS stacktrace --->
15.63 
15.63 FATAL ERROR: Reached heap limit Allocation failed - JavaScript heap out of memory
15.63 ----- Native stack trace -----
15.63 
15.82  ELIFECYCLE  Command failed with exit code 129.
------
Dockerfile:31
--------------------
  29 |     
  30 |     # Build
  31 | >>> RUN pnpm build
  32 |     
  33 |     FROM base AS runner
--------------------
ERROR: failed to solve: process "/bin/sh -c pnpm build" did not complete successfully: exit code: 129

2048MB (failed)

(...)
39.05 PWA v0.21.1
39.05 mode      injectManifest
39.05 format:   es
39.05 precache  510 entries (15400.08 KiB)
39.05 files generated
39.05   .output/public/elk-sw.js
39.07 [nitro] ℹ Building Nuxt Nitro server (preset: node-server)
59.92 
59.92 <--- Last few GCs --->
59.92 
59.92 [17:0x7d04e0c1f000]    59460 ms: Scavenge (reduce) (interleaved) 2027.2 (2073.0) -> 2026.3 (2073.0) MB, pooled: 0 MB, 3.94 / 0.00 ms  (average mu = 0.257, current mu = 0.190) allocation failure; 
59.92 [17:0x7d04e0c1f000]    59479 ms: Mark-Compact (reduce) 2026.4 (2073.0) -> 2015.4 (2069.5) MB, pooled: 0 MB, 17.77 / 0.05 ms  (+ 377.5 ms in 0 steps since start of marking, biggest step 0.0 ms, walltime since start of marking 519 ms) (average mu = 0.340, c
59.92 
59.92 <--- JS stacktrace --->
59.92 
59.92 FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
59.92 ----- Native stack trace -----
59.92 
60.20  ELIFECYCLE  Command failed with exit code 129.
------
Dockerfile:31
--------------------
  29 |     
  30 |     # Build
  31 | >>> RUN pnpm build
  32 |     
  33 |     FROM base AS runner
--------------------
ERROR: failed to solve: process "/bin/sh -c pnpm build" did not complete successfully: exit code: 129

2560MB (OK)

> docker build -t elk .
[+] Building 32.4s (15/19)                                                                           docker:default
 => [internal] load build definition from Dockerfile                                                           0.0s
[+] Building 32.5s (15/19)                                                                           docker:default
 => [internal] load build definition from Dockerfile                                                           0.0s
[+] Building 32.7s (15/19)                                                                           docker:default
 => [internal] load build definition from Dockerfile                                                           0.0s
[+] Building 32.8s (15/19)                                                                           docker:default
 => [internal] load build definition from Dockerfile                                                           0.0s
[+] Building 32.9s (15/19)                                                                           docker:default
[+] Building 87.5s (20/20) FINISHED                                                                  docker:default
 => [internal] load build definition from Dockerfile                                                           0.0s
 => => transferring dockerfile: 1.17kB                                                                         0.0s
 => [internal] load metadata for docker.io/library/node:lts-alpine                                             1.2s 
 => [internal] load .dockerignore                                                                              0.0s 
 => => transferring context: 268B                                                                              0.0s 
 => [internal] load build context                                                                              0.1s 
 => => transferring context: 430.94kB                                                                          0.1s 
 => [base 1/2] FROM docker.io/library/node:lts-alpine@sha256:f2dc6eea95f787e25f173ba9904c9d0647ab2506178c7b5b  0.0s 
 => CACHED [base 2/2] WORKDIR /elk                                                                             0.0s 
 => [builder  1/11] RUN corepack enable                                                                        0.3s 
 => [builder  2/11] RUN apk update                                                                             1.0s  => [builder  3/11] RUN apk add git --no-cache                                                                 0.9s 
 => [builder  4/11] COPY package.json ./                                                                       0.0s  => [builder  5/11] COPY .npmrc ./                                                                             0.0s 
 => [builder  6/11] COPY pnpm-lock.yaml ./                                                                     0.0s  => [builder  7/11] COPY patches ./patches                                                                     0.0s
 => [builder  8/11] RUN pnpm i --frozen-lockfile --ignore-scripts                                             17.8s  => [builder  9/11] COPY . ./                                                                                  1.2s
 => [builder 10/11] RUN pnpm i --frozen-lockfile                                                              10.7s  => [builder 11/11] RUN pnpm build                                                                            51.5s 
 => CACHED [runner 1/2] RUN set -eux;     addgroup -g 911 elk;     adduser -u 911 -D -G elk elk;               0.0s 
 => [runner 2/2] COPY --from=builder /elk/.output ./.output                                                    0.5s 
 => exporting to image                                                                                         0.5s 
 => => exporting layers                                                                                        0.5s 
 => => writing image sha256:691e4cf15e991ca2838c305ea0b3ff6a88f151dd127b9547a742909387459fa4                   0.0s 
 => => naming to docker.io/library/elk

3072MB (OK)

> docker build -t elk .
[+] Building 25.8s (15/19)                                                                           docker:default
 => [internal] load build definition from Dockerfile                                                           0.0s
[+] Building 25.9s (15/19)                                                                           docker:default
 => [internal] load build definition from Dockerfile                                                           0.0s
[+] Building 26.1s (15/19)                                                                           docker:default
 => [internal] load build definition from Dockerfile                                                           0.0s
[+] Building 26.2s (15/19)                                                                           docker:default
 => [internal] load build definition from Dockerfile                                                           0.0s
[+] Building 26.4s (15/19)                                                                           docker:default
[+] Building 78.0s (20/20) FINISHED                                                                  docker:default
 => [internal] load build definition from Dockerfile                                                           0.0s
 => => transferring dockerfile: 1.17kB                                                                         0.0s
 => [internal] load metadata for docker.io/library/node:lts-alpine                                             0.6s 
 => [internal] load .dockerignore                                                                              0.0s 
 => => transferring context: 268B                                                                              0.0s 
 => [base 1/2] FROM docker.io/library/node:lts-alpine@sha256:f2dc6eea95f787e25f173ba9904c9d0647ab2506178c7b5b  0.0s 
 => [internal] load build context                                                                              0.1s 
 => => transferring context: 430.94kB                                                                          0.1s 
 => CACHED [base 2/2] WORKDIR /elk                                                                             0.0s 
 => [builder  1/11] RUN corepack enable                                                                        0.3s 
 => [builder  2/11] RUN apk update                                                                             1.1s  => [builder  3/11] RUN apk add git --no-cache                                                                 0.9s 
 => [builder  4/11] COPY package.json ./                                                                       0.0s  => [builder  5/11] COPY .npmrc ./                                                                             0.1s 
 => [builder  6/11] COPY pnpm-lock.yaml ./                                                                     0.0s  => [builder  7/11] COPY patches ./patches                                                                     0.0s
 => [builder  8/11] RUN pnpm i --frozen-lockfile --ignore-scripts                                             13.3s  => [builder  9/11] COPY . ./                                                                                  1.0s
 => [builder 10/11] RUN pnpm i --frozen-lockfile                                                               9.5s  => [builder 11/11] RUN pnpm build                                                                            48.4s 
 => CACHED [runner 1/2] RUN set -eux;     addgroup -g 911 elk;     adduser -u 911 -D -G elk elk;               0.0s 
 => [runner 2/2] COPY --from=builder /elk/.output ./.output                                                    0.5s 
 => exporting to image                                                                                         0.5s 
 => => exporting layers                                                                                        0.5s 
 => => writing image sha256:23dcce568b3479d90dd059c51f1cc9320f5d6b48b7c7efb5a7369e1919b1137d                   0.0s 
 => => naming to docker.io/library/elk

shuuji3 Jan 19, 2025
Maintainer

Another option might be to build a container in another place like on GitHub Actions and use an external container registry.

tonivade Jan 19, 2025
Author

I tried with 2560 and it worked smoothly. No need to stop any service.

Thank you @shuuji3!

shuuji3 Jan 19, 2025
Maintainer

Welcome! 😃

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Out of memory generating docker image #3142

{{title}}

Replies: 2 comments 4 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

Select a reply

Out of memory generating docker image #3142

tonivade Jan 18, 2025

Replies: 2 comments · 4 replies

shuuji3 Jan 18, 2025 Maintainer

tonivade Jan 19, 2025 Author

shuuji3 Jan 19, 2025 Maintainer

1024MB (failed)

2048MB (failed)

2560MB (OK)

3072MB (OK)

shuuji3 Jan 19, 2025 Maintainer

tonivade Jan 19, 2025 Author

shuuji3 Jan 19, 2025 Maintainer

tonivade
Jan 18, 2025

Replies: 2 comments 4 replies

shuuji3
Jan 18, 2025
Maintainer

tonivade
Jan 19, 2025
Author

shuuji3 Jan 19, 2025
Maintainer

shuuji3 Jan 19, 2025
Maintainer

tonivade Jan 19, 2025
Author

shuuji3 Jan 19, 2025
Maintainer