OOM

[mookim-eth]

OOM after running 7 hours, running with a config having 25 assets

Polled an EVM on chain price for feed AAPL/USD (afcc9a5bb5eefd55e12b6f0b4c8e6bccf72b785134ee232a5d175afd082e8832).
Polled an EVM on chain price for feed AMZN/USD (095e126b86f4f416a21da0c44b997a379e8647514a1b78204ca0a6267801d00f).

<--- Last few GCs --->

[18:0x5d5d2f0] 26436885 ms: Mark-sweep 4024.2 (4139.9) -> 4012.0 (4141.2) MB, 5717.2 / 0.4 ms  (average mu = 0.578, current mu = 0.530) task; scavenge might not succeed
[18:0x5d5d2f0] 26450079 ms: Mark-sweep 4025.7 (4141.4) -> 4013.6 (4142.9) MB, 5694.2 / 0.3 ms  (average mu = 0.574, current mu = 0.568) task; scavenge might not succeed
[18:0x5d5d2f0] 26465084 ms: Mark-sweep 4027.5 (4143.2) -> 4015.3 (4144.4) MB, 6474.9 / 0.3 ms  (average mu = 0.571, current mu = 0.568) task; scavenge might not succeed


<--- JS stacktrace --->

FATAL ERROR: Reached heap limit Allocation failed - JavaScript heap out of memory
 1: 0xb6b850 node::Abort() [node]
 2: 0xa806a6  [node]
 3: 0xd52140 v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, bool) [node]
 4: 0xd524e7 v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, bool) [node]
 5: 0xf2fbe5  [node]
 6: 0xf420cd v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [node]
 7: 0xfb1124 v8::internal::ScavengeJob::Task::RunInternal() [node]
 8: 0xe2187b non-virtual thunk to v8::internal::CancelableTask::Run() [node]
 9: 0xbd6684  [node]
10: 0xbd9aee node::PerIsolatePlatformData::FlushForegroundTasksInternal() [node]
11: 0x1652906  [node]
12: 0x1664e44  [node]
13: 0x165326e uv_run [node]
14: 0xaafa2d node::SpinEventLoop(node::Environment*) [node]
15: 0xbb11f4 node::NodeMainInstance::Run() [node]
16: 0xb26c44 node::LoadSnapshotDataAndRun(node::SnapshotData const**, node::InitializationResult const*) [node]
17: 0xb2a83f node::Start(int, char**) [node]
18: 0x7fa0a93c7d0a __libc_start_main [/lib/x86_64-linux-gnu/libc.so.6]
19: 0xaad7ee _start [node]
Aborted (core dumped)

[jayantk]

thank you for reporting. we'll look into it.

[jayantk]

@mookim-eth I looked through the code for the price pusher and I don't see any obvious memory leaks. Do you mind sharing the configuration and command that you're running so I can attempt to profile?

[mookim-eth]

https://gist.github.com/mookim-eth/ea83f50a3ad0ab7258337eae88c8f709

[ali-bahjati]

Hey @mookim-eth. Sorry on getting back late on this for you. It seems that you are running a compose file that contains the price pusher with it's dependencies (price service and spy). Are you facing this OOM with price service or price pusher?

[mookim-eth]

@ali-bahjati the price pusher

but the pusher seems restarting pretty frequently (like gasPrice<baseFee), so i just treat it works as expected