CMake stops working: "cmake .viewLog" or others says command not found

[borjamunozf]

Brief Issue Summary

Hello.

• C++ real world project, mid-large size company one.
• Ubuntu 20.04 WSL
• It has been happening for multiple releases. Latest one also: 1.19.52
• Bisecting cames up to CMakeTools extension.

Extension seems to stop working randomly. Sometimes it takes a few hours, other it crashes.

NODE_OPTIONS has been added in ~/.bashrc already.

Error messages:

• Any CMake command stops working, so I can't get or execute the log diagnostics or any other.

cmake.logDiagnostics: command not found:
cmake.viewLog command not found`

Workaround
The workaround is to restart vscode and opening the project again.

Any guidance or help how I can provide you more info to help work this out?

CMake Tools Diagnostics

Debug Log

Additional Information

No response

[Amy-Li03]

Hi @borjamunozf , thanks for reporting issue.
Is this stop working issue only repro on your specific machine? or another machine also repro?
What did you do when this issue occurred?
Could you please check if there is an extension you have installed that is causing this issue?

[borjamunozf]

I can't reproduce it other machine, it's coming from a specific developer.

1. Nothing specials, he remarks just using VSCode with C++ extension & CMake. Sometimes it crashes in a few minutes, sometimes takes longer: Go to Definition, navigate through code... He does not identify any specific crash pattern
2. Bisection procedure identified the CMake Extension as the faulty one.

I'm thinking I'll try to debug the extension live perhaps and see where it breaks when it fails.
I'll come back to you with more results.

[Amy-Li03]

Hi @borjamunozf , thanks for your reply!
We are very happy that you are debugging the extension to investigate this issue, happy coding!

[borjamunozf]

Hello! Got this error with a new developer / machine:

1. The extension goes in a Remote unexpectedly loop crash when trying to finish the Configuration Step. If we run any other command, tis says command not found.
2. If we disable the loadCompileCommands setting and set it as false, this crash does not happen.
3. Interesting enough is that launching the CMakeTools extension in debug mode into the extension host this crash is not able to be reproduced, so I cannot get any insights at all.

More info:

• Vscode 1.99.3
• Windows 10.0.26100
• NodeJS 20.18.3
• 48GB RAM assigned to WSL
• Crashes in dmesg
• Extension version 1.20.53
• The compile commands is similar and from the same project I shared in CompilationDatabase - performance bottleneck for mid-large C++ projects (shlex) #4283

Developer logs reflects what I mention after the last "Configuring done". This is where I have been seeing huge performance problems with mid-large compile_commands.json files #4283 and probably this triggers side effects and weird crashes.

dmesg snippet with faal signal 6

[Tue May  6 11:31:40 2025] potentially unexpected fatal signal 6.
[Tue May  6 11:31:40 2025] CPU: 9 PID: 18353 Comm: node Not tainted 5.15.167.4.8-WSL2-whatever+ #1
[Tue May  6 11:31:40 2025] RIP: 0033:0x7f8dd5bd49fc
[Tue May  6 11:31:40 2025] Code: 41 89 c5 41 f7 dd eb 80 66 0f 1f 44 00 00 b8 ba 00 00 00 0f 05 89 c5 e8 52 56 05 00 44 89 e2 89 ee 89 c7 b8 ea 00 00 00 0f 05 <41> 89 c5 41 f7 dd 3d 00 f0 ff ff b8 00 00 00 00 44 0f 46 e8 e9 6d
[Tue May  6 11:31:40 2025] RSP: 002b:00007ffcab6dc110 EFLAGS: 00000246 ORIG_RAX: 00000000000000ea
[Tue May  6 11:31:40 2025] RAX: 0000000000000000 RBX: 00007f8dd5b39840 RCX: 00007f8dd5bd49fc
[Tue May  6 11:31:40 2025] RDX: 0000000000000006 RSI: 00000000000043f7 RDI: 00000000000043f7
[Tue May  6 11:31:40 2025] RBP: 00000000000043f7 R08: 00007ffcab6dc1e0 R09: 000000007fffffff
[Tue May  6 11:31:40 2025] R10: 0000000000000008 R11: 0000000000000246 R12: 0000000000000006
[Tue May  6 11:31:40 2025] R13: 0000000000000016 R14: 0000000002e21bc0 R15: 0000000015ba8830
[Tue May  6 11:31:40 2025] FS:  00007f8dd5b39840 GS:  0000000000000000
[Tue May  6 11:33:39 2025] potentially unexpected fatal signal 6.
[Tue May  6 11:33:39 2025] CPU: 3 PID: 21800 Comm: node Not tainted 5.15.167.4.8-WSL2-whatever #1
[Tue May  6 11:33:39 2025] RIP: 0033:0x7f5097d209fc
[Tue May  6 11:33:39 2025] Code: 41 89 c5 41 f7 dd eb 80 66 0f 1f 44 00 00 b8 ba 00 00 00 0f 05 89 c5 e8 52 56 05 00 44 89 e2 89 ee 89 c7 b8 ea 00 00 00 0f 05 <41> 89 c5 41 f7 dd 3d 00 f0 ff ff b8 00 00 00 00 44 0f 46 e8 e9 6d
[Tue May  6 11:33:39 2025] RSP: 002b:00007ffcd2c5de50 EFLAGS: 00000246 ORIG_RAX: 00000000000000ea
[Tue May  6 11:33:39 2025] RAX: 0000000000000000 RBX: 00007f5097c85840 RCX: 00007f5097d209fc
[Tue May  6 11:33:39 2025] RDX: 0000000000000006 RSI: 000000000000516a RDI: 000000000000516a
[Tue May  6 11:33:39 2025] RBP: 000000000000516a R08: 00007ffcd2c5df20 R09: 000000007fffffff
[Tue May  6 11:33:39 2025] R10: 0000000000000008 R11: 0000000000000246 R12: 0000000000000006
[Tue May  6 11:33:39 2025] R13: 0000000000000016 R14: 0000000002e21bc0 R15: 000000003e737830
[Tue May  6 11:33:39 2025] FS:  00007f5097c85840 GS:  0000000000000000
[Tue May  6 11:35:42 2025] potentially unexpected fatal signal 6.
[Tue May  6 11:35:42 2025] CPU: 16 PID: 25206 Comm: node Not tainted 5.15.167.4.8-WSL2-whatever #1
[Tue May  6 11:35:42 2025] RIP: 0033:0x7f3bcd50b9fc
[Tue May  6 11:35:42 2025] Code: 41 89 c5 41 f7 dd eb 80 66 0f 1f 44 00 00 b8 ba 00 00 00 0f 05 89 c5 e8 52 56 05 00 44 89 e2 89 ee 89 c7 b8 ea 00 00 00 0f 05 <41> 89 c5 41 f7 dd 3d 00 f0 ff ff b8 00 00 00 00 44 0f 46 e8 e9 6d
[Tue May  6 11:35:42 2025] RSP: 002b:00007fff7e0d30d0 EFLAGS: 00000246 ORIG_RAX: 00000000000000ea
[Tue May  6 11:35:42 2025] RAX: 0000000000000000 RBX: 00007f3bcd470840 RCX: 00007f3bcd50b9fc
[Tue May  6 11:35:42 2025] RDX: 0000000000000006 RSI: 0000000000005eb5 RDI: 0000000000005eb5
[Tue May  6 11:35:42 2025] RBP: 0000000000005eb5 R08: 00007fff7e0d31a0 R09: 000000007fffffff
[Tue May  6 11:35:42 2025] R10: 0000000000000008 R11: 0000000000000246 R12: 0000000000000006
[Tue May  6 11:35:42 2025] R13: 0000000000000016 R14: 0000000002e21bc0 R15: 0000000010dd9830
[Tue May  6 11:35:42 2025] FS:  00007f3bcd470840 GS:  0000000000000000
[Tue May  6 11:45:36 2025] mini_init (282): drop_caches: 1

Crash

What else I can do to trace this? It seems like a OOM by the extension, not sure.

[borjamunozf]

More info with strace confirms the heap issue.

FATAL ERROR: Reached heap limit "

protect(0x3137cf7c0000, 262144, PROT_READ|PROT_WRITE) = 0
futex(0x421f76d0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f7680, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f76d0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f7680, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f76d0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f7680, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f76d4, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f7680, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f76d4, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f7680, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f76d4, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f7680, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f76d0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f7680, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f76d0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f7680, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f76d0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x421f7680, FUTEX_WAKE_PRIVATE, 1) = 1
getpid() = 13126
write(2, "\n<--- Last few GCs --->\n\n[13126:"..., 409) = 409
write(2, "\n<--- JS stacktrace --->\n\n", 26) = 26
write(2, "FATAL ERROR: Reached heap limit "..., 82) = 82
write(2, "----- Native stack trace -----\n\n", 32) = 32
futex(0x7f33c78df210, FUTEX_WAKE_PRIVATE, 2147483647) = 0
write(2, " 1: 0xb8d11b node::OOMErrorHandl"..., 152) = 152
write(2, " 2: 0xf01b70 v8::Utils::ReportOO"..., 182) = 182
write(2, " 3: 0xf01e57 v8::internal::V8::F"..., 196) = 196
write(2, " 4: 0x1113aa5 [/home/borjamf/.v"..., 96) = 96
write(2, " 5: 0x112b928 v8::internal::Heap"..., 221) = 221
write(2, " 6: 0x1101a41 v8::internal::Heap"..., 260) = 260
write(2, " 7: 0x1102bd5 v8::internal::Heap"..., 261) = 261
write(2, " 8: 0x10e0226 v8::internal::Fact"..., 236) = 236
write(2, " 9: 0x153c086 v8::internal::Runt"..., 188) = 188
write(2, "10: 0x7f33bfed9ef6 \n", 20) = 20
rt_sigprocmask(SIG_UNBLOCK, [ABRT], NULL, 8) = 0
gettid() = 13126
getpid() = 13126
tgkill(13126, 13126, SIGABRT) = 0
--- SIGABRT {si_signo=SIGABRT, si_code=SI_TKILL, si_pid=13126, si_uid=1000} ---
+++ killed by SIGABRT +++

With extra info the Extension Remote Host

 /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::base::OS::Allocate(void*, unsigned long, unsigned long, v8::base::OS::MemoryPermission)+0x9c) [0x1d975cc]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::VirtualMemory::VirtualMemory(v8::PageAllocator*, unsigned long, void*, unsigned long, v8::internal::JitPermission)+0x83) [0x11a8343]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::MemoryAllocator::AllocateAlignedMemory(unsigned long, unsigned long, unsigned long, v8::internal::AllocationSpace, v8::internal::Executability, void*, v8::internal::VirtualMemory*)+0x4f) [0xd7c86f]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::MemoryAllocator::AllocateUninitializedChunkAt(v8::internal::BaseSpace*, unsigned long, v8::internal::Executability, unsigned long, v8::internal::PageSize)+0xa9) [0xd7cb19]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::MemoryAllocator::AllocatePage(v8::internal::MemoryAllocator::AllocationMode, v8::internal::Space*, v8::internal::Executability)+0x6b) [0xd7d3ab]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::CompactionSpace::TryExpandImpl()+0x2c) [0xd9597c]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::PagedSpaceBase::RawRefillLabMain(int, v8::internal::AllocationOrigin) [clone .part.0]+0x34e) [0xd94c3e]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::EvacuateNewSpaceVisitor::Visit(v8::internal::HeapObject, int)+0xca) [0xd5071a]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Evacuator::RawEvacuatePage(v8::internal::MemoryChunk*, long*)+0xd06) [0xd5e466]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Evacuator::EvacuatePage(v8::internal::MemoryChunk*)+0x73) [0xd5ebd3]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::PageEvacuationJob::Run(v8::JobDelegate*)+0x127) [0xd5ef07]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::platform::DefaultJobState::Join()+0x325) [0x197dc65]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::platform::DefaultJobHandle::Join()+0x13) [0x197de33]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::MarkCompactCollector::EvacuatePagesInParallel()+0x1352) [0xd62682]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::MarkCompactCollector::Evacuate()+0x194) [0xd771d4]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::MarkCompactCollector::CollectGarbage()+0x5e) [0xd77d0e]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Heap::MarkCompact()+0x116) [0xd25bf6]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Heap::PerformGarbageCollection(v8::internal::GarbageCollector, v8::internal::GarbageCollectionReason, char const*)+0xaed) [0xd2b24d]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags)+0x29c) [0xd2b73c]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::HeapAllocator::AllocateRawWithLightRetrySlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment)+0x751) [0xd01a41]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::HeapAllocator::AllocateRawWithRetryOrFailSlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment)+0x25) [0xd02bd5]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Factory::NewFillerObject(int, v8::internal::AllocationAlignment, v8::internal::AllocationType, v8::internal::AllocationOrigin)+0xf6) [0xce0226]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Runtime_AllocateInYoungGeneration(int, unsigned long*, v8::internal::Isolate*)+0xa6) [0x113c086]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node() [0x1575ef6]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node() [0x157664f]
 > unexpected_backtracing_error [0x7fd688b21fa6]
19909 20:31:09 mmap(0x88e7440000, 520192, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS|MAP_NORESERVE, -1, 0) = 0x88e7440000 <0.000327>
 > /usr/lib/x86_64-linux-gnu/libc.so.6(__mmap+0x17) [0x11ea27]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::base::OS::Allocate(void*, unsigned long, unsigned long, v8::base::OS::MemoryPermission)+0x9c) [0x1d975cc]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::VirtualMemory::VirtualMemory(v8::PageAllocator*, unsigned long, void*, unsigned long, v8::internal::JitPermission)+0x83) [0x11a8343]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::MemoryAllocator::AllocateAlignedMemory(unsigned long, unsigned long, unsigned long, v8::internal::AllocationSpace, v8::internal::Executability, void*, v8::internal::VirtualMemory*)+0x4f) [0xd7c86f]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::MemoryAllocator::AllocateUninitializedChunkAt(v8::internal::BaseSpace*, unsigned long, v8::internal::Executability, unsigned long, v8::internal::PageSize)+0xa9) [0xd7cb19]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::MemoryAllocator::AllocatePage(v8::internal::MemoryAllocator::AllocationMode, v8::internal::Space*, v8::internal::Executability)+0x6b) [0xd7d3ab]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::CompactionSpace::TryExpandImpl()+0x2c) [0xd9597c]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::PagedSpaceBase::RawRefillLabMain(int, v8::internal::AllocationOrigin) [clone .part.0]+0x34e) [0xd94c3e]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::EvacuateNewSpaceVisitor::Visit(v8::internal::HeapObject, int)+0xca) [0xd5071a]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Evacuator::RawEvacuatePage(v8::internal::MemoryChunk*, long*)+0xd06) [0xd5e466]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Evacuator::EvacuatePage(v8::internal::MemoryChunk*)+0x73) [0xd5ebd3]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::PageEvacuationJob::Run(v8::JobDelegate*)+0x127) [0xd5ef07]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::platform::DefaultJobState::Join()+0x325) [0x197dc65]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::platform::DefaultJobHandle::Join()+0x13) [0x197de33]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::MarkCompactCollector::EvacuatePagesInParallel()+0x1352) [0xd62682]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::MarkCompactCollector::Evacuate()+0x194) [0xd771d4]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::MarkCompactCollector::CollectGarbage()+0x5e) [0xd77d0e]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Heap::MarkCompact()+0x116) [0xd25bf6]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Heap::PerformGarbageCollection(v8::internal::GarbageCollector, v8::internal::GarbageCollectionReason, char const*)+0xaed) [0xd2b24d]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags)+0x29c) [0xd2b73c]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::HeapAllocator::AllocateRawWithLightRetrySlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment)+0x751) [0xd01a41]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::HeapAllocator::AllocateRawWithRetryOrFailSlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment)+0x25) [0xd02bd5]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Factory::NewFillerObject(int, v8::internal::AllocationAlignment, v8::internal::AllocationType, v8::internal::AllocationOrigin)+0xf6) [0xce0226]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Runtime_AllocateInYoungGeneration(int, unsigned long*, v8::internal::Isolate*)+0xa6) [0x113c086]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node() [0x1575ef6]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node() [0x157664f]
 > unexpected_backtracing_error [0x7fd688b21fa6]
19909 20:31:09 --- SIGABRT {si_signo=SIGABRT, si_code=SI_TKILL, si_pid=19909, si_uid=1000} ---
 > /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c) [0x969fc]
 > /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16) [0x42476]
 > /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3) [0x287f3]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(node::OOMErrorHandler(char const*, v8::OOMDetails const&)+0x13b) [0x78d138]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, v8::OOMDetails const&)+0x20) [0xb01b70]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, v8::OOMDetails const&)+0x277) [0xb01e57]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Heap::FatalProcessOutOfMemory(char const*)+0x15) [0xd13aa5]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags)+0x488) [0xd2b928]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::HeapAllocator::AllocateRawWithLightRetrySlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment)+0x751) [0xd01a41]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::HeapAllocator::AllocateRawWithRetryOrFailSlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment)+0x25) [0xd02bd5]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Factory::NewFillerObject(int, v8::internal::AllocationAlignment, v8::internal::AllocationType, v8::internal::AllocationOrigin)+0xf6) [0xce0226]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node(v8::internal::Runtime_AllocateInYoungGeneration(int, unsigned long*, v8::internal::Isolate*)+0xa6) [0x113c086]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node() [0x1575ef6]
 > /home/borjamf/.vscode-server/bin/17baf841131aa23349f217ca7c570c76ee87b957/node() [0x157664f]
 > unexpected_backtracing_error [0x7fd688b21fa6]
19916 20:31:09 +++ killed by SIGABRT +++

[borjamunozf]

Increasing the max-old-space-size to 11GB seems to fix the problem.

My guess is that as the CompileDatabase that handles the Map<String, CompileCommand> (storing ~22000 elements) is filling up all the heap, and as it's seems to be required along for at least running a compile file.

[Amy-Li03]

@borjamunozf Thank you for such detailed information!
@gcampbell-msft Could you please help take a look at this one?

[borjamunozf]

Continuing the investigation:

• The shlex.split called from infoFileByPath allocates to heap roughly ~4GB extra to the 8.9GB overall. A more or less direct straightforward is to replace the naive string concatenation as I mentioned here CompilationDatabase - performance bottleneck for mid-large C++ projects (shlex) #4283
• However, there's still 5GB more or less that it's being allocated before the CompilationDatabase. It seems that is coming from here:

retc = await this.doConfigure(expanded_flags, trigger, consumer, showCommandOnly, defaultPresetName, presetOverride, options, debuggerInformation);

I observe that the cache takes ~6000 elements plus ~4500 files for CMakeLists.txt, so my guess is the cmakeFileApiDriver is leaking memory somewhere, probably from the proc.ts calls.

My main bet righ now is that the other leak is coming from the proc.execute().
The accumulate function closure with concat string is suspicious, isnt it :)?

vscode-cmake-tools/src/proc.ts

Lines 203 to 298 in c24739c

	const accumulate = (str1: string, str2: string) => {
	try {
	return str1 + str2;
	} catch {
	// If the resulting string is longer than can be represented by `string.length`, an exception will be thrown.
	// Don't accumulate any more content at this point.
	return str1;
	}
	};
	const result = new Promise<ExecutionResult>(resolve => {
	let stdout_acc = '';
	let line_acc = '';
	let stderr_acc = '';
	let stderr_line_acc = '';
	child?.on('error', err => {
	log.warning(localize({key: 'process.error', comment: ['The space before and after all placeholders should be preserved.']}, 'The command: {0} failed with error: {1}', `${cmdstr}`, `${err}`));
	});
	child?.on('exit', (code, signal) => {
	if (code !== 0) {
	if (signal !== null && signal !== undefined) {
	log.warning(localize({key: 'process.exit.with.signal', comment: ['The space before and after all placeholders should be preserved.']}, 'The command: {0} exited with code: {1} and signal: {2}', `${cmdstr}`, `${code}`, `${signal}`));
	} else {
	log.warning(localize({key: 'process.exit', comment: ['The space before and after all placeholders should be preserved.']}, 'The command: {0} exited with code: {1}', `${cmdstr}`, `${code}`));
	}
	if (options?.showOutputOnError) {
	if (stdout_acc) {
	const output = stdout_acc.trimEnd().replace(/\n/g, '\n\t');
	log.warning(localize('process.exit.stdout', 'Command output on standard out: {0}', `${output}`));
	}
	if (stderr_acc) {
	const output = stderr_acc.trimEnd().replace(/\n/g, '\n\t');
	log.warning(localize('process.exit.stderr', 'Command output on standard error: {0}', `${output}`));
	}
	}
	}
	});
	child?.stdout?.on('data', (data: Uint8Array) => {
	rollbar.invoke(localize('processing.data.event.stdout', 'Processing {0} event from proc stdout', "\"data\""), { data, command, args }, () => {
	const str = iconv.decode(Buffer.from(data), encoding);
	const lines = str.split('\n').map(l => l.endsWith('\r') ? l.substr(0, l.length - 1) : l);
	while (lines.length > 1) {
	line_acc = accumulate(line_acc, lines[0]);
	if (outputConsumer) {
	outputConsumer.output(line_acc);
	} else if (util.isTestMode()) {
	log.info(line_acc);
	}
	line_acc = '';
	// Erase the first line from the list
	lines.splice(0, 1);
	}
	console.assert(lines.length, 'Invalid lines', JSON.stringify(lines));
	line_acc = accumulate(line_acc, lines[0]);
	stdout_acc = accumulate(stdout_acc, str);
	});
	});
	child?.stderr?.on('data', (data: Uint8Array) => {
	rollbar.invoke(localize('processing.data.event.stderr', 'Processing {0} event from proc stderr', "\"data\""), { data, command, args }, () => {
	const str = iconv.decode(Buffer.from(data), encoding);
	const lines = str.split('\n').map(l => l.endsWith('\r') ? l.substr(0, l.length - 1) : l);
	while (lines.length > 1) {
	stderr_line_acc = accumulate(stderr_line_acc, lines[0]);
	if (outputConsumer) {
	outputConsumer.error(stderr_line_acc);
	} else if (util.isTestMode() && stderr_line_acc) {
	log.info(stderr_line_acc);
	}
	stderr_line_acc = '';
	// Erase the first line from the list
	lines.splice(0, 1);
	}
	console.assert(lines.length, 'Invalid lines', JSON.stringify(lines));
	stderr_line_acc = accumulate(stderr_line_acc, lines[0]);
	stderr_acc = accumulate(stderr_acc, str);
	});
	});
	// The 'close' event is emitted after a process has ended and the stdio streams of a child process have been closed.
	// This is distinct from the 'exit' event, since multiple processes might share the same stdio streams.
	// The 'close' event will always emit after 'exit' was already emitted, or 'error' if the child failed to spawn.
	child?.on('close', retc => {
	try {
	rollbar.invoke(localize('resolving.close.event', 'Resolving process on {0} event', "\"close\""), { line_acc, stderr_line_acc, command, retc }, () => {
	if (line_acc && outputConsumer) {
	outputConsumer.output(line_acc);
	}
	if (stderr_line_acc && outputConsumer) {
	outputConsumer.error(stderr_line_acc);
	}
	resolve({ retc, stdout: stdout_acc, stderr: stderr_acc });
	});
	} catch (e: any) {
	resolve({ retc, stdout: stdout_acc, stderr: stderr_acc });
	}
	});
	});

[Amy-Li03]

@borjamunozf thanks for the investigation! Please @gcampbell-msft help handle this one.