#2387: Allreduce hashed trace user events at the end of run

[cwschilly]

Fixes #2387

Work in progress

[github-actions]

Pipelines results

PR tests (gcc-12, ubuntu, mpich, verbose, kokkos)

Build for 779e46d (2025-01-13 17:35:24 UTC)

FAILED: src/CMakeFiles/vt.dir/Unity/unity_16_cxx.cxx.o 
/usr/bin/ccache /usr/lib/ccache/g++ -DJSON_USE_IMPLICIT_CONVERSIONS=1 -DKOKKOS_DEPENDENCE -DMAGISTRATE_KOKKOS_ENABLED=1 -DMAGISTRATE_KOKKOS_KERNELS_ENABLED=0 -DVT_NO_COLOR_ENABLED -I/vt/lib/CLI -I/build/vt/release -I/vt/src -I/vt/lib/json/include -I/vt/lib/brotli/c/include -I/vt/lib/libfort/lib -isystem /vt/lib/fmt/include -isystem /vt/lib/EngFormat-Cpp/include -isystem /build/checkpoint/install/include -isystem /build/kokkos/build/install/include -isystem /vt/lib/yaml-cpp/include -O3 -DNDEBUG -Wall -Wextra -Wno-unknown-pragmas -Wnon-virtual-dtor -Wshadow -Wsign-compare -Wsuggest-override -pedantic -ftemplate-backtrace-limit=100 -Werror -std=c++17 -MD -MT src/CMakeFiles/vt.dir/Unity/unity_16_cxx.cxx.o -MF src/CMakeFiles/vt.dir/Unity/unity_16_cxx.cxx.o.d -o src/CMakeFiles/vt.dir/Unity/unity_16_cxx.cxx.o -c /build/vt/src/CMakeFiles/vt.dir/Unity/unity_16_cxx.cxx
In file included from /build/vt/src/CMakeFiles/vt.dir/Unity/unity_16_cxx.cxx:3:
/vt/src/vt/trace/trace.cc: In member function 'void vt::trace::Trace::addHashedEvent(vt::trace::UserEventIDType)':
/vt/src/vt/trace/trace.cc:224:3: error: 'theTrace' was not declared in this scope; did you mean 'Trace'?
  224 |   theTrace()->user_hashed_events_.push_back(event_id);
      |   ^~~~~~~~
      |   Trace
In file included from /build/vt/src/CMakeFiles/vt.dir/Unity/unity_16_cxx.cxx:9:
/vt/src/vt/trace/trace_lite.cc: In member function 'void vt::trace::TraceLite::writeTracesFile(int, bool)':
/vt/src/vt/trace/trace_lite.cc:549:26: error: 'ReduceVecMsg' was not declared in this scope
  549 |   auto msg = makeMessage<ReduceVecMsg<UserEventIDType>>(
      |                          ^~~~~~~~~~~~
/vt/src/vt/trace/trace_lite.cc:549:26: note: suggested alternatives:
In file included from /vt/src/vt/collective/collective_alg.h:53,
                 from /vt/src/vt/trace/trace.cc:44:
/vt/src/vt/collective/reduce/operators/default_msg.h:236:7: note:   'vt::collective::ReduceVecMsg'
  236 | using ReduceVecMsg = reduce::operators::ReduceVecMsg<T>;
      |       ^~~~~~~~~~~~
/vt/src/vt/collective/reduce/operators/default_msg.h:207:8: note:   'vt::collective::reduce::operators::ReduceVecMsg'
  207 | struct ReduceVecMsg : SerializeRequired<
      |        ^~~~~~~~~~~~
/vt/src/vt/trace/trace_lite.cc:549:14: error: parse error in template argument list
  549 |   auto msg = makeMessage<ReduceVecMsg<UserEventIDType>>(
      |              ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/vt/src/vt/trace/trace_lite.cc:550:5: error: 'theTrace' was not declared in this scope; did you mean 'Trace'?
  550 |     theTrace()->user_hashed_events_);
      |     ^~~~~~~~
      |     Trace
/vt/src/vt/trace/trace_lite.cc:552:5: error: 'PlusOp' was not declared in this scope
  552 |     PlusOp<std::vector<UserEvent%0D%0A%0D%0A%0D%0A ==> And there is more. Read log. <==

Build log

---