no function clause matching in Commanded.Commands.Dispatcher.telemetry_stop/3

[yordis]

We are getting the following issue:

FunctionClauseError: no function clause matching in Commanded.Commands.Dispatcher.telemetry_stop/3
  File "lib/commanded/commands/dispatcher.ex", line 214, in Commanded.Commands.Dispatcher.telemetry_stop/3
  File "lib/commanded/commands/dispatcher.ex", line 59, in Commanded.Commands.Dispatcher.dispatch/1
  File "lib/myapp/balances_updater.ex", line 25, in MyApp.BalancesUpdater.handle_message/3
  File "lib/broadway/topology/processor_stage.ex", line 159, in anonymous fn/6 in Broadway.Topology.ProcessorStage.handle_messages/4
  File "/opt/app/deps/telemetry/src/telemetry.erl", line 320, in :telemetry.span/3
  File "lib/broadway/topology/processor_stage.ex", line 146, in Broadway.Topology.ProcessorStage.handle_messages/4
  File "lib/broadway/topology/processor_stage.ex", line 65, in anonymous fn/2 in Broadway.Topology.ProcessorStage.handle_events/3
  File "/opt/app/deps/telemetry/src/telemetry.erl", line 320, in :telemetry.span/3

Arguments:

arg0: {:error, :too_many_attempts}
arg1: -576084594885863171
arg2: %{application: MyApp, error: nil, execution_context: %Commanded.Aggregates.ExecutionContext{command: %MyApp.UpdateBalances{...}}

[pirvudoru]

Did you figure out the issue?

Saw the error too and came here searching for an answer.

Context:
Running a migration job that backfills events into the event store.
Have a custom Aggregate Lifespan that kills the aggregate after command execution.
Am running a distributed elixir system -- but seeing the error when running locally with a single node in the cluster. Haven't tried with multiple nodes.
Retried the command dispatch with the same parameters and it worked ok. Retried the job and it fails at different stages each time.

Tried increasing the lifespan of the aggregate to 10 seconds, and now it does not show a failure with that error, but stops without finishing the job and not displaying any error....

Some debug logs at the moment of the failure:

{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Ecto.Adapters.SQL.log/4","file_name":"lib/ecto/adapters/sql.ex","line":1117},"message":"QUERY OK source=\"cars\" db=9.4ms\nSELECT c0.\"id\", c0.\"uuid\", c0.\"vin\", c0.\"plate_number\", c0.\"is_active\", c0.\"session_token\", c0.\"inserted_at\", c0.\"updated_at\", c0.\"id\" FROM \"cars\" AS c0 WHERE (c0.\"session_token\" = $1) ORDER BY c0.\"id\" LIMIT $2 [<<45, 221, 33, 238, 21, 180, 73, 111, 141, 42, 142, 139, 133, 8, 127, 15>>, 500]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.140Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Commanded.Aggregates.Supervisor.open_aggregate/3","file_name":"lib/commanded/aggregates/supervisor.ex","line":29},"message":"Locating aggregate process for `MyApp.Estate.Aggregates.Car` with UUID \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.140Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_call] registering {MyApp.CommandedApplication, MyApp.Estate.Aggregates.Car, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} as process started by Elixir.DynamicSupervisor.start_child/2 with args [MyApp.CommandedApplication.Commanded.Aggregates.Supervisor, {Commanded.Aggregates.Aggregate, [application: MyApp.CommandedApplication, aggregate_module: MyApp.Estate.Aggregates.Car, aggregate_uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"]}]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.141Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] starting {MyApp.CommandedApplication, MyApp.Estate.Aggregates.Car, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.141Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] started {MyApp.CommandedApplication, MyApp.Estate.Aggregates.Car, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.141Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.7545.0>","method_name":"Elixir.Commanded.Aggregates.Aggregate.execute_command/2","file_name":"lib/commanded/aggregates/aggregate.ex","line":470},"message":"MyApp.Estate.Aggregates.Car<7e809295-fafe-4362-a062-22ecdbb4dc4c@0> executing command: %MyApp.Estate.Commands.AddCar{customer_uuid: \"2ddd21ee-15b4-496f-8d2a-8e8b85087f0f\", identifier: \"WF0AXXGCDA3L30359\", uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"}","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.143Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.848.0>","method_name":"Elixir.EventStore.Notifications.Listener.handle_info/2","file_name":"lib/event_store/notifications/listener.ex","line":36},"message":"Listener received notification on channel \"public.events\" with payload: \"$all,0,3286,3286\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.150Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.848.0>","method_name":"Elixir.EventStore.Notifications.Listener.handle_info/2","file_name":"lib/event_store/notifications/listener.ex","line":36},"message":"Listener received notification on channel \"public.events\" with payload: \"7e809295-fafe-4362-a062-22ecdbb4dc4c,1963,1,1\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.150Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.7545.0>","method_name":"Elixir.EventStore.Storage.Appender.append/4","file_name":"lib/event_store/storage/appender.ex","line":28},"message":"Appended 1 event(s) to stream \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.151Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_monitor] {MyApp.CommandedApplication, MyApp.Estate.Aggregates.Car, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} is down: :normal","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.151Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Commanded.Aggregates.Supervisor.open_aggregate/3","file_name":"lib/commanded/aggregates/supervisor.ex","line":29},"message":"Locating aggregate process for `MyApp.Estate.Aggregates.Car` with UUID \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.151Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_call] registering {MyApp.CommandedApplication, MyApp.Estate.Aggregates.Car, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} as process started by Elixir.DynamicSupervisor.start_child/2 with args [MyApp.CommandedApplication.Commanded.Aggregates.Supervisor, {Commanded.Aggregates.Aggregate, [application: MyApp.CommandedApplication, aggregate_module: MyApp.Estate.Aggregates.Car, aggregate_uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"]}]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.152Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] starting {MyApp.CommandedApplication, MyApp.Estate.Aggregates.Car, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.152Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] started {MyApp.CommandedApplication, MyApp.Estate.Aggregates.Car, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.152Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.7547.0>","method_name":"Elixir.Commanded.Aggregates.Aggregate.execute_command/2","file_name":"lib/commanded/aggregates/aggregate.ex","line":470},"message":"MyApp.Estate.Aggregates.Car<7e809295-fafe-4362-a062-22ecdbb4dc4c@1> executing command: %MyApp.Estate.Commands.AddCarInfo{customer_uuid: \"2ddd21ee-15b4-496f-8d2a-8e8b85087f0f\", plate_number: \"AB98ADL\", uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\", vin: \"WF0AXXGCDA3L30359\"}","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.160Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.848.0>","method_name":"Elixir.EventStore.Notifications.Listener.handle_info/2","file_name":"lib/event_store/notifications/listener.ex","line":36},"message":"Listener received notification on channel \"public.events\" with payload: \"$all,0,3287,3287\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.167Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.7547.0>","method_name":"Elixir.EventStore.Storage.Appender.append/4","file_name":"lib/event_store/storage/appender.ex","line":28},"message":"Appended 1 event(s) to stream \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.167Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.848.0>","method_name":"Elixir.EventStore.Notifications.Listener.handle_info/2","file_name":"lib/event_store/notifications/listener.ex","line":36},"message":"Listener received notification on channel \"public.events\" with payload: \"7e809295-fafe-4362-a062-22ecdbb4dc4c,1963,2,2\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.167Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_monitor] {MyApp.CommandedApplication, MyApp.Estate.Aggregates.Car, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} is down: :normal","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.167Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Ecto.Adapters.SQL.log/4","file_name":"lib/ecto/adapters/sql.ex","line":1117},"message":"QUERY OK source=\"rca_quote_requests\" db=0.5ms\nSELECT r0.\"id\", r0.\"duration\", r0.\"start_from\", r0.\"person_type\", r0.\"unique_identification_number\", r0.\"email\", r0.\"mobile_phone_number\", r0.\"street_name\", r0.\"street_number\", r0.\"postal_code\", r0.\"first_name\", r0.\"last_name\", r0.\"state_employee\", r0.\"national_id_card_series\", r0.\"national_id_card_number\", r0.\"date_of_permit\", r0.\"company_name\", r0.\"plate_number\", r0.\"vin\", r0.\"id_card\", r0.\"fabrication_year\", r0.\"cylindrical_capacity\", r0.\"power\", r0.\"mass\", r0.\"number_of_seats\", r0.\"fuel_type\", r0.\"registration_type\", r0.\"used_for\", r0.\"direct_payment\", r0.\"model_name\", r0.\"car_uuid\", r0.\"car_id\", r0.\"town_id\", r0.\"category_id\", r0.\"subcategory_id\", r0.\"brand_id\", r0.\"model_id\", r0.\"leasing_company_id\", r0.\"inserted_at\", r0.\"updated_at\" FROM \"rca_quote_requests\" AS r0 WHERE (r0.\"car_id\" = $1) ORDER BY r0.\"id\" [1087]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.168Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Commanded.Aggregates.Supervisor.open_aggregate/3","file_name":"lib/commanded/aggregates/supervisor.ex","line":29},"message":"Locating aggregate process for `MyApp.Rca.Aggregates.Rca` with UUID \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.168Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_call] registering {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} as process started by Elixir.DynamicSupervisor.start_child/2 with args [MyApp.CommandedApplication.Commanded.Aggregates.Supervisor, {Commanded.Aggregates.Aggregate, [application: MyApp.CommandedApplication, aggregate_module: MyApp.Rca.Aggregates.Rca, aggregate_uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"]}]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.168Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] starting {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.168Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] started {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.168Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.7549.0>","method_name":"Elixir.Commanded.Aggregates.Aggregate.execute_command/2","file_name":"lib/commanded/aggregates/aggregate.ex","line":470},"message":"MyApp.Rca.Aggregates.Rca<7e809295-fafe-4362-a062-22ecdbb4dc4c@2> executing command: %MyApp.Rca.Commands.ChangeEmail{car_uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\", email: \"test@example.com\"}","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.175Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.7549.0>","method_name":"Elixir.Ecto.Adapters.SQL.log/4","file_name":"lib/ecto/adapters/sql.ex","line":1117},"message":"QUERY OK db=4.2ms idle=1084.7ms\nINSERT INTO \"pii_kvps\" AS p0 (\"customer_uuid\",\"key\",\"value\") VALUES ($1,$2,$3) ON CONFLICT (\"customer_uuid\",\"key\") DO UPDATE SET \"value\" = $4 RETURNING \"id\" [<<45, 221, 33, 238, 21, 180, 73, 111, 141, 42, 142, 139, 133, 8, 127, 15>>, \"email-7e809295-fafe-4362-a062-22ecdbb4dc4c\", \"test@example.com\", \"test@example.com\"]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.180Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.7549.0>","method_name":"Elixir.EventStore.Storage.Appender.append/4","file_name":"lib/event_store/storage/appender.ex","line":28},"message":"Appended 1 event(s) to stream \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.193Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.848.0>","method_name":"Elixir.EventStore.Notifications.Listener.handle_info/2","file_name":"lib/event_store/notifications/listener.ex","line":36},"message":"Listener received notification on channel \"public.events\" with payload: \"$all,0,3288,3288\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.193Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.848.0>","method_name":"Elixir.EventStore.Notifications.Listener.handle_info/2","file_name":"lib/event_store/notifications/listener.ex","line":36},"message":"Listener received notification on channel \"public.events\" with payload: \"7e809295-fafe-4362-a062-22ecdbb4dc4c,1963,3,3\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.193Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Ecto.Adapters.SQL.log/4","file_name":"lib/ecto/adapters/sql.ex","line":1117},"message":"QUERY OK source=\"rca_insurances\" db=0.4ms\nSELECT r0.\"id\", r0.\"uuid\", r0.\"start_at\", r0.\"end_at\", r0.\"insurer\", r0.\"number\", r0.\"series\", r0.\"price\", r0.\"period\", r0.\"direct_payment\", r0.\"identifier\", r0.\"file_path\", r0.\"data_exchange_id\", r0.\"data_exchange_payment_id\", r0.\"status\", r0.\"car_uuid\", r0.\"car_id\", r0.\"quote_id\", r0.\"inserted_at\", r0.\"updated_at\", r0.\"id\" FROM \"rca_insurances\" AS r0 WHERE (r0.\"car_id\" = $1) ORDER BY r0.\"id\" LIMIT $2 [1087, 500]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.194Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Commanded.Aggregates.Supervisor.open_aggregate/3","file_name":"lib/commanded/aggregates/supervisor.ex","line":29},"message":"Locating aggregate process for `MyApp.Rca.Aggregates.Rca` with UUID \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.195Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_call] registering {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} as process started by Elixir.DynamicSupervisor.start_child/2 with args [MyApp.CommandedApplication.Commanded.Aggregates.Supervisor, {Commanded.Aggregates.Aggregate, [application: MyApp.CommandedApplication, aggregate_module: MyApp.Rca.Aggregates.Rca, aggregate_uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"]}]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.195Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] found {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} already registered on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.195Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Commanded.Aggregates.Supervisor.open_aggregate/3","file_name":"lib/commanded/aggregates/supervisor.ex","line":29},"message":"Locating aggregate process for `MyApp.Rca.Aggregates.Rca` with UUID \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.195Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_call] registering {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} as process started by Elixir.DynamicSupervisor.start_child/2 with args [MyApp.CommandedApplication.Commanded.Aggregates.Supervisor, {Commanded.Aggregates.Aggregate, [application: MyApp.CommandedApplication, aggregate_module: MyApp.Rca.Aggregates.Rca, aggregate_uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"]}]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.196Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] found {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} already registered on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.196Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Commanded.Aggregates.Supervisor.open_aggregate/3","file_name":"lib/commanded/aggregates/supervisor.ex","line":29},"message":"Locating aggregate process for `MyApp.Rca.Aggregates.Rca` with UUID \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.196Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_call] registering {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} as process started by Elixir.DynamicSupervisor.start_child/2 with args [MyApp.CommandedApplication.Commanded.Aggregates.Supervisor, {Commanded.Aggregates.Aggregate, [application: MyApp.CommandedApplication, aggregate_module: MyApp.Rca.Aggregates.Rca, aggregate_uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"]}]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.196Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] found {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} already registered on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.196Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Commanded.Aggregates.Supervisor.open_aggregate/3","file_name":"lib/commanded/aggregates/supervisor.ex","line":29},"message":"Locating aggregate process for `MyApp.Rca.Aggregates.Rca` with UUID \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.196Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_call] registering {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} as process started by Elixir.DynamicSupervisor.start_child/2 with args [MyApp.CommandedApplication.Commanded.Aggregates.Supervisor, {Commanded.Aggregates.Aggregate, [application: MyApp.CommandedApplication, aggregate_module: MyApp.Rca.Aggregates.Rca, aggregate_uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"]}]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.196Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] found {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} already registered on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.196Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Commanded.Aggregates.Supervisor.open_aggregate/3","file_name":"lib/commanded/aggregates/supervisor.ex","line":29},"message":"Locating aggregate process for `MyApp.Rca.Aggregates.Rca` with UUID \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.197Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_call] registering {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} as process started by Elixir.DynamicSupervisor.start_child/2 with args [MyApp.CommandedApplication.Commanded.Aggregates.Supervisor, {Commanded.Aggregates.Aggregate, [application: MyApp.CommandedApplication, aggregate_module: MyApp.Rca.Aggregates.Rca, aggregate_uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"]}]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.197Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] found {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} already registered on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.197Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Commanded.Aggregates.Supervisor.open_aggregate/3","file_name":"lib/commanded/aggregates/supervisor.ex","line":29},"message":"Locating aggregate process for `MyApp.Rca.Aggregates.Rca` with UUID \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.197Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_call] registering {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} as process started by Elixir.DynamicSupervisor.start_child/2 with args [MyApp.CommandedApplication.Commanded.Aggregates.Supervisor, {Commanded.Aggregates.Aggregate, [application: MyApp.CommandedApplication, aggregate_module: MyApp.Rca.Aggregates.Rca, aggregate_uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"]}]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.197Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] found {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} already registered on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.197Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Commanded.Aggregates.Supervisor.open_aggregate/3","file_name":"lib/commanded/aggregates/supervisor.ex","line":29},"message":"Locating aggregate process for `MyApp.Rca.Aggregates.Rca` with UUID \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.198Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_call] registering {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} as process started by Elixir.DynamicSupervisor.start_child/2 with args [MyApp.CommandedApplication.Commanded.Aggregates.Supervisor, {Commanded.Aggregates.Aggregate, [application: MyApp.CommandedApplication, aggregate_module: MyApp.Rca.Aggregates.Rca, aggregate_uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"]}]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.198Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] found {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} already registered on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.198Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Commanded.Aggregates.Supervisor.open_aggregate/3","file_name":"lib/commanded/aggregates/supervisor.ex","line":29},"message":"Locating aggregate process for `MyApp.Rca.Aggregates.Rca` with UUID \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.198Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_call] registering {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} as process started by Elixir.DynamicSupervisor.start_child/2 with args [MyApp.CommandedApplication.Commanded.Aggregates.Supervisor, {Commanded.Aggregates.Aggregate, [application: MyApp.CommandedApplication, aggregate_module: MyApp.Rca.Aggregates.Rca, aggregate_uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"]}]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.198Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] found {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} already registered on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.198Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Commanded.Aggregates.Supervisor.open_aggregate/3","file_name":"lib/commanded/aggregates/supervisor.ex","line":29},"message":"Locating aggregate process for `MyApp.Rca.Aggregates.Rca` with UUID \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.198Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_call] registering {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} as process started by Elixir.DynamicSupervisor.start_child/2 with args [MyApp.CommandedApplication.Commanded.Aggregates.Supervisor, {Commanded.Aggregates.Aggregate, [application: MyApp.CommandedApplication, aggregate_module: MyApp.Rca.Aggregates.Rca, aggregate_uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"]}]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.198Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] found {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} already registered on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.198Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Commanded.Aggregates.Supervisor.open_aggregate/3","file_name":"lib/commanded/aggregates/supervisor.ex","line":29},"message":"Locating aggregate process for `MyApp.Rca.Aggregates.Rca` with UUID \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.201Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_call] registering {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} as process started by Elixir.DynamicSupervisor.start_child/2 with args [MyApp.CommandedApplication.Commanded.Aggregates.Supervisor, {Commanded.Aggregates.Aggregate, [application: MyApp.CommandedApplication, aggregate_module: MyApp.Rca.Aggregates.Rca, aggregate_uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"]}]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.202Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] found {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} already registered on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.202Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.866.0>","method_name":"Elixir.Commanded.Aggregates.Supervisor.open_aggregate/3","file_name":"lib/commanded/aggregates/supervisor.ex","line":29},"message":"Locating aggregate process for `MyApp.Rca.Aggregates.Rca` with UUID \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.203Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_call] registering {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} as process started by Elixir.DynamicSupervisor.start_child/2 with args [MyApp.CommandedApplication.Commanded.Aggregates.Supervisor, {Commanded.Aggregates.Aggregate, [application: MyApp.CommandedApplication, aggregate_module: MyApp.Rca.Aggregates.Rca, aggregate_uuid: \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"]}]","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.203Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:do_track] found {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} already registered on nonode@nohost","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.203Z"}}
{"domain":["elixir"],"erl_level":"debug","logger":{"thread_name":"#PID<0.721.0>","method_name":"Elixir.Swarm.Logger.debug/1","file_name":"lib/swarm/logger.ex","line":9},"message":"[swarm on nonode@nohost] [tracker:handle_monitor] {MyApp.CommandedApplication, MyApp.Rca.Aggregates.Rca, \"7e809295-fafe-4362-a062-22ecdbb4dc4c\"} is down: :normal","syslog":{"hostname":"39c78e9b62a9","severity":"debug","timestamp":"2023-01-11T16:14:12.216Z"}}

Seeing "is down: normal" but don't know what it means or if related.

[yordis]

If you DDoS the aggregate with stateless lifespan you will get this error,