Scheduled sending of heartbeat was delayed

After upgrading Lagom from 1.4.x to 1.5.x, we are seeing a significant increase of the Scheduled sending of heartbeat was delayed. message. Do you have any guidance on how we can investigate this or why this would happen after the upgrade?

I don’t know why this would happen more after upgrading, but it indicates that the Akka default dispatcher is being starved of CPU time.

There are a few common reasons for this:

  1. Frequent blocking I/O calls are being made on the default dispatcher
  2. Non-yielding, CPU-intensive functions are executing on the default dispatcher
  3. Lengthy garbage collection cycles are pausing the entire VM

I hope that gives some some leads to investigate. If you have a Lightbend Platform Subscription, you can also use the Akka Thread Starvation Detector to help diagnose these types of problems.