Timeout exceptions while fetching to google credentials

Experiencing the timeout exceptions consistently while fetching credentials from google. We are using alpakka google common (alpakka/google-common at master · akka/alpakka · GitHub) version 2.13-3.0.4. We tried to increase the timeout from 1s to 20s to 50s but we haven’t seen any improvement. I also looked at the metadata server logs of google but couldn’t find any 4xx or 5xx errors, the requests for workflow identity federation are processed successfully.

Restarting stream due to failure [1]: java.util.concurrent.TimeoutException: Future timed out after [20 seconds]
java.util.concurrent.TimeoutException: Future timed out after [20 seconds]
at scala.concurrent.impl.Promise$DefaultPromise.tryAwait0(Promise.scala:248)
at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:261)
at scala.concurrent.Await$.$anonfun$result$1(package.scala:201)
at akka.dispatch.MonitorableThreadFactory$AkkaForkJoinWorkerThread$$anon$3.block(ThreadPoolBuilder.scala:174)
at java.base/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3118)
at akka.dispatch.MonitorableThreadFactory$AkkaForkJoinWorkerThread.blockOn(ThreadPoolBuilder.scala:172)
at scala.concurrent.Await$.result(package.scala:124)
at akka.stream.alpakka.google.auth.Credentials$.parseComputeEngine(Credentials.scala:57)
at akka.stream.alpakka.google.auth.Credentials$.apply(Credentials.scala:49)
at akka.stream.alpakka.google.GoogleSettings$.apply(GoogleSettings.scala:34)
at akka.stream.alpakka.google.GoogleExt.$anonfun$settings$1(GoogleExt.scala:29)
at scala.collection.MapOps.getOrElse(Map.scala:162)
at scala.collection.MapOps.getOrElse$(Map.scala:160)
at scala.collection.AbstractMap.getOrElse(Map.scala:405)
at akka.stream.alpakka.google.GoogleExt.settings(GoogleExt.scala:28)
at akka.stream.alpakka.google.GoogleExt.(GoogleExt.scala:25)
at akka.stream.alpakka.google.GoogleExt$.createExtension(GoogleExt.scala:41)
at akka.stream.alpakka.google.GoogleExt$.createExtension(GoogleExt.scala:36)
at akka.actor.ActorSystemImpl.registerExtension(ActorSystem.scala:1158)
at akka.actor.ExtensionId.apply(Extension.scala:78)
at akka.actor.ExtensionId.apply$(Extension.scala:77)
at akka.stream.alpakka.google.GoogleExt$.apply(GoogleExt.scala:38)
at akka.stream.alpakka.google.GoogleExt$.apply(GoogleExt.scala:36)
at akka.stream.alpakka.google.GoogleSettings$.apply(GoogleSettings.scala:66)
at akka.stream.alpakka.googlecloud.pubsub.grpc.scaladsl.GrpcPublisher$.apply(GrpcPublisher.scala:37)
at akka.stream.alpakka.googlecloud.pubsub.grpc.scaladsl.GrpcPublisher$.apply(GrpcPublisher.scala:43)
at akka.stream.alpakka.googlecloud.pubsub.grpc.scaladsl.GrpcPublisherExt.(GrpcPublisherExt.scala:12)
at akka.stream.alpakka.googlecloud.pubsub.grpc.scaladsl.GrpcPublisherExt$.createExtension(GrpcPublisherExt.scala:17)
at akka.stream.alpakka.googlecloud.pubsub.grpc.scaladsl.GrpcPublisherExt$.createExtension(GrpcPublisherExt.scala:15)
at akka.actor.ActorSystemImpl.registerExtension(ActorSystem.scala:1158)
at akka.actor.ExtensionId.apply(Extension.scala:78)
at akka.actor.ExtensionId.apply$(Extension.scala:77)
at akka.stream.alpakka.googlecloud.pubsub.grpc.scaladsl.GrpcPublisherExt$.apply(GrpcPublisherExt.scala:25)
at akka.stream.alpakka.googlecloud.pubsub.grpc.scaladsl.GrpcPublisherExt$.apply(GrpcPublisherExt.scala:15)
at akka.actor.ExtensionId.apply(Extension.scala:84)
at akka.actor.ExtensionId.apply$(Extension.scala:84)
at akka.stream.alpakka.googlecloud.pubsub.grpc.scaladsl.GrpcPublisherExt$.apply(GrpcPublisherExt.scala:21)
at

Hi Pradeep,

I understand you got help via Lightbend Support. Let’s continue there.

Regards,
Enno.

What is the solution suggested? I am also seeing same issue for my use case.