Partial disruption in DataDog metrics exporter
Aug 2, 17:30 UTCResolved - An incident occurred yesterday during a maintenance operation, resulting in disruptions to our stats exporter. Some customers might have gaps in their DataDog metrics between...
View ArticleElevated error rates on mt1 cluster
Aug 15, 12:30 UTCResolved - Between 12:33 and 13:05 UTC customers may have encountered an increase in error rates when interacting with the Channels HTTP API. The error rate has since subsided. We are...
View ArticleMT1 Elevated Errors
Sep 5, 23:03 UTCResolved - This incident has been resolved.Sep 5, 22:52 UTCMonitoring - We have implemented a fix and are monitoring the impact - so far the system looks operational.Sep 5, 22:06...
View ArticleMT1 cluster outage
Sep 6, 21:24 UTCResolved - This issue is now resolved, with connections being established successfully across both websocket and fallback protocols. We will share a post mortem when the full...
View ArticleMT1 Cluster issues
Sep 7, 15:28 UTCResolved - This issue is now resolved and the service is operational once more. An RCA will be published once we conclude internal investigations into the issue.Sep 7, 14:38...
View Article[Urgent] MT1 and EU cluster maintenance
Sep 9, 05:02 UTCCompleted - The scheduled maintenance has been completed.Sep 9, 04:27 UTCVerifying - We have deployed the intended changes to the MT1 and EU clusters. We are continuing to monitor.Sep...
View Article[Urgent] MT1 cluster maintenance
Sep 11, 06:01 UTCCompleted - The scheduled maintenance has been completed.Sep 11, 04:00 UTCIn progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Sep 8,...
View ArticleElevated API Errors
Sep 19, 07:57 UTCResolved - This incident has been resolved.Sep 18, 19:56 UTCUpdate - Our vendor continues to investigate and work towards resolution of this issue. We are continuing to see elevated...
View ArticleInsights and graphs not available in neither customer and admin view
Oct 17, 23:20 UTCResolved - Most customers have had their graphs restored. Over the next few days, the team will persist in their efforts to ensure that all customers' graph issues are resolved, albeit...
View ArticlePartial outage in eu cluster
Oct 18, 14:30 UTCResolved - Between 14:30 and 14:45 UTC, the Channels API experienced a partial outage. At its peak, approximately 32% of requests to publish a new message failed and most clients had...
View ArticleMarketing website is unreachable for some visitors
Oct 23, 09:22 UTCResolved - The marketing website (pusher.com) should now be reachable for all visitors, and this incident is now resolved. Pusher services were available and unaffected the entire...
View ArticleDisruption in Channels stats integration
Oct 25, 04:00 UTCResolved - Between 06:10 and 09:14 UTC, we encountered an issue that temporarily disrupted the export of data to our stats integrations as well as our own dashboard. As a result,...
View ArticleChannels EU cluster having intermittent issues
Nov 14, 17:36 UTCResolved - The cluster is now operational following the implementation of a fix at 17:13 UTC. Our team is actively monitoring the results. The primary contributing factor was...
View ArticleWebhook delivery issue - Channels EU cluster
Nov 15, 19:02 UTCResolved - This incident has been resolved.Nov 15, 18:46 UTCMonitoring - A fix has been implemented and we are monitoring the results.Nov 15, 18:36 UTCInvestigating - We're currently...
View Articleintermittent issues with publishing messages in EU cluster
Nov 20, 10:41 UTCResolved - This issue has been resolvedNov 20, 10:30 UTCMonitoring - The issue has been identified and a fix is releasedNov 19, 10:15 UTCInvestigating - We are currently investigating...
View ArticleA subset of webhooks may not be successfully delivered - EU cluster only
Nov 22, 14:27 UTCResolved - Our engineering team has rolled out a fix and has confirmed webhooks delivery is fully operational on the affected EU cluster.Nov 22, 13:08 UTCInvestigating - Our...
View ArticleHigh latency on channels US2 API
Nov 29, 16:09 UTCResolved - Our engineering team has confirmed this issue has been mitigated. We apologise for any inconvenience this may have caused you.Nov 29, 15:48 UTCIdentified - Our engineering...
View ArticleCustomers using Datadog exporter feature at pusher channels might experience...
Nov 30, 11:17 UTCResolved - This incident is being resolvedNov 30, 10:30 UTCInvestigating - Our engineering team has detected an issue that is preventing all data to be published to DataDog. We are...
View ArticleUS2 Customers may be experiencing latency issues with or unable to utilize...
Dec 1, 21:20 UTCResolved - This incident has been resolved.Dec 1, 20:53 UTCMonitoring - The fix has been implemented and latency has improved.Dec 1, 20:46 UTCIdentified - The team has identified the...
View ArticlePublic EU cluster outage
Dec 5, 18:11 UTCResolved - This incident has been resolved.Dec 5, 17:47 UTCMonitoring - The public EU cluster has been restored and all services are now back online. We will continue to monitor the...
View ArticleChannels Stats Missing Data
Jan 26, 15:37 UTCResolved - Between 15:37 - 16:01 UTC we encountered an issue with our stats pipeline that resulted in missing metrics. Customers may notice data missing for this period in the Pusher...
View ArticlePusher US3 cluster outage
Feb 23, 00:36 UTCResolved - This incident has been resolved.Feb 23, 00:34 UTCMonitoring - A fix has been implemented and we are monitoring the results.Feb 22, 23:11 UTCIdentified - The team identified...
View ArticlePusher US2 webhooks delayed
Feb 24, 13:35 UTCResolved - All delayed US webhooks completed processing at approximately 730 UTC. This incident is resolved.Feb 24, 05:16 UTCUpdate - We have deployed a fix for this issue. The...
View ArticlePusher EU webhooks delayed
Feb 24, 13:36 UTCResolved - All delayed EU webhooks completed processing at approximately 1030 UTC. This incident is resolved.Feb 24, 05:16 UTCUpdate - We have deployed a fix for this issue. The...
View ArticlePusher US2 webhooks delayed
Feb 25, 04:11 UTCResolved - We have identified the issue and resolved it. Webhooks are behaving as expected again.Feb 25, 01:02 UTCInvestigating - We are investigating a delay in Webhooks.
View Article
