Possible Slowdown on (NA3 & SBNA3) Environments

Incident Report for BlackLine

Resolved

BlackLine has confirmed that the service is fully operational and we apologize for any inconvenience this issue may have caused.
Posted Jul 14, 2026 - 21:50 UTC

Update

Our engineering teams continue to address the service disruption related to elevated database processing that initially began on June 30th. We have identified several areas for software optimization and are shifting our focus toward implementing these systemic improvements to enhance overall performance.

Our specialized teams are currently reviewing and adjusting specific diagnostic configurations that may have contributed to the recent database load. These forward-looking enhancements are designed to ensure optimal system stability and allow us to normalize our infrastructure scaling.
Posted Jul 14, 2026 - 12:57 UTC

Monitoring

Our engineering teams continue to investigate the ongoing service disruption that initially began on June 30th, with increased impact observed since July 8th. We are actively working to understand the underlying source of the unexpected database processing behavior.

To immediately improve system performance, we have implemented temporary infrastructure enhancements, including scaling our database resources. We are closely monitoring these adjustments to ensure optimal stability while our specialized teams develop a permanent resolution.
Posted Jul 13, 2026 - 12:32 UTC

Update

Clients may experience a brief interruption of service during the maintenance activity previously scheduled for 12-2 on July 11
Posted Jul 11, 2026 - 01:14 UTC

Identified

Our engineering teams are scheduling targeted infrastructure enhancements, including an increase in processing capacity planned for tomorrow, to continually optimize system performance. Furthermore, we are implementing preventative safeguards and expanded monitoring capabilities across our services to bolster overall platform resilience.

We appreciate your patience
Posted Jul 10, 2026 - 23:26 UTC

Update

Our teams are comprehensively analyzing the underlying database processing load and have scheduled temporary infrastructure enhancements during our upcoming maintenance window to improve system responsiveness. We remain committed to your system's stability and will provide additional updates as our investigation progresses.
Posted Jul 10, 2026 - 19:06 UTC

Update

Our engineering teams are continuing to investigate an ongoing service disruption that involves unexpected database activity. We have observed that this behavior aligns with recurring seasonal spikes typically seen at the start of each month.

We will continue to provide updates as our investigation progresses and we implement a permanent resolution.
Posted Jul 10, 2026 - 17:00 UTC

Update

BlackLine engineering teams are currently investigating an ongoing service disruption that began on 7 July. We are actively running diagnostic traces and analyzing system data to resolve the unexpected database activity.

Our database specialists are fully engaged and working diligently to swiftly restore optimal system performance. We appreciate your patience and remain committed to delivering the reliable and secure software experience you expect from us.
Posted Jul 10, 2026 - 12:42 UTC

Update

We are actively investigating a performance issue that is currently causing elevated processing loads for select background operations. Please be assured that general platform usage and overall business traffic remain steady and unaffected by this event. We will provide regular updates on this page until the issue is resolved.
Posted Jul 10, 2026 - 01:48 UTC

Update

Our experts are actively analyzing the application layer to optimize how this process is executed and eliminate any unnecessary system load. We are also deploying additional diagnostic measures to accelerate our troubleshooting efforts and ensure a robust, lasting solution.
Posted Jul 09, 2026 - 22:27 UTC

Update

We are continuing our investigation into the performance delays that escalated on July 7, 2026, which are currently impacting NA3 and SBNA3 data center. Our engineering teams have identified a backend process that is running less efficiently than expected and contributing to overall system slowness.
Posted Jul 09, 2026 - 19:54 UTC

Investigating

The BlackLine team continues to investigate the performance issues affecting certain modules in the NA3 and SBNA3 data centers. We are working diligently to restore optimal performance levels and will provide new information as it becomes available.
Posted Jul 09, 2026 - 17:57 UTC

Monitoring

Our engineering teams successfully addressed the latency by restarting the scheduler message processor, which restored optimal import performance. The systems are now functioning normally, and we have moved this incident into a monitoring phase to ensure continued stability.
Posted Jul 08, 2026 - 21:03 UTC

Update

At 1:15 PM PST, our engineering teams restarted the scheduler message processor to address the latency, yielding noticeable improvements in import performance. Our Platform and Site Reliability Engineering teams are continuing their thorough investigation to fully resolve the remaining latency.
Posted Jul 08, 2026 - 20:49 UTC

Update

BlackLine Platform team has joined our Site Reliability Engineering experts to assist with the ongoing research into the network anomalies associated with the reported delays. The combined teams are actively analyzing our environments to thoroughly understand the contributing factors.
Posted Jul 08, 2026 - 20:32 UTC

Investigating

Customers may be experiencing an issue where certain modules in the NA3 and SBNA3 data centers are performing slower than expected. The BlackLine team is currently investigating this issue. We will provide regular updates on this page until the matter is resolved.
Posted Jul 08, 2026 - 18:54 UTC
This incident affected: Financial Close - Sandbox (SB NA3) and Financial Close - Production (PROD NA3).