Possible Slowdown on (NA3 & SBNA3) Systems - FCM
Incident
Report for BlackLine
Resolved
The backend re-synchronization process is now 100% complete. Processing queues for FTP import jobs (DAI & DMP) on the NA3 and SBNA3 systems have fully cleared, and standard processing speeds are restored. Engineering teams will continue to monitor system performance to ensure sustained stability.
Update
Customers may be experiencing delays with FTP import job processing (DAI & DMP) on the NA3 and SBNA3 systems.. Our backend re-synchronization process is progressing and is now 92% complete. Engineering teams continue to monitor system performance and processing queues as we approach full restoration of standard processing speeds for FTP import jobs (DAI & DMP).
Update
A significant portion of the processing queue has been successfully cleared as the system efficiently handles the production workload. Our backend re-synchronization is progressing smoothly, with completion rates currently at 84% across the impacted aggregates.
Update
Customers may continue to experience latency with FTP import jobs (DAI & DMP). Processing queues have now fully cleared for a large segment of our customers, and our backend synchronization process is approximately 75% complete. Engineering teams remain actively engaged in monitoring throughput and clearing the remaining backlog to fully restore standard processing speeds. We will provide another update as progress continues.
Monitoring
Customers may be experiencing an issue where possible latency issues with FTP import jobs (DAI & DMP). Our backend synchronization process is making steady progress and is now over two-thirds complete. Engineering teams remain actively engaged in monitoring throughput and clearing the remaining backlog to fully restore standard processing speeds.
Update
Customers may be experiencing delays with FTP import job processing (DAI & DMP) on the NA3 and SBNA3 systems. Our engineering teams remain engaged in remediation efforts and are continuing to tune system performance while reducing the volume of queued jobs. Processing throughput has improved, and imports are steadily progressing through the backlog.
Update
Customers may be experiencing an issue where possible latency issues with FTP import jobs (DAI & DMP). Our engineering teams continue to optimize system resources and clear the service queue backlog for FTP import jobs (DAI & DMP) on the NA3 and SBNA3 systems. We are seeing progress in processing times and will provide another update as we work toward fully restoring standard performance.
Update
Customers may be experiencing an issue where possible latency issues with FTP import jobs (DAI & DMP). Our engineering teams are actively optimizing system resources to clear any processing delays and restore standard performance speeds.
Update
Customers may be experiencing an issue where Possible Slowdown on (NA3 & SBNA3) Systems. Our technical teams are actively clearing the service queue backlog and optimizing the system to restore standard processing times. We will continue to provide updates as the process continues.
Identified
Customers may be experiencing an issue where possible latency issues with FTP import jobs (DAI & DMP). BlackLine teams are continuing to investigate the issue. We will provide regular updates on this page until the issue is resolved.
Investigating
Customers may be experiencing an issue where Possible Slowdown on (NA3 & SBNA3) Systems. BlackLine teams are investigating the issue. We will provide regular updates on this page until the issue is resolved.
This incident affected: Financial Close - Sandbox (SB NA3) and Financial Close - Production (PROD NA3).