Showing posts with label pipeline. Show all posts
Showing posts with label pipeline. Show all posts

Saturday, 30 May 2026

Cloud-Native EPM Automation: Why It's Time to Migrate to Oracle EPM Pipelines

For years, Oracle Cloud EPM administrators looking to build robust, hands-free automation workflows had to walk a narrow, complex path. You either wrestled with the code-free but severely restrictive Batch functionality within Data Management, or you stood up standalone servers to orchestrate complex external scripts via EPM Automate. But the architecture of Enterprise Planning and Budgeting Cloud Service (EPBCS) has officially shifted. With Oracle systematically decommissioning legacy Data Management batches, a modern framework has taken center stage: The Pipeline. Far from a simple cosmetic makeover, the Pipeline feature completely replaces cumbersome legacy processes with a visual, centralized, and cloud-native orchestration powerhouse located right inside the Data Integration dashboard.

The Death of Custom Scripting and Legacy Batches
Historically, chain-linking EPM actions required significant operational overhead. If you wanted to load data, map it, run a series of business rules, clear a partition, and send a completion email, you had to write shell or PowerShell scripts using EPM Automate. This required an on-premise or cloud infrastructure host, security certificates, credential management, and constant maintenance. The new Pipeline feature natively swallows these infrastructure requirements. It allows administrators to build end-to-end, multi-stage, multi-module execution paths without writing a single line of external code. Because it runs natively inside Oracle EPM Cloud, there are no third-party servers to maintain and no external batch utilities to configure. Architectural Shift Notice: Oracle's strategic direction is clear. Legacy Data Management batches are being deprecated. Transitioning to Pipelines isn't just about modernizing your stack—it's a critical path item to ensure your EPM ecosystem remains fully supported and operational. 

Anatomy of an EPM Pipeline
Pipelines bring a highly structured hierarchy to business process automation. They are built on two core concepts: Stages and Jobs. Stages (Serial vs. Parallel): A pipeline is broken into sequential stages. However, inside each stage, you can configure jobs to execute either sequentially (Serial) or concurrently (Parallel). Running jobs in parallel allows you to process up to 25 data integrations or processes simultaneously, drastically slashing nightly batch windows. Supported Job Types: Pipelines are fully integrated across the platform. A single pipeline can call Data Integrations, execute Open Batches, trigger complex Business Rules or Rulesets, run Data Maps, clear data slices, import/export metadata, and even dynamically update Substitution Variables. 

What’s New? Recent High-Impact Pipeline Releases 
Oracle has aggressively added enterprise-grade features to the Pipeline framework over recent updates. If you haven't reviewed Pipelines lately, here are the major game-changing enhancements you need to know: 
1. Seamless Cross-Instance Orchestration Modern enterprise architecture rarely relies on just one EPM environment. You might handle planning in EPBCS, but handle financial consolidation in FCCS and account reconciliation in ARCS. Pipelines can now cross instance boundaries. You can log into your primary planning instance and build a pipeline that triggers data exports locally, pushes them to FCCS, runs consolidation rules there, and triggers balance updates in ARCS—all managed from a single pane of glass. 
2. Direct SFTP Integration Eliminating the need for intermediate data-staging servers, Oracle introduced native SFTP job types. Pipelines can now securely pull source files directly from an external SFTP server or push exports out to external environments. This effectively replaces traditional file-transfer agents for basic automated integrations. 

3. Proxy User Execution for Non-Admins Historically, complex system automations required full Service Administrator privileges to execute. The new Proxy User credential capability changes the game. Administrators can assign a proxy credential to a pipeline, enabling business power users or regional finance teams to trigger the workflow themselves. The pipeline executes with administrative authority behind the scenes, without elevating the actual user's system privileges. 

4. Enterprise-Grade User Interface Refinements As pipelines have grown to encompass hundreds of sequential and parallel steps, managing them could become unwieldy. Oracle resolved this by introducing a compact Table View, allowing administrators to filter, audit, and modify massive workflows quickly. Additionally, the canvas has moved to a Manual Save model, ensuring that complex layout changes are only committed when you choose, preventing accidental runtime disruptions. 

Advanced Error Handling and Scheduling What happens when things go wrong? Legacy automation often failed silently or required custom error-parsing scripts. The Pipeline feature handles errors natively: 
  • Conditional Logic: Configure steps to explicitly "Abort on Failure" or gracefully "Continue on Failure" depending on the criticality of the job. 
  • Native Notifications: Automatically emails stakeholders upon pipeline success, warning, or failure, complete with direct links to the exact runtime logs. 
  • Job Scheduler Integration: Pipelines live directly inside the core EPM Job Scheduler, letting you plan executions right alongside your standard system maintenance blocks. 

The Bottom Line 
The Oracle Cloud EPM Pipeline is no longer a peripheral feature—it is the definitive future of platform automation. By stripping away external scripting servers, providing native parallel processing, and breaking down boundaries between disparate EPM instances, Oracle has given administrators a cleaner, safer, and faster way to manage the financial close and planning cycles. If your organization is still leaning heavily on legacy Data Management batches or fragile external EPM Automate scripts, it’s time to plan your migration. The Pipeline is ready for prime time.

Saturday, 2 August 2025

Data Integration Pipeline Extended to Account Reconciliation

From Aug 2025 monthly patch release, the Pipeline in Data Integration is now available to Account Reconciliation environments.  The Pipeline is used to orchestrate a series of routine tasks within Cloud EPM Platform as a single process.

Below is the sample example of Pipeline in ARCS where we are performing below tasks - 
  • Open the Period
  • Load Rate
  • Import Pre-mapped Balance
  • Create Reconciliation
  • Close period

Below are the sample screen shots while creating job in pipeline -



New Pipeline job types specific to Account Reconciliation include:

  • Create Reconciliation: (Reconciliation Compliance) Copies all selected profiles to a period and return success or failure status.
  • Generate Report for Account Reconciliation: Generates either a single predefined Reconciliation Compliance report, predefined Transaction Matching report or a custom report.
  • Import Attribute Values: Imports attribute values into an existing list attribute or group attribute. In Transaction Matching, only group attributes can be imported.
  • Import Balances: (Reconciliation Compliance) Imports balances data using Data Integration from a previously created integration definition and returns a success or failure status.
  • Import Pre-Mapped Balances: (Reconciliation Compliance) Imports pre-mapped balances and returns the success or failure status.
  • Import Pre-Mapped Transactions: (Transaction Matching) Imports a file of pre-mapped transactions into Transaction Matching and returns the success or failure status.
  • Import Rates: (Reconciliation Compliance) Imports rates for a particular period and rate type, and returns the success or failure status.
  • Run Auto Match: (Transaction Matching) Runs the auto match process in Transaction Matching.
  • Run Auto Alert: (Transaction Matching) Runs the auto alert process for the specified match type in Transaction Matching. This job processes the alert rules defined for the match type and then automatically creates alerts for unmatched transactions. Status of an Auto Alert job can be monitored through the Job History tab in Account Reconciliation.
  • Set Period Status:  (Reconciliation Compliance) Changes the status of a period (open, closed, pending, locked) and returns the success or failure status. 

Applied to: ARCS

Business Benefit

The Pipeline functionality allows users to conduct a sequence of Account Reconciliation focused operations such as importing balances, pre-mapped balances and transactions, rates and so on, streamlined in one location and executed then in serial or parallel mode.

Updated on: Aug 02, 2025

Monday, 19 May 2025

New Copy Pipeline Feature in Data Integration

Prior to this feature, there is no option to open existing pipeline, and users had to create new pipeline always.

A new Copy Pipeline feature is available that enables to create a Pipeline identical to another Pipeline but with a different name. Pipeline can be copied within the same environment or to a remote environment.

The Copy Pipeline option is available from the home page by clicking ... next to the Pipeline to copy and then selecting Copy from the Task Menu:


You are then prompted to select Copy Pipeline options including:

  • New pipeline name
  • New Pipeline code
  • Connection



This feature applies to: 

  • Enterprise Profitability and Cost Management
  • Financial Consolidation and Close
  • FreeForm
  • Planning
  • Profitability and Cost Management
  • Tax Reporting

Business Benefit: Use the copy Pipeline feature to create a new copy of a Pipeline definition with identical connections and job type information. You might use this feature when you want to copy a Pipeline definition in a test environment, or you want to copy a source Pipeline as a model for another Pipeline.


Created by Mohit Jain and Megha Gupta

Ability to Create and Manage External Users

Service Administrators can now use the Manage Users tab under Access Control to create, edit, and delete external users (users who are not p...