Introducing the integration platform

In the previous post, we looked at how point-to-point integrations decay as systems grow.

The problem was not that systems needed to exchange data.
The problem was that no one owned the exchange.

This is where an integration platform becomes important.

An integration platform is not just a technical runtime.
It is the control layer for how systems communicate.


Back to the business example

Our example company is a mid-sized seafood processing business.

It has production, warehouse, transport, finance, quality control and reporting systems. Each system has a valid reason to exist. The problem is that business processes cross all of them.

A customer order may touch:

  • ERP for customer, item and order data
  • Production for batch and packing information
  • Warehouse for stock and lot handling
  • Quality system for certificates and approvals
  • Transport portal for shipment booking
  • Data platform for reporting and forecasting

Without an integration platform, each system learns too much about the others.

%%{init: {'theme': 'dark'}}%%
graph LR
    ERP[ERP] --> WH[Warehouse]
    ERP --> PROD[Production]
    ERP --> FIN[Finance]
    WH --> PROD
    WH --> TMS[Transport Portal]
    PROD --> QA[Quality System]
    PROD --> DATA[Data Platform]
    QA --> DATA
    WH --> DATA

Every system becomes both a business application and an integration engine.

That is not a clean separation of responsibility.

What the integration platform changes

An integration platform introduces a controlled middle layer.

Systems no longer need to know every other system directly.
They communicate through a layer that owns transport, transformation, routing, retries, monitoring and traceability.

%%{init: {'theme': 'dark'}}%%
graph LR
    ERP[ERP] --> INT[Integration Platform]
    WH[Warehouse] --> INT
    PROD[Production] --> INT
    QA[Quality System] --> INT
    TMS[Transport Portal] --> INT
    FIN[Finance] --> INT
    DATA[Data Platform] --> INT

    INT --> ERP
    INT --> WH
    INT --> PROD
    INT --> QA
    INT --> TMS
    INT --> FIN
    INT --> DATA

This does not remove complexity.
It moves complexity into a place where it can be owned.

The purpose of an integration platform is not to make integration disappear.
It is to make integration visible, governable and supportable.

What an integration platform owns

A useful integration platform owns the concerns that should not be scattered across every application.

  • Message routing
  • Protocol handling
  • Data transformation
  • Contract validation
  • Retries and error handling
  • Monitoring and alerting
  • Traceability and logging
  • Operational documentation
  • Security boundaries
  • Versioning and change control

These are not minor details.
They decide whether a business process can be trusted in production.

The integration platform as a business layer

In the seafood company, an order is not just a row in an ERP system.

It becomes a business event.

  • An order was created
  • A batch was produced
  • Stock was reserved
  • A quality certificate was approved
  • A shipment was booked
  • An invoice was prepared

The integration platform should understand these flows at a technical level.

Not because it replaces the business systems, but because it connects them in a controlled way.

%%{init: {'theme': 'dark'}}%%
graph TD
    ORDER[Order Created] --> INT[Integration Platform]
    INT --> STOCK[Reserve Stock]
    INT --> PROD[Notify Production]
    INT --> QA[Check Quality Requirement]
    INT --> TRANSPORT[Prepare Transport]
    INT --> FINANCE[Prepare Invoice Data]
    INT --> TRACE[Trace and Monitor Flow]

Now the full process can be observed from one place.

Why this matters operationally

When something fails, the question should not be:

Which system do we log into first?

The question should be:

Where did this business flow stop?

An integration platform gives operations and developers a central place to answer that question.

  • Was the message received?
  • Was the message valid?
  • Was it transformed correctly?
  • Was the target system available?
  • Was it retried?
  • Was anyone alerted?
  • Can the message be replayed safely?

Without this, teams investigate by guessing.

With it, they investigate by following the flow.

Integration platform does not mean one product

An integration platform does not have to mean one specific vendor or one monolithic tool.

It can be built from several technologies:

  • API gateway
  • Message broker
  • Integration runtime
  • File transfer handling
  • Transformation services
  • Monitoring and logging
  • Metadata and documentation
  • DevOps pipelines

The important part is not the brand.
The important part is that integration is treated as a platform responsibility, not as scattered side effects inside each application.

What good looks like

A good integration platform gives the organization:

  • One place to see important flows
  • Clear ownership of integration behavior
  • Reusable patterns for APIs, files, messages and events
  • Consistent logging and alerting
  • Safer change management
  • Better separation between business systems and transport logic
  • More reliable data for reporting and AI

The integration platform is where data movement becomes an owned capability.

The real goal

The goal is not to make every integration complicated.

The goal is to make important integrations boring.

Boring means:

  • Visible
  • Logged
  • Monitored
  • Documented
  • Repeatable
  • Supportable
  • Safe to change

That is what a business needs from its integration platform.


In the next post, we separate the integration platform from another important layer: the cloud ETL and AI data platform.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *