Skip to main content
Redhat Developers  Logo
  • Products

    Featured

    • Red Hat Enterprise Linux
      Red Hat Enterprise Linux Icon
    • Red Hat OpenShift AI
      Red Hat OpenShift AI
    • Red Hat Enterprise Linux AI
      Linux icon inside of a brain
    • Image mode for Red Hat Enterprise Linux
      RHEL image mode
    • Red Hat OpenShift
      Openshift icon
    • Red Hat Ansible Automation Platform
      Ansible icon
    • Red Hat Developer Hub
      Developer Hub
    • View All Red Hat Products
    • Linux

      • Red Hat Enterprise Linux
      • Image mode for Red Hat Enterprise Linux
      • Red Hat Universal Base Images (UBI)
    • Java runtimes & frameworks

      • JBoss Enterprise Application Platform
      • Red Hat build of OpenJDK
    • Kubernetes

      • Red Hat OpenShift
      • Microsoft Azure Red Hat OpenShift
      • Red Hat OpenShift Virtualization
      • Red Hat OpenShift Lightspeed
    • Integration & App Connectivity

      • Red Hat Build of Apache Camel
      • Red Hat Service Interconnect
      • Red Hat Connectivity Link
    • AI/ML

      • Red Hat OpenShift AI
      • Red Hat Enterprise Linux AI
    • Automation

      • Red Hat Ansible Automation Platform
      • Red Hat Ansible Lightspeed
    • Developer tools

      • Red Hat Trusted Software Supply Chain
      • Podman Desktop
      • Red Hat OpenShift Dev Spaces
    • Developer Sandbox

      Developer Sandbox
      Try Red Hat products and technologies without setup or configuration fees for 30 days with this shared Openshift and Kubernetes cluster.
    • Try at no cost
  • Technologies

    Featured

    • AI/ML
      AI/ML Icon
    • Linux
      Linux Icon
    • Kubernetes
      Cloud icon
    • Automation
      Automation Icon showing arrows moving in a circle around a gear
    • View All Technologies
    • Programming Languages & Frameworks

      • Java
      • Python
      • JavaScript
    • System Design & Architecture

      • Red Hat architecture and design patterns
      • Microservices
      • Event-Driven Architecture
      • Databases
    • Developer Productivity

      • Developer productivity
      • Developer Tools
      • GitOps
    • Secure Development & Architectures

      • Security
      • Secure coding
    • Platform Engineering

      • DevOps
      • DevSecOps
      • Ansible automation for applications and services
    • Automated Data Processing

      • AI/ML
      • Data Science
      • Apache Kafka on Kubernetes
      • View All Technologies
    • Start exploring in the Developer Sandbox for free

      sandbox graphic
      Try Red Hat's products and technologies without setup or configuration.
    • Try at no cost
  • Learn

    Featured

    • Kubernetes & Cloud Native
      Openshift icon
    • Linux
      Rhel icon
    • Automation
      Ansible cloud icon
    • Java
      Java icon
    • AI/ML
      AI/ML Icon
    • View All Learning Resources

    E-Books

    • GitOps Cookbook
    • Podman in Action
    • Kubernetes Operators
    • The Path to GitOps
    • View All E-books

    Cheat Sheets

    • Linux Commands
    • Bash Commands
    • Git
    • systemd Commands
    • View All Cheat Sheets

    Documentation

    • API Catalog
    • Product Documentation
    • Legacy Documentation
    • Red Hat Learning

      Learning image
      Boost your technical skills to expert-level with the help of interactive lessons offered by various Red Hat Learning programs.
    • Explore Red Hat Learning
  • Developer Sandbox

    Developer Sandbox

    • Access Red Hat’s products and technologies without setup or configuration, and start developing quicker than ever before with our new, no-cost sandbox environments.
    • Explore Developer Sandbox

    Featured Developer Sandbox activities

    • Get started with your Developer Sandbox
    • OpenShift virtualization and application modernization using the Developer Sandbox
    • Explore all Developer Sandbox activities

    Ready to start developing apps?

    • Try at no cost
  • Blog
  • Events
  • Videos

Reference Architecture for Agile Integration

July 27, 2017
Christina Lin
Related topics:
KubernetesJavaMicroservices
Related products:
Red Hat OpenShift Container PlatformRed Hat Fuse

Share:

    Integration is still around but in a different form. So, what does modern integration look like? Looking at how agile scrum has taken over traditional waterfall development framework, by enabling shorter delivery cycles, faster feedback, and having the flexibility to rapidly adapt to changes. I believe it’s time for traditional integration to be agile again. By breaking up traditional ESB into distributed microservices.

    A little recap of what should be in Agile integration:

    • Distributed Integration
      • Lightweight, support distributed deployment
      • Pattern Based Integration
      • Reusable Connectors
      • Microservices
    • Containers
      • Cloud native solutions
      • Lean artifacts, individually deployable
      • Container based scaling and high availability
    • API
      • Well defined, reusable, and well-managed end-points
      • Ecosystem leverage

    Based on these three principles, I was asked to create a reference architecture for it. After giving it some thought, drawing up numerous boxes and diagrams, something clicked when I watched a 3-year-old playing. And here, this is my answer…

    Yup. That is it! Reference architecture of Agile Integration. Architecture is often needed during the design phase of a software project; it provides a structure and backbone for the software project. Once it’s done, it’s done; any architectural modification will be difficult and can bring disastrous results.  We all knew “one thing will never change in software development is Change”. Maybe it’s because of the regulation requirement, market demands or simply learning more about the business domain. So I started to think, can we build an architecture that is flexible for change, and can be shaped into the needs of a project as needed? So based on that concept, this is my reference architecture for Agile Integration, the modern integration application development that enables flexibility from many angles.  

    There are the major components in my reference architecture diagram for Agile Integration:

    PaaS - Provides a foundation for fast pace software development by allowing the developer to self-service, as well as an enable-automated provision. It will also boost operational efficiencies by making the entire environment DevOps ready.

    Security/Identity management (IAM) - Handles basic authentication and authorization for application interfaces and platforms.

    Automation - Automates both the processes of building applications and rolling deployment strategies for upgrades. Together with continuous integration tools, it can achieve continuous delivery of the application software.

    Logging and Tracing - What was supposed to be easy in a monolithic world, has now become one of the challenges in distributed microservice architecture for integration. As it has now become harder to have a unified view of how things are doing. It is important to have a way to see logging as a whole. And has the tracing capability for different activities.   

    Containerized packages - Container technology allows us to build immutable portable lightweight application package, that is language agnostic. The configuration is independent of this build allowing the same package to deploy quickly in multiple environments.

    Container management - In a large-scale system, it is essential to have a convenient management platform to manage all the containers running the applications. Taking care of the monitoring, discovery, recovery, and failover of the running containers.

    Microservices - Large applications/services are broken down into easy maintainable pieces and can be independently developed and deployed in a distributed environment. Each of them should be built with failure in mind. 

    Load Balance/Service discovery/Network management  - Microservices are built for flexibility, according to current system load, the load should be automatically balanced for each running instance. All services should be registered and can be found in the system without complex setup. Ideally, a proxy endpoint for external users to hide away the deployment complexity.  

    Layered architecture - Logically organize microservice into a set of layers, each has its own responsibility to avoid duplication of effort and make it easier to replace later on. Currently, there are 4 layers:

    • Gateway layer - provides simple gateway routing capability such as versioning, and dealing with a different platform of devices.
    • Composite layer - an important middle tier that handles composition of multiple microservices. They do more complex routing from processing the content data itself and sometimes handle more complex data aggregation or normalization.  
    • Base layer - like the name, which is most likely, represents the basic components of the system. Handles data retrieval or business logic processing.
    • Anti-corruption layer - This layer handles interface to a legacy application or anything that works against microservices quick and flexible principle. This layer is built in the protection wall to your system, by doing the transforming job and translation between two very distinct implementations of the system.   

    Application domains - This one is more like a pattern than architecture. But since we mention layers in software I also wanted to touch a little bit on this. Because it’s all about reining microservices into a more organized way. It’s a good practice to have each application domain defined (using the same set of the data model). And have other external integration microservices to wire between each domain. One other good thing about microservices is that you have the flexibility to move each small microservice to different domains where it will better fit.

    API management - Managing the APIs by reinforced access policy, collecting statistics around the usage of APIs. Also building a healthy eco-system among the developer and users of APIs. Further to allow direct revenue source from the APIs.

    There is certainly some limitation in today’s technology to allow a complete pliable architectural form. But I believe this model can bring flexibility into the system without significant impact to the system when changes occur. I will provide more details in my upcoming posts.


    Take advantage of your Red Hat Developers membership and download RHEL today at no cost.

    Last updated: July 26, 2017

    Recent Posts

    • Create and enrich ServiceNow ITSM tickets with Ansible Automation Platform

    • Expand Model-as-a-Service for secure enterprise AI

    • OpenShift LACP bonding performance expectations

    • Build container images in CI/CD with Tekton and Buildpacks

    • How to deploy OpenShift AI & Service Mesh 3 on one cluster

    Red Hat Developers logo LinkedIn YouTube Twitter Facebook

    Products

    • Red Hat Enterprise Linux
    • Red Hat OpenShift
    • Red Hat Ansible Automation Platform

    Build

    • Developer Sandbox
    • Developer Tools
    • Interactive Tutorials
    • API Catalog

    Quicklinks

    • Learning Resources
    • E-books
    • Cheat Sheets
    • Blog
    • Events
    • Newsletter

    Communicate

    • About us
    • Contact sales
    • Find a partner
    • Report a website issue
    • Site Status Dashboard
    • Report a security problem

    RED HAT DEVELOPER

    Build here. Go anywhere.

    We serve the builders. The problem solvers who create careers with code.

    Join us if you’re a developer, software engineer, web designer, front-end designer, UX designer, computer scientist, architect, tester, product manager, project manager or team lead.

    Sign me up

    Red Hat legal and privacy links

    • About Red Hat
    • Jobs
    • Events
    • Locations
    • Contact Red Hat
    • Red Hat Blog
    • Inclusion at Red Hat
    • Cool Stuff Store
    • Red Hat Summit
    © 2025 Red Hat

    Red Hat legal and privacy links

    • Privacy statement
    • Terms of use
    • All policies and guidelines
    • Digital accessibility

    Report a website issue