Smart-Meter Data Processing Using Apache Kafka on OpenShift

There is a major push in the United Kingdom to replace aging mechanical electricity meters with connected smart meters. New meters allow consumers to more closely monitor their energy usage and associated cost, and they enable the suppliers to automate the billing process because the meters automatically report fine-grained energy use.

This post describes an architecture for processing a stream of meter readings using Strimzi, which offers support for running Apache Kafka in a container environment (Red Hat OpenShift). The data has been made available through a UK research project that collected data from energy producers, distributors, and consumers from 2011 to 2014. The TC1a dataset used here contains data from 8,000 domestic customers on half-hour intervals in the following form:

Continue reading “Smart-Meter Data Processing Using Apache Kafka on OpenShift”

Share

Announcing AMQ Streams: Apache Kafka on OpenShift

Hi all,

We are excited to announce a Developer Preview of Red Hat AMQ Streams, a new addition to Red Hat AMQ, focused on running Apache Kafka on OpenShift.

Apache Kafka is a leading real-time, distributed messaging platform for building data pipelines and streaming applications.

Using Kafka, applications can:

  • Publish and subscribe to streams of records.
  • Store streams of records.
  • Process records as they occur.

Continue reading “Announcing AMQ Streams: Apache Kafka on OpenShift”

Share

IoT Developer Survey – Deadline March 5, 2018

We are seeking input from Internet of Things (#IoT) developers to better understand their needs for software and related tools. Whether you’re a hacker instrumenting your home with Raspberry Pi, or an IT developer working on Industrial IoT solutions, we want to know how you’re using open source technologies to build your IoT solution. The output from this survey will help the open source community focus on the resources most needed by IoT developers.

Continue reading IoT Developer Survey – Deadline March 5, 2018

Share

It’s Time To Accelerate Your Application Development With Red Hat JBoss Middleware And Microsoft Azure

The role of applications has changed dramatically. In the past, applications were running businesses, but primarily relegated to the background. They were critical, but more operational in the sense that they kept businesses running, more or less. Today, organizations can use applications as a competitive advantage. In fact, a well-developed, well-timed application can disrupt an entire industry. Just take a look at the hotel, taxi, and movie rental industries respectively.

Continue reading “It’s Time To Accelerate Your Application Development With Red Hat JBoss Middleware And Microsoft Azure”

Share

ARM TechCon 2017 – Embedded, IoT, Networking, and more…

Arm TechCon 2017 – Embedded, IoT, Networking and no Server focus

Last month was Arm TechCon, the annual developer conference showcasing offerings from Arm and its partners. Arm laid out its vision and strategy to achieving even greater integration in its processors and circumventing the slowing Moore’s law. As always, there was a bevy of new product announcements but overall, the show seemed to lack the energy of the last few years and especially the excitement of last year after Arm was acquired by Softbank. For example, there was no big vision keynote like the one last year from Masayoshi Son (Chairman & CEO of Softbank) who had talked of IoT enabling a Cambrian Explosion (which enabled thousands of new species on Earth), leading to 1 trillion IoT devices in 20 years.

Continue reading “ARM TechCon 2017 – Embedded, IoT, Networking, and more…”

Share

Using Agile Integration for IoT

In architecting end-to-end Internet of Things (IoT) solutions, one of the biggest challenges is how to integrate IoT data with data streams from enterprise systems and external sources. Traditionally, businesses have used an enterprise service bus (ESB) and service-oriented architecture (SOA) to integrate and connect different systems and applications. However, this integration approach, due to its complexity and time-consuming implementation cycle, is not suitable for the rapidly moving needs of digital business imperatives like IoT. Given IoT’s adaptive nature, agile integration should be considered.

Continue reading “Using Agile Integration for IoT”

Share

Building a Secure IoT Solution: Summit 2017

How do customers build an end-to-end IoT solution using commercial grade, open source products? This is the question we (Patrick Steiner, Maggie Hu and I) wanted to address with our session at the Red Hat Summit, Boston. The end-to-end solution is based on three-tier Enterprise IoT Architecture, which integrates IoT data with existing business processes and the human element.

Continue reading “Building a Secure IoT Solution: Summit 2017”

Share

Brief Interview with James Kirkland about IoT