Loading Events

« All Events

  • This event has passed.

Developing an Event-Driven Broker Based Data Pipeline

2023-12-05 @ 12:00 PM - 1:00 PM

This presentation looks at the journey of an upstream producer to make data more accessible throughout all aspects of the business. The traditional data movement of scheduling demand polling through a SCADA server has worked very well and will continue to work well for many workflows. However, as new demands for the data emerge, the possibility of simply increasing the polling frequency stressed the network and compute infrastructure, which led us down the journey of implementing an event-driven data broker data pipeline.

The journey started with streaming data from a historian to a 3rd party’s SaS offering for offset monitoring, and it didn’t take long to understand how else we could use this solution to improve data movement for inter-field data exchanges, remote data collection, and streaming to cloud services. We’ve since used this pipeline to bring data from corporate systems into our field control applications while adhering to strict security guidelines.

Lastly, having a live data feed is only beneficial to those who understand the origin of the data streams. So, a critical part of this solution is to model the data at source by adding context, and metadata is a crucial part of ensuring the rest of the business can easily leverage the data pipeline.

We’ve had numerous successes, and just as many failures during this journey, and the presentation is intended to share some of each.

CLICK HERE to REGISTER

Details

Date:
2023-12-05
Time:
12:00 PM - 1:00 PM
Event Categories:
, ,
Website:
https://www.specalgary.com/product-page/developing-an-event-driven-broker-based-data-pipeline

Organizer

SPE – Calgary Section
Phone
403-930-5453
Email
calgarysection@spe.org
View Organizer Website

Venue

Calgary Petroleum Club
319 Fifth Avenue SW
Calgary, Alberta T2P 0L5 Canada
+ Google Map
Phone
403-269-7981
View Venue Website