Few sectors have the scale and complexity as the energy and utilities industry. Hortonworks 100% open-source connected data platforms can help you make sense of it faster than you ever imagined, with a single view of assets (we enhance grid visibility by orders of magnitude), operations and customers, predictive maintenance to prevent blackouts and leaks, and smart meter analytics to detect outages and energy theft, and customer analytics to optimize customer service.
Power and utility companies around the globe face significant industry changes that are transforming how they conduct business. They must deliver safe, dependable, and affordable energy to their customers while also managing the pressures associated with increasingly stringent regulatory requirements, aging assets, rising demand for alternative energy sources, and an immense growth in data generated from newly deployed Advanced Metering Infrastructures (AMI). Many of the world's largest power and utility companies have turned to Hortonworks' Connected Data Platforms to manage their data in motion and data at rest—improving reliability, operational efficiency, profitability, and customer satisfaction.
Smart Meter Analytics Improve Grid Reliability
Modern utility companies need to capture, transmit, analyze and store smart meter data in order to meet their business objectives associated with installing Advanced Metering Infrastructures. But their data architectures were designed during a simpler time when a monthly measurement was the norm. Smart meters collect information multiple times every hour, creating a vast, constant, and rich stream of data that utility companies are ill-equipped to process and store efficiently on legacy database platforms.
With 100% open-source Connected Data Platforms from Hortonworks, utilities enhance their grid visibility by orders of magnitude. Hortonworks helps them monitor their data-in-motion from operated assets in real-time and compare that to deep historical analysis on past trends. That data discovery powers actionable intelligence for remote operations support, and also delivers real-time insights to: increase grid reliability, balance loads, reduce outages, and detect fraud.
A Single View of Assets to Optimize Grid Operations
Historically, power and utility companies’ operational technology (OT) and information technology (IT) systems have been developed, maintained, and used by siloed personnel within the organization. This reality has hindered cross-company collaboration and data visibility across business units, resulting in higher operating and energy costs, prolonged outages, inefficient operations, and poor customer service.
From the beginning, Apache™ Hadoop® was architected to combine data from many different sources with highly variable formats. Apache NiFi identifies all of those sources and moves them to a central location for storage and analysis (both in real-time and batch). Now Hortonworks offers both of those technologies in an integrated set of solutions. Connected Data Platforms integrate data from siloed operational, IT, and external systems, enabling OT/IT convergence to create new dashboards for a single view of assets. This cross-company visibility reduces downtime and optimizes grid operations, potentially saving millions of dollars.
Predictive Equipment Maintenance to Prevent Blackouts
Traditionally, operators gathered data on the health of generation, transmission, distribution and metering equipment through physical inspections. This meant that inspection data was sparse and difficult to access, particularly considering the high value of the hardware in question and the potential health, safety, and convenience impacts of equipment malfunctions.
Predictive maintenance helps utilities determine the condition of in-service equipment and then predict when maintenance should be performed. Rather than sending a maintenance truck based on the the time of year, utilities now send them based on the the actual need for repair. This visibility reduces failures and lower costs associated with routine or time-based preventive maintenance.
Single View of the Household for World-Class Customer Service
Utility companies built legacy data systems with a one-to-one relationship between the end application and storage platform. For example, the billing team manages a payment system with its database, the customer care team stores call logs in a CRM system, and the field service team stores data on service trucks and work orders. Hortonworks has helped some of the largest utility companies create a single view of their data and uncover value that might have been within reach, but scattered across multiple interactions, channels, groups and platforms. With that single view, they create customer personas, rank them by usage, optimize service calls, reduce churn and adjust target marketing for offers on value-added services like budget billing.
Energy Trading Intelligence, One Step Ahead of the Markets
Wholesale energy market participants face similar data challenges as utility operators, with an even more diverse set and volume of data sources that need to be collected, processed, stored, integrated and analyzed in order to reduce risk. Sources include sensor data from operated assets, market and exchange data, ERP data, data from trade and risk management platforms, and other internal and external sources.
Real-time trading solutions powered by Hortonworks enable energy traders to react instantaneously to market opportunities, without exposing their organizations to undue legal or financial risk. For example, one customer leverages our Connected Data Platforms to ingest, process, and analyze real-time electricity market data from a commodity exchange data service to enrich data in their existing trading platforms. This improves forecasting, allows them to identify market irregularities, and helps detect fraudulent trading practices.
153 Years of Mission-Critical Data: Why DNV GL Turned to Hortonworks
DNV GL has an impressive 153 years of history, dating back to 1864 when the company inspected and evaluated Norwegian merchant vessels. Fast-forward to today, DNV GL now operates in over 100 countries and provides services for several industries including maritime, renewable energy, oil & gas, electrification, food & beverage, and healthcare. According to Rene…
Big Data Re-energizes Customer Experience and Mobility at Centrica
There’s an old myth that says lightning can’t strike the same place twice, but Big Data can control precisely where energy strikes at any given time. Customers in every industry are constantly on the move, and with ever-developing mobile technologies, companies are forced to meet their customers everywhere they go. This is true even in…
Don’t miss the Business of Data at DataWorks Summit
Business and tech leaders know that harnessing the information they need to become a data-driven organization is no simple task: rapidly assimilating, integrating, and analyzing big data streams from internal and external sources to produce actionable insights can be daunting. The DataWorks Summit/Hadoop Summit community has put together more than 170 sessions on the business technology…
CenterPoint Energy: Business Value from Large, Complex Data
The San Jose DataWorks Summit (June 13-15) is just a few weeks away! We’re busy finalizing the lineup of an impressive array of speakers and business use cases. This year our Data Processing & Warehouse Track will feature Daniel Sumners, IT Architect at CenterPoint Energy. CenterPoint Energy is a Fortune 500 electric and gas utility company operating in several…
Time is running out to secure your spot at DataWorks Summit/Hadoop Summit. With over 170 sessions featuring top organization using open source technologies to leverage their data, drive predictive analytics, distributed deep-learning, and artificial intelligence initiatives, you don’t want to miss the industry’s premier event. Join us June 13 – 15 in San Jose and save…
Open Energi on the Business Value of Hortonworks Technical Expertise
Open Energi is a UK clean tech company working with businesses to intelligently optimize their electricity demand and to deliver both revenue and cost savings. The company pioneers in its market in terms of services, real-time analytics, machine learning, and Internet of Things (IoT). Through Hortonworks Data Platform (HDP) and DataFlow (HDF), Open Energi developed…
A Few of Our 1,000+ Customers, In Case You Missed Last Thursday’s Earnings Call
This past Thursday, Hortonworks announced financial results for the first quarter of 2017. As always, our CEO Rob Bearden began the call by thanking our customers. Rob began his industry and use case examples by describing the DataWorks Summit in Germany, which featured presentations from the thought leaders of large European enterprises that are transforming their businesses…
Trust Your Data: How an International Data Company Built Veracity
Three weeks ago, at the DataWorks Summit in Munich, we announced the Data Hero winners for the EMEA region. The winner in the Data Scientist category was Rene Castberg, Senior Researcher at DNV GL. You can read the announcement here. DNV GL is headquartered in Oslo, Norway, and operates in over 100 counties. It provides services for several industries including maritime, renewable…
An Industrial IoT Offshore Drilling Solution Delivered in Less Than 90 Days
Baker Hughes CEO Martin Craighead says: “If a typical deep water well is like going to the moon, then the Gulf of Mexico ultra-deep water frontier is like going to Mars.”* Safely performing these kinds of complex and high risk operations requires many people to collaborate, share information and make informed decisions quickly. When…
Data is the fuel for Open Energi’s virtual power station with Hortonworks DataFlow
Earlier today, we announced that Open Energi has tripled its investment in data analytics by adding Hortonworks DataFlow to its existing use of Hortonworks Data Platform to manage its data in motion. Open Energi is at the forefront of smart grids and the Internet of Things in the UK. Put simply, it allows its customers’…
Welcome back to my blogging adventure. I want to take a break today from walking through the cybersecurity architecture for an analytic based incident response process to step back and look at the big picture in applying a mature analytic lifecycle to a cybersecurity analytic platform. I’ve had many conversations and read many articles recently…
Energy wasted through excess capacity is one of the world's most challenging problems especially in developed countries where energy doesn’t come cheap. Meet Open Energi, an organization working with businesses in the UK to harness excess capacity from their equipment and aggregating it to create a virtual power station to better meet demand. Join this…
Apache, Hadoop, Falcon, Atlas, Tez, Sqoop, Flume, Kafka, Pig, Hive, HBase, Accumulo, Storm, Solr, Spark, Ranger, Knox, Ambari, ZooKeeper, Oozie, Phoenix, NiFi, HAWQ, Zeppelin, Atlas, Slider, Mahout, MapReduce, HDFS, YARN, Metron and the Hadoop elephant and Apache project logos are either registered trademarks or trademarks of the Apache Software Foundation in the United States or other countries.