Close
  • Home
  • Applications
      • Asset Management
      • Business Intelligence
      • CEM
      • Cognitive
      • Compliance
      • CRM
      • Data Center
      • E-Invoicing/E-Billing
      • Enterprise Communication
      • Enterprise Mobility
      • ERP
      • Facility Management
      • GDPR
      • Human Resource
      • Information Security
      • ITSM
      • Managed IT Services
      • MarTech
      • Payment and Card
      • Procurement
      • RegTech
      • Risk Management
      • RPA
      • Software Testing
      • Unified Communication
  • Verticals
      • Automotive
      • Casino Tech
      • Contact Center
      • Enterprise Startups
      • Field Service
      • FinTech
      • Healthcare
      • Legal Tech
      • PropTech
      • Telecom
      • Travel and Hospitality
  • Technologies
      • Agile
      • Artificial Intelligence
      • Augmented & Virtual Reality
      • Big Data
      • Blockchain
      • Cloud
      • Data Analytics
      • DevOps
      • Drone
      • HPC
      • IoT
      • Robotics
      • Smart City
      • Storage
  • Company Eco System
      • Adobe
      • Dassault Systemes
      • HPE
      • IBM
      • Microsoft
      • Oracle
      • Salesforce
      • SAP
  • News
  • conferences
  • Newsletter
  • Specials

  • Menu
      • Big Data
      • Blockchain
      • Casino Tech
      • CEM
      • Cloud
      • CRM
      • DevOps
      • Drone
      • Facility Management
      • GDPR
      • IoT
      • Legal Tech
      • Oracle
      • PropTech
      • RPA
  • Blockchain
  • Cloud
  • CRM
  • Drone
  • Facility Management
  • IoT
  • Oracle
Specials
  • Specials

  • Big Data
  • Blockchain
  • Casino Tech
  • CEM
  • Cloud
  • CRM
  • DevOps
  • Drone
  • Facility Management
  • GDPR
  • IoT
  • Legal Tech
  • Oracle
  • PropTech
  • RPA
×
#

CIO Applications Europe Weekly Brief

Be first to read the latest tech news, Industry Leader's Insights, and CIO interviews of medium and large enterprises exclusively from CIO Applications Europe

Subscribe

loading
  • Home
  • Big Data
Editor's Pick(1 - 4 of 8)
left
Pushing The Envelope With Big Data

Elena Gil Lizasoain, CIO, CEO, LUCA

Efficient Data Management in the Healthcare Space

Jim Simpson, SVP & CIO, AvMed

Big Data: The Catalyst of Digital Transformationtion

Mona Badie, CIO & CDO, GE Hitachi Nuclear Energy

Leveraging Biomedical Big Data: A Hybrid Solution

Bryon Campbell, Ph.D., CIO, Van Andel Institute

Big Data & Insights: Oil for the Digital Age

Radhika Venkatraman, SVP - CIO, Network & Technology, Verizon

Big Data and Credit Scoring in Indonesia

Shawn Paskevic, CIO, NEBCO, Inc

Big Data Is The Biggest Trend Currently

Tony Hashem, CIO, Holmes Murphy

Technology Transforming Manufacturing

Matt Meier, VP And CIO – North America, Whirlpool Corporation

right

THANK YOU FOR SUBSCRIBING

Accelerate Data Analytics with DataOps

By Harvinder Atwal, Head of Data Strategy and Advanced Analytics, MoneySuperMarket.com

Tweet
content-image

Harvinder Atwal, Head of Data Strategy and Advanced Analytics, MoneySuperMarket.com

It is an amazing time to be working with data. Exponential growth in data collection, advances in artificial intelligence (AI) algorithms, an explosion in software libraries for working with large quantities and varieties of data, and improvements in big data technologies for storing and processing data are ushering in a digital transformation. At the heart of the revolution is a data analytics ecosystem of skills to exploit new opportunities that include data science, data engineering and the broader fields of data and business analytics.

The data-driven digital revolution is beginning to transform every aspect of our lives from personalised health care or financial management, to how we interface with machines, whether it is a self-driving car or virtual assistants. However, we are also only at the start of the journey to understand the best processes required to deliver desired outcomes from raw data. Modern data analytics is still in the comparable transition phase between bespoke handcrafted production and mechanised automation that manufacturing confronted during the early nineteenth century. Unfortunately, the lack of maturity means there is plenty of evidence that returns on substantial investment in data capability is not uniformly positive. According to Forrester Research, only 22% of companies see a significant return from data analytics expenditures.

Despite the high failure rate, the prescriptions and discussions remain the same. Big data technology vendors promote the latest storage and processing solutions, but adding new technology to legacy processes results in much more expensive legacy processes. Most data scientists talk about how to create machine learning or AI models, but not many speak about getting them off laptops into scalable production workflows where they can affect customers. Solutions vendors talk about the latest platforms but not how to overcome organisational barriers to using data effectively.

Most approaches for managing and consuming data were developed in a world where data was scarce; computer resource was expensive, storage constrained, access restricted, the opportunity to test and learn minimally, and digital automation non-existent.
We now live a world with fewer constraints and expect data-driven decisions to be made everywhere and in smaller and smaller increments from auto-enhancement in a photo-editing mobile app to sentence autocomplete in webmail. It is also now cheaper than ever before to generate empirical data to learn and reduce the uncertainty of decision-making. Nevertheless, most organisations still approach data analytics as a series of large bespoke, waterfall research projects with artificial constraints in the provision of data, software, and systems. Poor returns on data analytics investment are often a result of applying 20th-century thinking to 21st-century opportunities.

Manufacturing and software development have also faced similar challenges as data analytics. To add value as quickly and efficiently as possible, yet deal with high levels of complexity and uncertainty, they created revolutionary approaches, Lean thinking, Agile practices, and DevOps culture. DataOps is an emerging methodology that applies these approaches to the unique needs of data analytics:

Poor returns on data analytics investment are often a result of applying 20th-century thinking to 21st-century opportunities

• Agile collaboration breaks down data and organisational silos to ensure we work on the "right things" that add value for the "right people."

• Lean manufacturing like focus eliminates waste and bottlenecks, continuously improves speed and quality, monitors data flows and makes it cheap to put data into the hands of consumers.

• DevOps mindset allows teams to move at rapid speed using highly optimised self-service tools and automated processes across the whole data lifecycle to continuously deliver what customers need.

The name DataOps is a portmanteau of Data and Operations and was first introduced by Lenny Liebmann in a 2014 blog post. Since then, interest has snowballed, and DataOps made Gartner's "Hype Cycle" for Data Management in 2018. The goal of DataOps is to turn unprocessed data into a valuable data product for customers through a rapid, scalable and repeatable process. Numerous times a day we are customers of a data product whether it is a Google Maps route request, a Netflix product recommendation, or even a business report. It is not a one-off project; a data product is in continuous production with constant monitoring, iteration based on experimentation and feedback leads to improvement, it is reproducible, and it brings customer and organisational benefit.

DataOps brings together self-contained teams with data analytics, data science, data engineering, DevOps skills and line of business expertise in close collaboration. The DataOps team view the analytical pipelines between raw data and data product as a lean manufacturing line, and they orchestrate the data, code, and environments from start to end. Self-service access to tools and data allows DataOps teams to deliver quickly but requires trust; trust in data and trust in the users of data. Trust in data occurs from constant monitoring and testing for quality as data moves through pipelines. Trust in users of data comes through robust data governance and data management practices that respect agility.

DataOps practices encourage organisations to take a collaborative end-to-end view of their data flows to increase data analytics speed to market and value. With DataOps, organizations remove many of the challenges faced in delivering modern data analytics allowing them to thrive in the data-driven digital revolution.

See Also:

Top Big Data Solution Companies

Top Big Data Consulting Companies

Check This Out:- Top Data Analytics Consulting/Services Companies

Check This Out:- Top Data Analytics Solution Companies

tag

DevOps

Big Data

Agile

Data Management

Read Also

Big Data & Insights: Oil for the Digital Age

Big Data & Insights: Oil for the Digital Age

Radhika Venkatraman, SVP - CIO, Network & Technology, Verizon
Big Data and Credit Scoring in Indonesia

Big Data and Credit Scoring in Indonesia

Shawn Paskevic, CIO, NEBCO, Inc
Big Data Is The Biggest Trend Currently

Big Data Is The Biggest Trend Currently

Tony Hashem, CIO, Holmes Murphy
Technology Transforming Manufacturing

Technology Transforming Manufacturing

Matt Meier, VP And CIO – North America, Whirlpool Corporation

Weekly Brief

loading
cxoinsights
Top 10 Big Data Consulting/Services Companies - 2019
ON THE DECK

Big Data 2019

Top Vendors

Big Data 2018

Top Vendors

Previous Next

Top Trending News

  • 4 Latest Enterprise Mobility Trends to Follow
    4 Latest Enterprise Mobility Trends...
  • Is 5G a Game-Changer for the European Healthcare Industry?
    Is 5G a Game-Changer for the European...
  • 3 Digital Trends Influencing the European Hospitality Industry
    3 Digital Trends Influencing the...
  • How is the European M&E Industry Preparing for 5G?
    How is the European M&E Industry...
View More ›

Copyright © 2019 CIOApplicationsEurope. All rights reserved. Registration on or use of this site constitutes acceptance of our Terms of Use and Privacy Policy |  Sitemap |  Subscribe |  About Us

follow on linkedin follow on twitter follow on rss
This content is copyright protected

However, if you would like to share the information in this article, you may use the link below:

https://big-data.cioapplicationseurope.com/cxoinsights/accelerate-data-analytics-with-dataops-nid-911.html