• Home
    • About DBI
    • Award Winning Diver BI Software
    • Customer Commendations
    • The Team
    • DBI Privacy Policy
  • Articles
    • News
    • Accolades
    • Blog
  • Products
    • Diver | BI
      • Diver Workbench
      • Videos
      • Case Studies
    • Gap 360 Sales Analysis
      • Diver on demand in the Cloud
  • Applications
    • Property
      • Property Prices Ireland
    • Supply Chain
      • Retail
      • Wholesale
      • Distributor
      • Produce
      • Manufacturing
      • Autoparts
      • Transport
      • Beverage Alcohol Suppliers
      • Beverage Alcohol Distributors
      • DI Program Advisor
    • Diversity
      • Waste management
      • Telecom Brokerage
      • Colleges & Universities
      • Economic Trends
      • Maps
      • Travel & Tourism
      • Parking
      • Smart Meters
      • Carbon Emissions Management
    • Healthcare
      • Healthcare
      • Pharma Applications of Diver
      • DI Surgery Advisor
      • DI Physician Performance Advisor
    • Finance
      • Finance
      • DI GL Advisor
    • Mobile
      • DiveTab Mobile BI
  • Partners
    • Dimensional Insight
    • Diver BI Group
      • Envisage
      • Chartwell IT
      • Cloud-works Solutions Ltd
      • Data Management Business Insight
      • Manitex
      • Equiniti ICS
      • Pinnula
      • Formell
      • IBI
    • Zight – Partner for Transport
    • 24/7 Uptime
    • ID Technology (Brazil)
    • Infotool (Nordic Countries)
    • BIMAXIS – DI France
    • KDE Group (Israel)
  • Services
    • SaaS
    • Training
    • Support
    • Software Development
    • Consultancy
  • Contact

DBI Dynamic
Business
Informatics

Home Articles When is an End-to-End BI Solution truly End-to-End?

When is an End-to-End BI Solution truly End-to-End?

Monday 23rd March 2015

Today’s crowded BI marketplace is packed with vendors jostling for a stall to vend their wares. Some have been around for more than a quarter of a century and some are relative infants. To the uninitiated, the companies that make up this mix can, at first glance, all seem to be offering a different version of the same solution; the same engine with different bodywork. Some BI products have gained traction and have grown rapidly – maybe too fast for their own good, like an infant that shoots up but hasn’t yet filled out and matured enough to leverage his height advantage.

SHINY NEW THINGS

Some of the newer players made their entrance noisily trumpeting their power, speed, data volume capabilities, superior data visualisations etc. Decision makers being presented with the razzmatazz of such a product’s user interface can be wowed into opting for the shiny new thing without considering the realities of how it actually performs as a mature enterprise-wide solution. Too late into the deployment do they discover not the promised insights from their data, but “cracks” beginning to appear in the product’s ability to integrate seamlessly all the data from disparate sources that makes up their business.

It is generally accepted that a successful BI deployment requires an ETL layer where data is consolidated from disparate sources and “fed” to the BI product. ETL stands for Extract, Transform and Load and the main purpose of the ETL layer can be defined as follows:

• Extraction of data from legacy or other sources which are usually heterogeneous.
• Data Transformation – for example transforming data that is optimised for transaction processing into data that is optimised for analysis and reporting.
• Synchronisation and cleansing of the data plus the ability to apply complex business rules.
• Loading of the data into a data mart or data warehouse or other data model.

But let’s consider the scenario above, where a company has opted for the “shiny new thing”. Once the initial integration is rolled out with, maybe, one set of clean data, the first flurry of excited users see how much power they have to create their own insights, and they soon develop an appetite for more. And crave more. They soon realise that in order to get a complete view of what is going on in their businesses, they need to add in those key spreadsheets with budgets or that market data that doesn’t reside in the ERP system, so they start demanding more information from different sources.

TWO OPTIONS LEADING WHERE?

So how do BI providers, whose products fail to cope with synchronising and joining data, solve this issue? There seem to be two paths they can go by – but in this case unfortunately neither of them lead to BI’s Stairway to Heaven.
Heaven

1. Some providers develop their own ETL software “after the fact” and bolt it on to their products OR
2. Partner with a third-party provider of back-end ETL software to plug the gaps and cover up their product’s shortcomings.

The problem with option 1 is that if the ETL layer is not developed in conjunction with all the other components of the offering prior to general release then there is inevitably a huge risk of dissatisfaction within the user community – post initial deployment. It will most likely kick in as soon as the users request more data from disparate sources. The provider will often supply promises of rapid development of their ETL layer, but in all probability, what usually happens when trying to restructure a product after the fact is that there will be considerable delays in delivery. These will deepen disappointments at the user level as well as adding to frustrations of the BI developer.

This approach may also mean that there is a long waiting period before the ETL layer is truly scalable and feature rich enough to be classed as enterprise wide. In the intervening period the developers may have to use their own initiative to create “plasters” to “glue” together what is only perceived to be an enterprise wide deployment.

For this type of BI provider, option 2 might therefore seem like the best path – partnering with a known, trusted ETL provider. Initially in this scenario, the requirement for the BI product to satisfy the data integration needs of an organisation, especially in a complex business area, will be satisfied.

Jigsaw
ASK YOURSELF THESE QUESTIONS

However, if you are considering purchasing a BI product with this type of collaborative approach to delivering an End-to-End Solution, there are a number of questions I recommend you to ask yourself:

1. How is the third-party back end ETL integrated into the BI product?
2. How is the additional cost passed on to the customer?
3. How are issues resolved between the front-end and the back-end?
4. How does this affect the provider of the BI software (most likely to be a partner of the BI developer)?
5. What are the knock-on effects to the end user organisation?
6. What happens if the ETL provider partners with another BI provider or goes into the BI marketplace with its own BI offering?
7. What happens if the ETL provider company is purchased by a third-party organisation (especially if it is one that competes directly with the incumbent BI software)?

Rope

I am asking you to consider these questions as we are aware of at least a couple of competing BI vendors using the same back end software provider. As the cost of third-party dedicated ETL products is comparatively very expensive, I for one would be concerned about procuring a BI product from a vendor whose margin is compromised by having to pay a third party for their ETL layer. Why? Because it limits their scope for in-house development, to enhance the existing modules you were “wowed” by initially, to respond to user requests and keep on developing the product in line with current and future trends.

According to some industry reports ETL work can consume 60 to 80 percent of all BI projects. So if you are considering a BI deployment my advice is to choose a vendor that has:
• Developed their ETL layer in conjunction with the front end
• A proven track record over many years
• AND who continually develop their software to embrace new technologies when they emerge as well as constantly providing enhanced functionality to their user base.

THE GOOD NEWS

The good news is that The Diver Solution from Dimensional Insight (DI) falls into this category. The Diver Solution is an enterprise wide BI product that was initially released in 1989 and is constantly being updated and developed by DI.

DI develop and own their own software and do not include third-party software in their product. The product is multi-platform, scalable, robust and extremely feature rich. The Data Integrator module combined with their superior Production module provide end-user organisations the ability to rapidly develop and deploy powerful BI solutions in a fraction of the time that competing vendors would take.

The end user community of The Diver Solution are clearly fans of both the product and the support from the company, as DI consistently outscore their competitors in industry wide user surveys such as KLAS or Dresner’s Wisdom of Crowds survey.
See more on these here.

About Bob Corr
Bob Corr
Bob Corr is Managing Director of DBI and set up DBI in Feb 2003. Prior to this Bob was MD of System Options Ltd. and has been involved with The Diver Solution since 1994. Bob has been designing and implementing Diver applications since 1994, and is particularly adept at integrating Diver with new systems and engineering proof of concept applications. He has worked with many clients; mainly those with multi-national operations where BI applications are required to bring information together in one place. Bob has a proven wealth of business experience, delivering applications that permit companies to save time and money, and make better educated decisions that are critical to their success.

Avatar photo

Debbie Lonsdale, DBI

Contact Debbie

Previous PostNext Post

Latest News from DBI

  • Dynamic Business Informatics Holiday Message
  • What’s New in Diver 7.2?
  • Dimensional Insight Named an Overall Leader by Dresner Advisory Services in 2022 Industry Excellence Awards
  • Top Logistics Trends for 2022
  • Take a Look at the DIUC22 Agenda

DBI Accolades

  • Dimensional Insight Named an Overall Leader by Dresner Advisory Services in 2022 Industry Excellence Awards
  • Dresner Wisdom of Crowds 2022 – Best in Class Results
  • Klas 2022 – A Grades for Dimensional Insight
  • Dimensional Insight Earns Top Marks in 2021 Wisdom of Crowds Business Intelligence Market Study
  • Best in Klas 2021

Dynamic Business Informatics Ltd

UK & Ireland Distributor of The Diver Solution, providing business consultancy services, products and applications derived from the Diver Solution.
14 Mellifont Avenue
Dun Laoghaire
Co. Dublin

+353 1 2302022

10 Kenyon Street
Nenagh
Co Tipperary

+353 67 43309

Contact Us

We would love to hear from you! Please submit your query and we will get in touch with you shortly.

Email addresses are never sold, rented, or shared. Please see our Privacy Policy.

  • This field is for validation purposes and should be left unchanged.

DBI Blog

How a Growth Mindset Can Help You in Analytics

What are some characteristics of a growth mindset and how can having this frame of mind benefit people who work in analytics? Here are three ways.More

  • How Organizations Can Use Analytics for Supply Chain Agility
  • Inventory Analytics: Four Key Sales-Related Metrics to Watch
  • Inventory Analytics: Two Sets of Metrics that Really Matter
  • 5 Data Trends for 2023

More Blog Posts

Copyright © 2014–2023 DBI · Privacy Policy · website by cubecolour

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Cookie settingsACCEPT
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.


What Are Cookies?


As is common practice with almost all professional websites this site uses cookies, which are tiny files that are downloaded to your computer, to improve your experience. This page describes what information they gather, how we use it and why we sometimes need to store these cookies. We will also share how you can prevent these cookies from being stored however this may downgrade or 'break' certain elements of the sites functionality.


For more general information on cookies, please read "What Are Cookies".


How We Use Cookies


We use cookies for a variety of reasons detailed below. Unfortunately in most cases there are no industry standard options for disabling cookies without completely disabling the functionality and features they add to this site. It is recommended that you leave on all cookies if you are not sure whether you need them or not in case they are used to provide a service that you use.


Disabling Cookies


You can prevent the setting of cookies by adjusting the settings on your browser (see your browser Help for how to do this). Be aware that disabling cookies will affect the functionality of this and many other websites that you visit. Disabling cookies will usually result in also disabling certain functionality and features of the this site. Therefore it is recommended that you do not disable cookies.


The Cookies We Set




  • Account related cookies


    If you create an account with us then we will use cookies for the management of the signup process and general administration. These cookies will usually be deleted when you log out however in some cases they may remain afterwards to remember your site preferences when logged out.




  • Login related cookies


    We use cookies when you are logged in so that we can remember this fact. This prevents you from having to log in every single time you visit a new page. These cookies are typically removed or cleared when you log out to ensure that you can only access restricted features and areas when logged in.




  • Forms related cookies


    When you submit data to through a form such as those found on contact pages or comment forms cookies may be set to remember your user details for future correspondence.




  • Site preferences cookies


    In order to provide you with a great experience on this site we provide the functionality to set your preferences for how this site runs when you use it. In order to remember your preferences we need to set cookies so that this information can be called whenever you interact with a page is affected by your preferences.




Third Party Cookies


In some special cases we also use cookies provided by trusted third parties. The following section details which third party cookies you might encounter through this site.




  • This site uses Google Analytics which is one of the most widespread and trusted analytics solution on the web for helping us to understand how you use the site and ways that we can improve your experience. These cookies may track things such as how long you spend on the site and the pages that you visit so we can continue to produce engaging content.


    For more information on Google Analytics cookies, see the official Google Analytics page.




More Information


Hopefully that has clarified things for you and as was previously mentioned if there is something that you aren't sure whether you need or not it's usually safer to leave cookies enabled in case it does interact with one of the features you use on our site.


However if you are still looking for more information then you can contact us through our contact page

Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Non-necessary
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
SAVE & ACCEPT