Log in

Data Vault

  • Follow Up Data Vault EXASOL Webinar

    In July 2016 Mathias Brink and I had given a webinar how to implement Data Vault on a EXASOL database. Read more about in my previous blogpost or watch the recording on Youtube.

    Afterward I became a lot of questions per our webinar. I’ll now answer all questions I got till today. If you have further more questions feel free to ask via my contact page,via Twitter, or write a comment right here.

  • Generating large example data with TPC-H

    Several times I had the need for some large data sets to do some Data Vault tests at customer site, writing a blogpost, doing a demo or a webinar and many more. And sometimes I need data to do performance or data usage tests on different databases. Due to my work together with EXASOL I focused on the TPC-H tool DBGen to generate gigabytes of data.

    To share my experience with DBGen generating large data sets I wrote this blogpost as a step by step instruction.

  • High performance - Data Vault and Exasol

    You may have received an e-mail invitation from EXASOL or from ITGAIN inviting you to our forthcoming webinar, such as this:

    Do you have difficulty incorporating different data sources into your current database? Would you like an agile development environment? Or perhaps you are using Data Vault for data modeling and are facing performance issues?
    If so, then attend our free webinar entitled “Data Vault Modeling with EXASOL: High performance and agile data warehousing.” The 60-minute webinar takes place on July 15 from 10:00 to 11:00 am CEST.
  • High-performance Data Vault

    TPC-H benchmark data model

    Over the last few weeks, Mathias Brink and I have worked hard on the topic of Data Vault on EXASOL.

    Our (simple) question: How does EXASOL perform with Data Vault?

    First, we had to decide what kind of data to run performance tests against in order to get a feeling for the power of this combination. And we decided to use the well-known TPC-H benchmark created by the non-profit organisation TPC.

    Second, we built a (simple) Data Vault model and loaded 500 GB of data into the installed model.  And to be honest, it was not the best model. On top of it we built a virtual TPC-H data model to execute the TPC-H SQLs in order to analyse performance.

  • How to load easy some data vault test data

    Some time ago a customers asked me how to load easy and simple some (test)data into their database XYZ (chose the one of your choice and replace XYZ) to test their new developed Data Vault logistic processes.
    The point was: They don’t want to use all this ETL-tool and IT-processes overhead just to some small test in their own environment. If this this is well done from a data governance perspective? Well, that’s not part of this blogpost. Just do this kind of thingis only in your development environment.

  • Increased quality and sped up process

    Dirk Lerner was engaged to coach my efforts of creating a data warehouse using data vault 2.0 architecture. It has been a pleasure to work with Dirk. The guidance given has greatly increased the quality of the design and sped up the entire process.

    After the first six-month engagement, I put together a financial analysis to examine the ROI of this engagement. What was found is to reach the same point in the project without the coaching engagement would have cost us three times the cost of the coaching and would have expanded the timeline.

    Therefore, engaging Dirk for coaching conceptual, logical and data vault data modeling was certainly worth it and would do it again without hesitation.

    Edwin Farrar, Enterprise Data Architect

  • Knowledge Base

  • Look Back Over DMZ

    I was at the Data Modeling Zone Europe 2016 in Berlin as a speaker. It was the 4th Data Modeling Zone in Europe and in my opinion one of the best per the conference program and the interesting and awesome chats with other speakers and attendees. This year’s venue was the Abion Hotel in Berlin, situated next to the Spreebogen and for this a great environment around the venue.

  • Look Back Over TDWI 2016

    Last week in June I was at the TDWI Conference 2016 at Munich. ITGAIN, my employer, had as a platin sponsor a booth to present our products and services!

    In my point of view, it was another great TDWI conference at Munich with a lot of awesome people I could talk with - including an interesting discussion about data architecture with Mark (Madsen) and all the nonsense happening in the Big Data world.

  • Meetup – Data Vault Interest Group

    I reactivated my Meetup Data Vault Interest Group this week. Long time ago I was thinking about a table of fellow regulars to network with other, let’s call them Data Vaulters. It should be a relaxed get-together, no business driven presentation or even worse advertisement for XYZ tool, consulting or any flavor of Data Vault. The feedback of many people was that they want something different to the existing Business Intelligence Meetings. So, here it is!

  • Mehr Qualität und beschleunigte Prozesse

    Dirk Lerner wurde damit beauftragt, mich bei der Erstellung eines Data Warehouse unter Verwendung der Data Vault 2.0 Architektur zu unterstützen. Es war ein Vergnügen, mit Dirk zu arbeiten. Die Beratung hat die Qualität des Designs erheblich verbessert und den gesamten Prozess beschleunigt.

    Nach sechs Monaten der Zusammenarbeit habe ich eine wirtschaftliche Bewertung erstellt, um den ROI zu untersuchen. Es hat sich gezeigt, dass es uns dreimal so viel gekostet hätte, den gleichen Punkt im Projekt ohne das Coaching zu erreichen, und dass sich der Zeitplan ohne die Zusammenarbeit deutlich verlängert hätte.

    Daher hat sich die Beauftragung von Dirk für das Coaching der konzeptionellen, logischen und Data-Vault-Datenmodellierung auf jeden Fall gelohnt und ich würde es ohne zu zögern wieder tun.

    Edwin Farrar, Enterprise Data Architect

  • Methodik zur Lösung bitemporaler Aufgaben

    Dirk hat eine sehr gut strukturiertes Training über temporale Daten durchgeführt. Sie hat mir sehr geholfen, mein Wissen über dieses anspruchsvolle Thema zu erweitern. Noch wichtiger ist, dass er mir eine hilfreiche Methodik für den Umgang mit bitemporalen Herausforderungen in meiner täglichen Arbeit bei der Modellierung und Implementierung von Data Vault vermittelt hat. Ich empfehle diese Schulung jedem, der sich für dieses Thema interessiert und seine Fähigkeiten in der Datenmodellierung verbessern möchte oder einfach mit Herausforderungen in der bitemporalen Modellierung konfrontiert ist.

    Vielen Dank an dich Dirk!

    Yannick Sigwalt | Lead Data Architect, Robert Bosch GmbH

  • Methodology to handle bitemporal challenges

    Dirk set up a very well structured training on temporal data. It helped me a lot to develop my knowledge on this challenging topic. More important it provided me with a helpful methodology to handle bitemporal challenges in my every days Data Vault modelling and implementation activities.  I highly recommend this training to anybody who is interested in this topic, and wants to enhance their data modeling skills, or simply faces challenges in bitemporal modeling. 

    Thank you Dirk!

    Yannick Sigwalt | Lead Data Architect, Robert Bosch GmbH  

  • Modeling the Agile Data Warehouse with Data Vault

    Dieses Buch ist ein MUSS für alle, die an Data Vault interessiert sind und auch für alle die sich für Business Intelligence und (Enterprise) Data Warehouse begeistern.
    Es ist aus meiner Sicht toll geschrieben: leicht verständlich und es sind alle Themen rund um Data Vault sehr gut erklärt.

  • Open-Data-Vault-Models

  • Presentations

  • Reflections on Data Natives conference, October 2016

    A conference for the data-driven generation!

    It’s late October 2016, an incredible crowd of young data-driven peeps are on their way to Berlin, looking forward to meet many other peeps with the same attitude at the Data Natives conference: Doing business with data or seeing a huge value in using data for the future. Besides the crowd I was not only impressed by the location but also by the amount of startups at the conference.

    The schedule for two days was full packed with talks and it wasn’t easy to choose between all these interesting topics. So I decided not to give myself too much pressure. Instead I cruised  through the program, and stumbled on some highlights.

  • Reflections on Global Data Summit 17

    This blog post will be a review of the Global Data Summit. But first I would like to lose a few sentences about the Advanced Data Vault & Ensemble Modelling meeting, organized by Hans Hultgren and Remco Broekmann. It is an event that brought together experienced data modelers from all over the world (New Zealand, South Africa, Europe and the USA) around Data Vault, Focal and Ensemble Logical Modeling (ELM). That sounds promising, doesn't it?

    Advanced Data Vault & Ensemble Modelling

    There were two interesting days with many topics around Data Vault and ELM, which were put up for discussion. The idea behind the meeting is to think further, e. g. where to go with Data Vault and ELM and what the participants can contribute from their own experiences. I personally find some of the points discussed very interesting and exciting and should be pursued further. With others I have to go into myself and continue researching. Most likely, I'll go into other blog posts on different topics, such as the discussion about concatenated key, partitioned links or how you can do without satellites on links. I will see.

  • Rüchschau 1. DDVUG

    Am Dienstag, den 24. Juni 2014, war es so weit! Wir haben uns, viele Data Vault Begeisterte, zum ersten Mal in Form einer User Group getroffen!DDVUG Dan Linstedt und das Star Schema Im Zuge der TDWI 2014 Konferenz hatten wir die Möglichkeit uns ebenfalls im MOC in München zu treffen. Danke hier auch an das ganze Team des TDWI.

    Super organisiert durch Christian Hädrich, war sogar Dan Linstedt als Ehrengast eingeladen. Sein Vortrag über die Entstehung von Data Vault war super anzuhören. Dieser soll in Kürze auf You Tube erscheinen. Wir sind gespannt.

  • Rückblick auf die Data Vault User Group im Mai 22

    Vergangene Woche hatte ich die Möglichkeit online bei der Data Vault User Group über temporale Daten vorzutragen: Who, how, what - why bitemporal data? Who does not ask will not be wise!