Photo by JJ Ying on Unsplash

On my journey developing data science applications, I often encounter challenges surrounding data. Most of these challenges are related to data quality, data availability and documentation. In this write-up, I want to show you how you can overcome some of these challenges by using a nifty open source tool called Data Build Tool (DBT) developed by Fishtown Analytics. In this piece I will discuss the following:

  • Our development process and its challenges
  • Why mocking data is hard
  • What is the added value of DBT?
  • The key components in a DBT project
  • DBT’s testing capabilities
  • Lineage and documentation
  • Some limitations that…

Jelmer Offenberg

Machine Learning Engineer! I have a passion for programming and technology.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store