Big Data Quality Assurance

Javier Ramos
ITNEXT
Published in
5 min readSep 11, 2020

--

Introduction

This article is an extract of my article Big Data Pipeline Recipe. In this short post I will try to summarize the data quality tools available for your data pipeline.

Will you submit code to production without tests or code review? So, why are companies building pipelines without testing their data assets?

Data Quality

--

--

Certified Java Architect/AWS/GCP/Azure/K8s: Microservices/Docker/Kubernetes, AWS/Serverless/BigData, Kafka/Akka/Spark/AI, JS/React/Angular/PWA @JavierRamosRod