RedJamJar Software Services

Full-Stack Data Engineering Consultant

recent posts

about

Data engineering specialist with 10+ years experience building scalable ETL pipelines, functional programming advocate, and open-source contributor focused on Scala/ScalaJS ecosystems

    Category: Software

    • Automating ETL Workflows with Apache Airflow: A Comprehensive Guide

      Apache Airflow has become a cornerstone tool in the data engineering world, offering robust workflow orchestration capabilities. As someone who has extensively used Airflow, I can attest to its flexibility and power in automating ETL processes. In this guide, I’ll walk you through setting up Airflow using Docker, creating and scheduling Directed Acyclic Graphs (DAGs),…

    • Why I Switched to dbt (Data Build Tool) and How It Improved our Data Workflow

      As a seasoned software engineer, I’m always on the lookout for tools that can streamline my workflow and enhance productivity. Over the past month, I’ve been using dbt (Data Build Tool), and it has transformed the way I handle data operations. In this blog post, I’ll share why I made the switch and how dbt…