Eka Ponkratova (@thatdatabackpacker)Creating a Data Management StrategyThis article looks at how different practice areas within the DAMA DMBOK interact and support each other in managing and leveraging data…4 min read·Apr 9, 2024----
Eka Ponkratova (@thatdatabackpacker)Is anybody loading data in fact and dimension tables the pure-Python way?The objective of the blog is to implement Slowly Changing Dimensions Type 2 (SCD2) and fact tables with a lookup to an SCD2 using Redshift…7 min read·Mar 16, 2024--2--2
Eka Ponkratova (@thatdatabackpacker)Moving Data with Mage on AWS ECSWhat’s that all about Mage?2 min read·Dec 29, 2023----
Eka Ponkratova (@thatdatabackpacker)Airflow is not an ETL tool…Introduction9 min read·Dec 17, 2023--7--7
Eka Ponkratova (@thatdatabackpacker)CI/CD pipeline with Google Compute Engine and GitHub Actions, part IIIn the previous blog post, I reviewed how CI/CD could keep the team in sync and save time by automatically merging code changes. Today I…4 min read·Sep 30, 2023----
Eka Ponkratova (@thatdatabackpacker)inPlumbers Of Data ScienceBuilding a CI/CD Pipeline for Apache Airflow DAGs, part II was sitting and looking at the formula that calculates ROI for task automation: TIME (spent on a single manual task) x FREQUENCY (of…5 min read·Sep 16, 2023----
Eka Ponkratova (@thatdatabackpacker)Part II or Stale data detection with dbt and Redshift metadataIn an ideal world, your SaaS provider, e.g. Xero allows you to export your data or has some systems in place that push data to your…6 min read·Mar 27, 2023----
Eka Ponkratova (@thatdatabackpacker)To continue with a metrics store, part II‘Why do we have X as a revenue in the report A and Y, in application B?’ You start digging and realize that in the first case, the analyst…8 min read·Mar 19, 2023----
Eka Ponkratova (@thatdatabackpacker)Stale data detection with dbt and BigQuery dataset metadataSee Part II or last modified in Redshift at…3 min read·Mar 5, 2023----
Eka Ponkratova (@thatdatabackpacker)Integration of dbt with other systems“I could do X with the system but cannot complete Y. What do I do?” The rise of the modern data stack trend caused many vendors to appear…2 min read·Feb 7, 2023----