And what is your impression of Amundsen? My impression about the open-source data catalogs I've reviewed that they are limited in one sense or another, e.g. if you use only Airflow for your ETL, you would be able to get the whole picture of the data lineage and benefit from Marquez. I also wondered how the commercial products like Alation are. I think I understand why data catalog projects usually fail . In my opinion, it would require huge efforts in getting data catalogs work fully, not as a mere list of sources.

--

--

Eka Ponkratova (@thatdatabackpacker)
Eka Ponkratova (@thatdatabackpacker)

Written by Eka Ponkratova (@thatdatabackpacker)

A data engineering specialist for small businesses and startups.

No responses yet