logoalt Hacker News

e1gen-vtoday at 6:47 PM1 replyview on HN

Oh I see it uses open lineage. I thought it was able to handle discovery


Replies

charlie-haleytoday at 6:59 PM

It can handle discovery within a plugin if the asset types are related. You can also manually add lineage via the UI or use Terraform to create lineage links via IaC. It's pretty complicated to automatically handle discovery of asset lineage, I'm yet to find a nice way of doing it that can work for many use-cases