alt Hacker NewsHow does this get the maps of the data flows and so on? Does it require read credentials to each data silo, or is there a manual mapping process?
How does this get the maps of the data flows and so on? Does it require read credentials to each data silo, or is there a manual mapping process?
It supports either, I didn't want to restrict people to just one method of getting their catalog populated. The CLI and Plugin system works on needing read credentials to a given Service, it then populates the catalog with those assets. Any lineage links currently need to be done manually (unless they're part of the same plugin). Otherwise, you can integrate with your existing IaC pipelines using Terraform or Pulumi to populate the catalog at deploy time instead of needing to scrape a bunch of services.