Simplify data integration pipeline development using AWS Glue custom blueprints

Data engineers need a way to enable non-data engineers like business analysts, data analysts, and data scientists to operate using self-service methods by abstracting the complexity of pipeline development. In this post, we discuss AWS Glue custom blueprints, which offer a framework for you to build and share reusable AWS Glue workflows.

Continue reading

creative internet computer display

Effective data lakes using AWS Lake Formation, Part 2: Creating a governed table for streaming data sources

We announced the preview of AWS Lake Formation transactions, row-level security, and acceleration at AWS re:Invent 2020 . In Part 1 of this series , we explained how to set up a governed table and add objects to it. In this post, we expand on this example, and demonstrate how to ingest streaming data into governed tables using Lake Formation transactions.

Continue reading

1 34 35 36 37 38 41