Cloud Native Continuous Delivery on Kubernetes with Tekton

The use case that we’ll be looking at is this, where we have parameters coming into this pipeline that has five paths, as a cloning, linting, testing, building, and then running task

Users can specify custom tasks, which are implemented by Kubernetes controllers that run on the cluster to provide functionality that’s not available directly in the Tekton pipelines API.

Continue reading

Financial Crime Discovery using Amazon EKS and Graph Databases

We needed a solution that could scale and process millions of transactions, by effectively using high memory and CPU configurations to perform complex queries quickly

We used a graph database, Amazon Elastic Kubernetes Service (EKS), and Amazon Neptune, to search for suspicious financial chains across large amounts of transactional data in minutes.

Continue reading

Build a modern data architecture on AWS with Amazon AppFlow, AWS Lake Formation, and Amazon Redshift: Part 2

The modern data platform ingests delta changes from all source data feeds once per night. The orchestration and transformations of the data is undertaken by dbt. dbt enables data analysts and engineers to write data transformation queries in a modular manner without having to maintain the run order manually.

Continue reading

1 … 179 180 181 182 183 … 186