And Include in an Event-driven Workflow

Image for post
Image for post
Pololu Valley, photo by me

Introduction

I’ve been working on a project where I was required to import partitioned JSON files in an Amazon S3 bucket into a PostgreSQL database on Amazon RDS. I had worked on another project where I did something similar — taking JSON ingested with Kinesis Data Streams into S3 and performing ETL to populate staging tables in an Amazon Redshift cluster — so I figured targeting a different storage service on the same cloud platform, and a storage technology (PostgreSQL) that originally served as the basis for the other (Redshift), would be fairly straightforward. After all, I can use the same…

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store