Atlassian's Data Lake, Socrates, is used by over 1500 internal users every month to gain insights and drive decisions. In this session we will give an overview of how Socrates uses Amazon S3, Amazon Kinesis, Amazon Athena, Amazon EMR, and AWS Glue to build the four pillars of any data lake: Ingest, Prepare, Store, and Query. We will focus on the goals of self-service and scalability, discuss the various challenges encountered, and the solutions found.
Speakers:
Steve Lee, Senior Data Engineer, Atlassian
Resource: