FSV303: Building Queryable Archives and Data Lakes for Financial Services

Financial institutions today must manage multiple data types from a wide variety of sources. Among these various data types, archive data presents a particular challenge: it is invisible to much of the organization and not easily leveraged by the lines of business for analytics, insight, and product innovation. Faced with massive volumes of archive data, Financial Services organizations are finding that delivering insights in a timely manner requires a data storage and analytics solution with more agility and flexibility than traditional data management systems can provide. In this session, we will discuss a design pattern that (1) brings this data into a highly available, lower-cost queryable archive within AWS than you currently have and (2) migrates that data to a data lake that the entire organization can use to extract insight and drive innovation. We will walk through a strategy that addresses the following topics: storing archive data in compressed, cost-effective, and readily available formats; creating lifecycle policies to archive older data sets and make them easily accessible; fully utilizing the features of object storage to enrich the data lake; and applying AWS analytics tools to gather business insights.