Apache® Spark™ News

Engineering population scale Genome-Wide Association Studies with Apache Spark™, Delta Lake, and MLflow

The advent of genome-wide association studies (GWAS) in the late 2000s enabled scientists to begin to understand the causes of complex diseases such as diabetes and Crohn’s disease at their most fundamental level. However, academic bioinformatics tools to perform GWAS have not kept pace with the growth of genomic data, which has been doubling globally every seven months.