One explicitly stated design goal is that Drill is able to scale to 10,000 servers or more and to be able to process petabytes of data and trillions of records in seconds. In addition, Drill supports data locality, if Drill and the datastore are on the same nodes.

For example, you can join a user profile collection in MongoDB with a directory of event logs in Hadoop.ĭrill's datastore-aware optimizer automatically restructures a query plan to leverage the datastore's internal processing capabilities. A single query can join data from multiple datastores. ĭrill supports a variety of NoSQL databases and file systems, including Alluxio, HBase, MongoDB, MapR-DB, HDFS, MapR-FS, Amazon S3, Azure Blob Storage, Google Cloud Storage, Swift, NAS and local files. It was designated an Apache Software Foundation top-level project in December 2016. Tom Shiran is the founder of the Apache Drill Project. Built chiefly by contributions from developers from MapR, Drill is inspired by Google's Dremel system, also productized as BigQuery. Apache Drill is an open-source software framework that supports data-intensive distributed applications for interactive analysis of large-scale datasets.

Apache ant