Cloudera Impala
| Developer(s) | Cloudera |
|---|---|
| Stable release | 2.1.0 |
| Development status | Active |
| Written in | C++ |
| Operating system | Cross-platform |
| Type | Relational Hadoop-analytics |
| License | Apache License 2.0 |
| Website | Cloudera Impala Homepage |
Cloudera Impala is Cloudera's open source massively parallel processing (MPP) SQL query engine for data stored in a computer cluster running Apache Hadoop.[1]
Description
Cloudera Impala is a query engine that runs on Apache Hadoop. The project was announced in October 2012 with a public beta test distribution[2][3] and became generally available in May 2013.[4]
Impala brings scalable parallel database technology to Hadoop, enabling users to issue low-latency SQL queries to data stored in HDFS and Apache HBase without requiring data movement or transformation. Impala is integrated with Hadoop to use the same file and data formats, metadata, security and resource management frameworks used by MapReduce, Apache Hive, Apache Pig and other Hadoop software.
Impala is promoted for analysts and data scientists to perform analytics on data stored in Hadoop via SQL or business intelligence tools. The result is that large-scale data processing (via MapReduce) and interactive queries can be done on the same system using the same data and metadata – removing the need to migrate data sets into specialized systems and/or proprietary formats simply to perform analysis.
Features include:
- Supports HDFS and Apache HBase storage,
- Reads Hadoop file formats, including text, LZO, SequenceFile, Avro, RCFile, and Parquet,
- Supports Hadoop security (Kerberos authentication),
- Fine-grained, role-based authorization with Apache Sentry,
- Uses metadata, ODBC driver, and SQL syntax from Apache Hive.
In early 2013, a column-oriented file format called Parquet was announced for architectures including Impala.[5] In December 2013, Amazon Web Services announced support for Impala.[6] In early 2014, MapR added support for Impala.[7]
See also
- Presto — open source SQL query engine created by Facebook and supported by Teradata. Optimized for high-speed distributed interactive analytics
- Dremel — similar tool from Google
- Apache Drill — similar open source project inspired by Dremel
- Cloudera — Hadoop distribution responsible for the Cloudera Impala project
References
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
- ↑ Lua error in package.lua at line 80: module 'strict' not found.
External links
- Cloudera Impala commercial web site
- Impala GitHub project source code
- Impala Project Page project web site
