Ibis: Python data analysis framework for Hadoop and SQL engines

Ibis is a toolbox to bridge the gap between local Python environments, remote storage, execution systems like Hadoop components (HDFS, Impala, Hive, Spark) and SQL databases. Its goal is to simplify analytical workflows and make you more productive.

Install Ibis from PyPI with:

pip install ibis-framework

or from conda-forge with

conda install ibis-framework -c conda-forge

Ibis currently provides tools for interacting with the following systems:

• Apache Impala (incubating)
• Apache Kudu
• Hadoop Distributed File System (HDFS)
• PostgreSQL
• MySQL (Experimental)
• SQLite
• Pandas DataFrames (Experimental)
• Clickhouse
• BigQuery

Learn more about using the library at http://docs.ibis-project.org and read the project blog at http://ibis-project.org for news and updates.