What is IBM AE Magic?

IBM Analytic Engine Magic package provide two covenient ways to to interact with IBM Analytic Engine:

• Jupyter Magic Function

• Python SDK

The Jupyter Magic Functions provided in the package allow Data Scientist to quickly submit spark job to IBM Analytic instance and get access to job status all from Jupyter Notebook.

The Python SDK is focusing providing ML Engineer to interact and configure IBM Analytic instance easier using python code.

IBM Analytic Engine

IBM Analytics Engine provides an architecture for Hadoop clusters that decouples the compute and storage tiers. Instead of a permanent cluster formed of dual-purpose nodes, the Analytics Engine allows users to store data in an object storage layer such as IBM Cloud Object Storage and spins up clusters of compute notes when needed. Separating compute from storage helps to transform the flexibility, scalability and maintainability of big data analytics platforms.