About This Book

This book describes the InterSystems Spark Connector (com.intersystems.spark), an implementation of the Data Source API for Spark that allows the Spark data processing engine to make optimal use of the InterSystems IRIS ® data platform and its distributed data capabilities.

The following topics are discussed in this book:

• Introduction — introduces Apache Spark and the InterSystems Spark Connector, and describes how to configure the Spark Connector on your system.

• Spark Connector Data Source Options — provides a detailed description of all Spark Connector data source options.

• Using Spark Connector Extension Methods — demonstrates the Spark Connector method interface.

• Spark Connector Best Practices — describes ways to optimize Spark Connector hardware and software

• Spark Connector Internals — useful information not otherwise covered.

• Spark Connector Quick Reference — provides a quick reference to InterSystems-specific Scala extension methods provided by the Spark Connector API.

There is also a detailed Table of Contents.

The following documents contain related material:

• “Apache Spark Support” in the Implementation Reference for Java Third Party APIs provides some technical details about the InterSystems Spark Connector.

• Spark Connector API Reference is the online Scala documentation for the com.intersystems.spark API.

• The “Apache Spark” InterSystems overview page lists other resources for the InterSystems Spark Connector.

• Using Java with InterSystems Software provides an overview of all InterSystems Java technologies enabled by the InterSystems JDBC driver, and describes how to use the driver.