Package object for the InterSystems IRIS Spark Connector.
Package object for the InterSystems IRIS Spark Connector.
Defines a custom interface for the InterSystems IRIS Spark Connector, a set
of classes and types that together offer a more convenient type safe Scala
interface for the connector than that of the generic string-based interface
that comes built into Spark itself.
Example:
scala> import com.intersystems.spark._
imports the custom interface into the current scope, allowing one to write,
for example:
scala> spark.read.iris("SELECT name FROM Owls").show(3)
+---------+
| name |
+---------+
| Barn |
| Horned |
| Screech |
+---------+
to read and display the first few records of a table called 'Owls' from the
default cluster, while:
scala> owls.write.mode("append").iris("Owls")
appends the contents of the dataframe owls to this very same table within
the cluster.
Package object for the InterSystems IRIS Spark Connector.
Defines a custom interface for the InterSystems IRIS Spark Connector, a set of classes and types that together offer a more convenient type safe Scala interface for the connector than that of the generic string-based interface that comes built into Spark itself.
scala> import com.intersystems.spark._imports the custom interface into the current scope, allowing one to write, for example:
to read and display the first few records of a table called 'Owls' from the default cluster, while:
appends the contents of the dataframe
owlsto this very same table within the cluster.