sedona.spark package

Subpackages

Submodules

sedona.spark.SedonaContext module

class sedona.spark.SedonaContext.SedonaContext[source]

Bases: object

__init__() None

Method generated by attrs for class SedonaContext.

classmethod builder() <pyspark.sql.session.SparkSession.Builder object at 0x7f46a7ddb850>[source]

This method adds the basic Sedona configuration to the SparkSession builder. Usually the user does not need to call this method directly, as it is configured when a cluster is created. This method is needed when the user wants to manually configure Sedona :return: SparkSession.builder

classmethod create(spark: SparkSession) SparkSession[source]

This is the core of whole package, It uses py4j to run wrapper which takes existing SparkSession and register the core logics of Apache Sedona, for this SparkSession.

Parameters:

spark – pyspark.sql.SparkSession, spark session instance

Returns:

SedonaContext which is an instance of SparkSession

Module contents