Packages

object Adapter

Adapter for converting between DataFrame and SpatialRDD. It provides methods to convert DataFrame to SpatialRDD and vice versa. The schema information is lost during conversion. It is different from org.apache.spark.sql.sedona_sql.adapters.StructuredAdapter which does not lose the schema information during conversion. This should be used if your data starts as a SpatialRDD and you want to convert it to DataFrame.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Adapter
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native() @HotSpotIntrinsicCandidate()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  8. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  9. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  10. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  11. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  12. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  13. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  14. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  15. def toDf(spatialPairRDD: JavaPairRDD[Geometry, Geometry], schema: StructType, sparkSession: SparkSession): DataFrame

    Convert a JavaPairRDD to DataFrame with a specified schema.

    Convert a JavaPairRDD to DataFrame with a specified schema.

    The schema is expected to follow the format: [left geometry, (left user data columns), right geometry, (right user data columns)]

    Note that the schema _must_ provide columns for left and right user data, even if they do not exist in the original data.

    Also note that some complex types, such as MapType, and schemas as strings are not supported.

    schema

    Desired output schema

    sparkSession

    Spark session

    returns

    Spatial pair RDD as a DataFrame with the desired schema

  16. def toDf(spatialPairRDD: JavaPairRDD[Geometry, Geometry], leftFieldnames: Seq[String], rightFieldNames: Seq[String], sparkSession: SparkSession): DataFrame
  17. def toDf(spatialPairRDD: JavaPairRDD[Geometry, Geometry], sparkSession: SparkSession): DataFrame
  18. def toDf[T <: Geometry](spatialRDD: SpatialRDD[T], schema: StructType, sparkSession: SparkSession): DataFrame

    Convert a spatial RDD to DataFrame with a given schema.

    Convert a spatial RDD to DataFrame with a given schema.

    T

    Geometry

    spatialRDD

    Spatial RDD

    schema

    Desired schema

    sparkSession

    Spark Session

    returns

    DataFrame with the specified schema

  19. def toDf[T <: Geometry](spatialRDD: SpatialRDD[T], fieldNames: Seq[String], sparkSession: SparkSession): DataFrame
  20. def toDf[T <: Geometry](spatialRDD: SpatialRDD[T], sparkSession: SparkSession): DataFrame
  21. def toSpatialRdd(dataFrame: DataFrame, geometryColId: Int): SpatialRDD[Geometry]

    Convert a Spatial DF to a Spatial RDD.

    Convert a Spatial DF to a Spatial RDD. The geometry column can be at any place in the DF

  22. def toSpatialRdd(dataFrame: DataFrame, geometryColId: Int, fieldNames: Seq[String]): SpatialRDD[Geometry]

    Convert a Spatial DF to a Spatial RDD with a list of user-supplied col names (except geom col).

    Convert a Spatial DF to a Spatial RDD with a list of user-supplied col names (except geom col). The geometry column can be at any place in the DF.

  23. def toSpatialRdd(dataFrame: DataFrame, geometryFieldName: String, fieldNames: Seq[String]): SpatialRDD[Geometry]

    Convert a Spatial DF to a Spatial RDD with a list of user-supplied col names (except geom col).

    Convert a Spatial DF to a Spatial RDD with a list of user-supplied col names (except geom col). The geometry column can be at any place in the DF.

  24. def toSpatialRdd(dataFrame: DataFrame, geometryFieldName: String): SpatialRDD[Geometry]

    Convert a Spatial DF to a Spatial RDD.

    Convert a Spatial DF to a Spatial RDD. The geometry column can be at any place in the DF

  25. def toString(): String
    Definition Classes
    AnyRef → Any
  26. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  28. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] ) @Deprecated
    Deprecated

Inherited from AnyRef

Inherited from Any

Ungrouped