Packages

object Adapter

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Adapter
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. def toDf(spatialPairRDD: JavaPairRDD[Geometry, Geometry], schema: StructType, sparkSession: SparkSession): DataFrame

    Convert a JavaPairRDD to DataFrame with a specified schema.

    Convert a JavaPairRDD to DataFrame with a specified schema.

    The schema is expected to follow the format: [left geometry, (left user data columns), right geometry, (right user data columns)]

    Note that the schema _must_ provide columns for left and right user data, even if they do not exist in the original data.

    Also note that some complex types, such as MapType, and schemas as strings are not supported.

    schema

    Desired output schema

    sparkSession

    Spark session

    returns

    Spatial pair RDD as a DataFrame with the desired schema

  2. def toDf(spatialPairRDD: JavaPairRDD[Geometry, Geometry], leftFieldnames: Seq[String], rightFieldNames: Seq[String], sparkSession: SparkSession): DataFrame
  3. def toDf(spatialPairRDD: JavaPairRDD[Geometry, Geometry], sparkSession: SparkSession): DataFrame
  4. def toDf[T <: Geometry](spatialRDD: SpatialRDD[T], schema: StructType, sparkSession: SparkSession): DataFrame

    Convert a spatial RDD to DataFrame with a given schema.

    Convert a spatial RDD to DataFrame with a given schema.

    T

    Geometry

    spatialRDD

    Spatial RDD

    schema

    Desired schema

    sparkSession

    Spark Session

    returns

    DataFrame with the specified schema

  5. def toDf[T <: Geometry](spatialRDD: SpatialRDD[T], fieldNames: Seq[String], sparkSession: SparkSession): DataFrame
  6. def toDf[T <: Geometry](spatialRDD: SpatialRDD[T], sparkSession: SparkSession): DataFrame
  7. def toSpatialRdd(dataFrame: DataFrame, geometryColId: Int): SpatialRDD[Geometry]

    Convert a Spatial DF to a Spatial RDD.

    Convert a Spatial DF to a Spatial RDD. The geometry column can be at any place in the DF

  8. def toSpatialRdd(dataFrame: DataFrame, geometryColId: Int, fieldNames: Seq[String]): SpatialRDD[Geometry]

    Convert a Spatial DF to a Spatial RDD with a list of user-supplied col names (except geom col).

    Convert a Spatial DF to a Spatial RDD with a list of user-supplied col names (except geom col). The geometry column can be at any place in the DF.

  9. def toSpatialRdd(dataFrame: DataFrame, geometryFieldName: String, fieldNames: Seq[String]): SpatialRDD[Geometry]

    Convert a Spatial DF to a Spatial RDD with a list of user-supplied col names (except geom col).

    Convert a Spatial DF to a Spatial RDD with a list of user-supplied col names (except geom col). The geometry column can be at any place in the DF.

  10. def toSpatialRdd(dataFrame: DataFrame, geometryFieldName: String): SpatialRDD[Geometry]

    Convert a Spatial DF to a Spatial RDD.

    Convert a Spatial DF to a Spatial RDD. The geometry column can be at any place in the DF