ExpandAddress

Introduction: Returns an array of expanded forms of the input address string. This is backed by the libpostal library's address expanding functionality.

Note

Jpostal requires at least 2 GB of free disk space to store the data files used for address parsing and expanding. By default, the data files are downloaded automatically to a temporary directory (<java.io.tmpdir>/libpostal/, e.g. /tmp/libpostal/ on Linux/macOS) when the function is called for the first time.

Note

The version of jpostal installed with this package only supports Linux and macOS. If you are using Windows, you will need to install libjpostal and libpostal manually and ensure that they are available in your java.library.path.

The data directory can be configured via spark.sedona.libpostal.dataDir. You can point it to a remote filesystem path (HDFS, S3, GCS, ABFS, etc.) such as hdfs:///data/libpostal/ or s3a://my-bucket/libpostal/. When using a remote path, you must distribute the data to all executors before running queries by calling sc.addFile("hdfs:///data/libpostal/", recursive=True) (PySpark) or sc.addFile("hdfs:///data/libpostal/", recursive = true) (Scala). In this remote-URI mode, the automatic internet download performed by jpostal is disabled, so the remote directory must already contain the libpostal model files. For local filesystem paths, jpostal's download-if-needed behavior remains enabled.

To prepare the libpostal data for a remote filesystem, first download it to a local machine by following the libpostal installation instructions. After installation, the data files will be in the directory you specified during setup (commonly /tmp/libpostal/). Then upload them to your remote storage.

Format: ExpandAddress (address: String)

Since: v1.8.0

SQL Example

SELECT ExpandAddress("100 W 1st St, Los Angeles, CA 90012");

Output:

[100 w 1st saint, 100 w 1st street, 100 west 1st saint, 100 west 1st street, 100 w 1 saint, 100 w 1 street, 100 west 1 saint, 100 west 1 street]