Publish Sedona¶

This page is for Sedona PPMC to publish Sedona releases.

Obtain Write Access to Sedona GitHub repo¶

Verify you have a Github ID enabled with 2FA https://help.github.com/articles/securing-your-account-with-two-factor-authentication-2fa/
Enter your Github ID into your Apache ID profile https://id.apache.org/
Merge your Apache and GitHub accounts using GitBox (Apache Account Linking utility): https://gitbox.apache.org/setup/
- You should see 3 green checks in GitBox
- Wait at least 30 minutes for an email inviting you to Apache GitHub Organization and accept invitation
After accepting the Github Invitation verify that you are a member of the team https://github.com/orgs/apache/teams/openwhisk-committers
Additionally, if you have been elected to the Sedona PPMC, verify you are part of the LDAP Sedona PPMC https://whimsy.apache.org/roster/ppmc/sedona

Prepare Secret GPG key¶

Install GNUGPG if it was not installed before. On Mac: brew install gnupg gnupg2
Generate a secret key. It must be RSA4096 (4096 bits long). Please follow Step 1 - 13 as listed here: https://docs.github.com/en/authentication/managing-commit-signature-verification/generating-a-new-gpg-key#generating-a-gpg-key

Set up ASF username for Maven¶

In your ~/.m2/settings.xml file, add the following content. Please create one if it does not exist. Please replace ASF_ID and ASF_PASSWORD with your own ASF ID and password.

<settings>
  <servers>
    <server>
      <id>apache.snapshots.https</id>
      <username>YOUR_ASF_ID</username>
      <password>YOUR_ASF_PASSWORD</password>
    </server>
    <server>
      <id>apache.releases.https</id>
      <username>YOUR_ASF_ID</username>
      <password>YOUR_ASF_PASSWORD</password>
    </server>
  </servers>
</settings>

Publish SNAPSHOTs¶

Publish Maven SNAPSHOTs¶

This step is to publish the SNAPSHOTs to https://repository.apache.org

The detailed requirement is on ASF Infra website

Prepare for Spark 3.0 and Scala 2.12

Prepare the SNAPSHOTs

mvn clean -Darguments="-DskipTests" release:prepare -DdryRun=true -DautoVersionSubmodules=true -Dresume=false

Deploy the SNAPSHOTs
```
mvn deploy -DskipTests
```

Prepare for Spark 2.4 and Scala 2.11

Prepare the SNAPSHOTs

mvn clean release:prepare -DdryRun=true -DautoVersionSubmodules=true -Dresume=false -DcheckModificationExcludeList=sql/src/main/scala/org/apache/sedona/sql/UDF/UdfRegistrator.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/JoinQueryDetector.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/TraitJoinQueryExec.scala -Darguments="-DskipTests -Dscala=2.11 -Dspark=2.4"

Deploy the SNAPSHOTs

mvn deploy -DskipTests -Dscala=2.11 -Dspark=2.4

Prepare for Spark 2.4 and Scala 2.12

Prepare the SNAPSHOTs

mvn clean release:prepare -DdryRun=true -DautoVersionSubmodules=true -Dresume=false -DcheckModificationExcludeList=sql/src/main/scala/org/apache/sedona/sql/UDF/UdfRegistrator.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/JoinQueryDetector.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/TraitJoinQueryExec.scala -Darguments="-DskipTests -Dscala=2.12 -Dspark=2.4"

Deploy the SNAPSHOTs

mvn deploy -DskipTests -Dscala=2.12 -Dspark=2.4

Check ASF copyright in all file headers¶

Download Apache Rat binary (.jar file).

Run the following terminal script:

#!/bin/bash
git clone --shared --branch master https://github.com/apache/incubator-sedona.git sedona-src
java -jar apache-rat-0.13.jar -d sedona-src > report.txt

Read the generated report.txt file and make sure all source code files have ASF header.
Delete the generated report and cloned files
```
rm -rf sedona-src
rm report.txt
```

Note

Please read the following guidelines first: 1. ASF Incubator Distribution Guidelines: https://incubator.apache.org/guides/distribution.html 2. ASF Release Guidelines: https://infra.apache.org/release-publishing.html 3. ASF Incubator Release Votes Guidelines: https://issues.apache.org/jira/browse/LEGAL-469

Publish releases¶

Update Sedona Python, R and Zeppelin versions¶

Make sure the Sedona version in the following files are 1.2.0-incubating. Note that: Python and R versions cannot have "incubating" postfix.

Stage the Release Candidate¶

This step is to stage the release to https://repository.apache.org

For Spark 3.0 and Scala 2.12

Prepare a release. Manually enter the following variables in the terminal: release id: 1.2.0-incubating, scm tag id: sedona-1.2.0-incubating-rc1. You also need to provide GitHub username and password three times.
```
mvn clean release:prepare -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests"
```

Stage a release

mvn clean release:perform -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests"

Now the releases are staged. A tag and two commits will be created on Sedona GitHub repo.

Now let's repeat the process to other Sedona modules. Make sure you use the correct SCM Git tag id sedona-1.2.0-incubating-rc1 (see below).

For Spark 2.4 and Scala 2.11

mvn org.apache.maven.plugins:maven-release-plugin:2.3.2:perform -DconnectionUrl=scm:git:https://github.com/apache/incubator-sedona.git -Dtag=sedona-1.2.0-incubating-rc1 -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests -Dscala=2.11 -Dspark=2.4"

For Spark 2.4 and Scala 2.12

mvn org.apache.maven.plugins:maven-release-plugin:2.3.2:perform -DconnectionUrl=scm:git:https://github.com/apache/incubator-sedona.git -Dtag=sedona-1.2.0-incubating-rc1 -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests -Dscala=2.12 -Dspark=2.4"

Upload Release Candidate¶

All release candidates must be first placed in ASF Dist Dev SVN before vote: https://dist.apache.org/repos/dist/dev/incubator/sedona

Make sure your armored PGP public key (must be encrypted by RSA-4096) is included in the KEYS file: https://dist.apache.org/repos/dist/dev/incubator/sedona/KEYS, and publish in major key servers: https://pgp.mit.edu/, https://keyserver.ubuntu.com/, http://keys.gnupg.net/

Create a folder on SVN, such as sedona-1.2.0-incubating-rc1

#!/bin/bash
svn mkdir -m "Adding folder" https://dist.apache.org/repos/dist/dev/incubator/sedona/1.2.0-incubating-rc1

In a folder other than the Sedona git repo, run the following script to create six files and two folders.

#!/bin/bash
git clone --shared --branch sedona-1.2.0-incubating-rc1 https://github.com/apache/incubator-sedona.git apache-sedona-1.2.0-incubating-src
rm -rf apache-sedona-1.2.0-incubating-src/.git
tar czf apache-sedona-1.2.0-incubating-src.tar.gz apache-sedona-1.2.0-incubating-src
mkdir apache-sedona-1.2.0-incubating-bin
cd apache-sedona-1.2.0-incubating-src && mvn clean install -DskipTests -Dscala=2.12 -Dspark=3.0 && cd ..
cp apache-sedona-1.2.0-incubating-src/core/target/sedona-*1.2.0-incubating.jar apache-sedona-1.2.0-incubating-bin/
cp apache-sedona-1.2.0-incubating-src/sql/target/sedona-*1.2.0-incubating.jar apache-sedona-1.2.0-incubating-bin/
cp apache-sedona-1.2.0-incubating-src/viz/target/sedona-*1.2.0-incubating.jar apache-sedona-1.2.0-incubating-bin/
cp apache-sedona-1.2.0-incubating-src/python-adapter/target/sedona-*1.2.0-incubating.jar apache-sedona-1.2.0-incubating-bin/
cp apache-sedona-1.2.0-incubating-src/flink/target/sedona-*1.2.0-incubating.jar apache-sedona-1.2.0-incubating-bin/
cd apache-sedona-1.2.0-incubating-src && mvn clean install -DskipTests -Dscala=2.11 -Dspark=2.4 && cd ..
cp apache-sedona-1.2.0-incubating-src/core/target/sedona-*1.2.0-incubating.jar apache-sedona-1.2.0-incubating-bin/
cp apache-sedona-1.2.0-incubating-src/sql/target/sedona-*1.2.0-incubating.jar apache-sedona-1.2.0-incubating-bin/
cp apache-sedona-1.2.0-incubating-src/viz/target/sedona-*1.2.0-incubating.jar apache-sedona-1.2.0-incubating-bin/
cp apache-sedona-1.2.0-incubating-src/python-adapter/target/sedona-*1.2.0-incubating.jar apache-sedona-1.2.0-incubating-bin/
cd apache-sedona-1.2.0-incubating-src && mvn clean install -DskipTests -Dscala=2.12 -Dspark=2.4 && cd ..
cp apache-sedona-1.2.0-incubating-src/core/target/sedona-*1.2.0-incubating.jar apache-sedona-1.2.0-incubating-bin/
cp apache-sedona-1.2.0-incubating-src/sql/target/sedona-*1.2.0-incubating.jar apache-sedona-1.2.0-incubating-bin/
cp apache-sedona-1.2.0-incubating-src/viz/target/sedona-*1.2.0-incubating.jar apache-sedona-1.2.0-incubating-bin/
cp apache-sedona-1.2.0-incubating-src/python-adapter/target/sedona-*1.2.0-incubating.jar apache-sedona-1.2.0-incubating-bin/
tar czf apache-sedona-1.2.0-incubating-bin.tar.gz apache-sedona-1.2.0-incubating-bin
shasum -a 512 apache-sedona-1.2.0-incubating-src.tar.gz > apache-sedona-1.2.0-incubating-src.tar.gz.sha512
shasum -a 512 apache-sedona-1.2.0-incubating-bin.tar.gz > apache-sedona-1.2.0-incubating-bin.tar.gz.sha512
gpg -ab apache-sedona-1.2.0-incubating-src.tar.gz
gpg -ab apache-sedona-1.2.0-incubating-bin.tar.gz

Upload six files to SVN and delete all created files using the following script

#!/bin/bash
svn import -m "Adding file" apache-sedona-1.2.0-incubating-src.tar.gz https://dist.apache.org/repos/dist/dev/incubator/sedona/1.2.0-incubating-rc1/apache-sedona-1.2.0-incubating-src.tar.gz
svn import -m "Adding file" apache-sedona-1.2.0-incubating-src.tar.gz.asc https://dist.apache.org/repos/dist/dev/incubator/sedona/1.2.0-incubating-rc1/apache-sedona-1.2.0-incubating-src.tar.gz.asc
svn import -m "Adding file" apache-sedona-1.2.0-incubating-src.tar.gz.sha512 https://dist.apache.org/repos/dist/dev/incubator/sedona/1.2.0-incubating-rc1/apache-sedona-1.2.0-incubating-src.tar.gz.sha512
svn import -m "Adding file" apache-sedona-1.2.0-incubating-bin.tar.gz https://dist.apache.org/repos/dist/dev/incubator/sedona/1.2.0-incubating-rc1/apache-sedona-1.2.0-incubating-bin.tar.gz
svn import -m "Adding file" apache-sedona-1.2.0-incubating-bin.tar.gz.asc https://dist.apache.org/repos/dist/dev/incubator/sedona/1.2.0-incubating-rc1/apache-sedona-1.2.0-incubating-bin.tar.gz.asc
svn import -m "Adding file" apache-sedona-1.2.0-incubating-bin.tar.gz.sha512 https://dist.apache.org/repos/dist/dev/incubator/sedona/1.2.0-incubating-rc1/apache-sedona-1.2.0-incubating-bin.tar.gz.sha512
rm apache-sedona-1.2.0-incubating-src.tar.gz
rm apache-sedona-1.2.0-incubating-src.tar.gz.asc
rm apache-sedona-1.2.0-incubating-src.tar.gz.sha512
rm apache-sedona-1.2.0-incubating-bin.tar.gz
rm apache-sedona-1.2.0-incubating-bin.tar.gz.asc
rm apache-sedona-1.2.0-incubating-bin.tar.gz.sha512
rm -rf apache-sedona-1.2.0-incubating-src
rm -rf apache-sedona-1.2.0-incubating-bin

Vote in dev sedona.apache.org¶

Check the status of the staging repo: Locate and Examine Your Staging Repository . You should see 12 Sedona modules in total.
Call for a vote in Sedona community and Apache incubator. Then close the staging repo.

Here is a generated vote email. Please add changes at the end if needed:

Subject: [VOTE] Release Apache Sedona 1.2.0-incubating-rc1

Hi all,

This is a call for vote on Apache Sedona 1.2.0-incubating-rc1. Please refer to the changes listed at the bottom of this email.

Release notes:
https://github.com/apache/incubator-sedona/blob/sedona-1.2.0-incubating-rc1/docs/setup/release-notes.md

Build instructions:
https://github.com/apache/incubator-sedona/blob/sedona-1.2.0-incubating-rc1/docs/setup/compile.md

GitHub tag:
https://github.com/apache/incubator-sedona/releases/tag/sedona-1.2.0-incubating-rc1

GPG public key to verify the Release:
https://downloads.apache.org/incubator/sedona/KEYS

Source code and binaries:
https://dist.apache.org/repos/dist/dev/incubator/sedona/1.2.0-incubating-rc1/

The vote will be open for at least 72 hours or until a majority of at least 3 "approve" PMC votes are cast

Please vote accordingly:

[ ] +1 approve

[ ] +0 no opinion

[ ] -1 disapprove with the reason

Checklist for reference (because of DISCLAIMER-WIP, other checklist items are not blockers):

[ ] Download links are valid.

[ ] Checksums and PGP signatures are valid.

[ ] DISCLAIMER is included.

[ ] Source code artifacts have correct names matching the current release.

For a detailed checklist  please refer to:
https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist

------------

Changes according to the comments on the previous release
Original comment (Permalink from https://lists.apache.org/list.html):

Here is a generated "pass" email:

Subject: [RESULT][VOTE] Release Apache Sedona 1.2.0-incubating-rc1

Dear all,

The vote closes now as 72hr have passed. The vote PASSES with

+? (binding): NAME1, NAME2, NAME3
+? (non-binding): NAME4
No -1 votes

The vote thread (Permalink from https://lists.apache.org/list.html):

I will now bring the vote to general@incubator.apache.org to get
approval by the IPMC. If this vote passes too, the release is accepted and will be published.

Vote in general incubator.apache.org¶

Here is a generated vote email. Please add changes at the end if needed:

Subject: [VOTE] Release Apache Sedona 1.2.0-incubating-rc1

Hi all,

This is a call for vote on Apache Sedona 1.2.0-incubating-rc1. Please refer to the changes listed at the bottom of this email.

Sedona Community vote thread (Permalink from https://lists.apache.org/list.html):

Sedona community vote result thread (Permalink from https://lists.apache.org/list.html):

Release notes:
https://github.com/apache/incubator-sedona/blob/sedona-1.2.0-incubating-rc1/docs/setup/release-notes.md

Build instructions:
https://github.com/apache/incubator-sedona/blob/sedona-1.2.0-incubating-rc1/docs/setup/compile.md

GitHub tag:
https://github.com/apache/incubator-sedona/releases/tag/sedona-1.2.0-incubating-rc1

GPG public key to verify the Release:
https://downloads.apache.org/incubator/sedona/KEYS

Source code and binaries:
https://dist.apache.org/repos/dist/dev/incubator/sedona/1.2.0-incubating-rc1/

The vote will be open for at least 72 hours or until a majority of at least 3 "approve" PMC votes are cast

Please vote accordingly:

[ ] +1 approve

[ ] +0 no opinion

[ ] -1 disapprove with the reason

Checklist for reference (because of DISCLAIMER-WIP, other checklist items are not blockers):

[ ] Download links are valid.

[ ] Checksums and PGP signatures are valid.

[ ] DISCLAIMER is included.

[ ] Source code artifacts have correct names matching the current release.

For a detailed checklist  please refer to:
https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist

------------

Changes according to the comments on the previous release
Original comment (Permalink from https://lists.apache.org/list.html):

Here is a generated "pass" email:

Subject: [RESULT][VOTE] Release Apache Sedona 1.2.0-incubating-rc1

Dear all,

The vote closes now as 72hr have passed. The vote PASSES with

+? (binding): NAME1, NAME2, NAME3
+? (non-binding): NAME4
No -1 votes

The vote thread (Permalink from https://lists.apache.org/list.html):

I will publish the release and make an annoucement once it is done.

Here is a generated "announce" email. This email should be CCed to dev@sedona.apache.org:

Subject: [ANNOUNCE] Apache Sedona 1.2.0-incubating released

Dear all,

We are happy to report that we have released Apache Sedona (incubating) 1.2.0-incubating. Thank you again for your help.

Apache Sedona (incubating) is a cluster computing system for processing large-scale spatial data. 


Vote thread (Permalink from https://lists.apache.org/list.html):


Vote result thread (Permalink from https://lists.apache.org/list.html):


Website:
http://sedona.apache.org/

Release notes:
https://github.com/apache/incubator-sedona/blob/sedona-1.2.0-incubating/docs/setup/release-notes.md

Download links:
https://github.com/apache/incubator-sedona/releases/tag/sedona-1.2.0-incubating

Additional resources:
Get started: http://sedona.apache.org/setup/overview/
Tutorials: http://sedona.apache.org/tutorial/rdd/
Mailing list: dev@sedona.apache.org
Twitter: https://twitter.com/ApacheSedona
Gitter: https://gitter.im/apache/sedona

Regards,
Apache Sedona (incubating) Team

Failed vote¶

If a vote failed, please first drop the staging repo on repository.apache.org. Then redo all the steps above. Make sure you use a new scm tag for the new release candidate when use maven-release-plugin (i.e., 1.2.0-incubating-rc2). You can change the sedona.current_rc and sedona.current_git_tag in mkdocs.yml to generate the script listed on this webpage.

Release the package¶

Move all files in https://dist.apache.org/repos/dist/dev/incubator/sedona to https://dist.apache.org/repos/dist/release/incubator/sedona, using svn

#!/bin/bash
svn mkdir -m "Adding folder" https://dist.apache.org/repos/dist/release/incubator/sedona/1.2.0-incubating
wget https://dist.apache.org/repos/dist/dev/incubator/sedona/1.2.0-incubating-rc1/apache-sedona-1.2.0-incubating-src.tar.gz
wget https://dist.apache.org/repos/dist/dev/incubator/sedona/1.2.0-incubating-rc1/apache-sedona-1.2.0-incubating-src.tar.gz.asc
wget https://dist.apache.org/repos/dist/dev/incubator/sedona/1.2.0-incubating-rc1/apache-sedona-1.2.0-incubating-src.tar.gz.sha512
wget https://dist.apache.org/repos/dist/dev/incubator/sedona/1.2.0-incubating-rc1/apache-sedona-1.2.0-incubating-bin.tar.gz
wget https://dist.apache.org/repos/dist/dev/incubator/sedona/1.2.0-incubating-rc1/apache-sedona-1.2.0-incubating-bin.tar.gz.asc
wget https://dist.apache.org/repos/dist/dev/incubator/sedona/1.2.0-incubating-rc1/apache-sedona-1.2.0-incubating-bin.tar.gz.sha512
svn import -m "Adding file" apache-sedona-1.2.0-incubating-src.tar.gz https://dist.apache.org/repos/dist/release/incubator/sedona/1.2.0-incubating/apache-sedona-1.2.0-incubating-src.tar.gz
svn import -m "Adding file" apache-sedona-1.2.0-incubating-src.tar.gz.asc https://dist.apache.org/repos/dist/release/incubator/sedona/1.2.0-incubating/apache-sedona-1.2.0-incubating-src.tar.gz.asc
svn import -m "Adding file" apache-sedona-1.2.0-incubating-src.tar.gz.sha512 https://dist.apache.org/repos/dist/release/incubator/sedona/1.2.0-incubating/apache-sedona-1.2.0-incubating-src.tar.gz.sha512
svn import -m "Adding file" apache-sedona-1.2.0-incubating-bin.tar.gz https://dist.apache.org/repos/dist/release/incubator/sedona/1.2.0-incubating/apache-sedona-1.2.0-incubating-bin.tar.gz
svn import -m "Adding file" apache-sedona-1.2.0-incubating-bin.tar.gz.asc https://dist.apache.org/repos/dist/release/incubator/sedona/1.2.0-incubating/apache-sedona-1.2.0-incubating-bin.tar.gz.asc
svn import -m "Adding file" apache-sedona-1.2.0-incubating-bin.tar.gz.sha512 https://dist.apache.org/repos/dist/release/incubator/sedona/1.2.0-incubating/apache-sedona-1.2.0-incubating-bin.tar.gz.sha512
rm apache-sedona-1.2.0-incubating-src.tar.gz
rm apache-sedona-1.2.0-incubating-src.tar.gz.asc
rm apache-sedona-1.2.0-incubating-src.tar.gz.sha512
rm apache-sedona-1.2.0-incubating-bin.tar.gz
rm apache-sedona-1.2.0-incubating-bin.tar.gz.asc
rm apache-sedona-1.2.0-incubating-bin.tar.gz.sha512

Add the download link to Download page and create a GitHub release.

(1) Publish Python project to PyPi using twine. You must have the maintainer priviledge of https://pypi.org/project/apache-sedona/. (2) Publish Zeppelin plugin to NPM

#!/bin/bash
git clone --shared --branch sedona-1.2.0-incubating-rc1 https://github.com/apache/incubator-sedona.git apache-sedona-1.2.0-incubating-src
cd apache-sedona-1.2.0-incubating-src/python && python3 setup.py sdist bdist_wheel && twine upload dist/* && cd ..
cd zeppelin && npm publish && cd ..
rm -rf apache-sedona-1.2.0-incubating-src

Publish Sedona R to CRAN. More details to be added.

#!/bin/bash
R CMD build .
R CMD check --as-cran apache.sedona_*.tar.gz

Instructions on how to submit a R package to CRAN are at the bottom of the CRAN front page, “Submitting to CRAN.” Submission is now via a web form.
Close the staging repo on https://repository.apache.org. If the staging repo has been automatically closed by the system, please read below.

Use Maven Release Plugin directly from an existing tag

The staging repo on repository.apache.org is usually automatically closed before the voting is closed. If so, you need to do mvn release:perform from an existing tag. Note that: you have to use org.apache.maven.plugins:maven-release-plugin:2.3.2:perform due to a bug in maven release plugin from v2.4 (https://issues.apache.org/jira/browse/SCM-729). Make sure you use the correct scm tag (i.e., sedona-1.2.0-incubating-rc1).

For Spark 3.0 and Scala 2.12

mvn org.apache.maven.plugins:maven-release-plugin:2.3.2:perform -DconnectionUrl=scm:git:https://github.com/apache/incubator-sedona.git -Dtag=sedona-1.2.0-incubating-rc1 -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests"

For Spark 2.4 and Scala 2.11

mvn org.apache.maven.plugins:maven-release-plugin:2.3.2:perform -DconnectionUrl=scm:git:https://github.com/apache/incubator-sedona.git -Dtag=sedona-1.2.0-incubating-rc1 -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests -Dscala=2.11 -Dspark=2.4"

For Spark 2.4 and Scala 2.12

mvn org.apache.maven.plugins:maven-release-plugin:2.3.2:perform -DconnectionUrl=scm:git:https://github.com/apache/incubator-sedona.git -Dtag=sedona-1.2.0-incubating-rc1 -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests -Dscala=2.12 -Dspark=2.4"

Fix the error when close the staged repo

In the last step, you may see 6 errors similar to the following:

typeId  signature-staging
failureMessage  Invalid Signature: '/org/apache/sedona/sedona-python-adapter-2.4_2.12/1.2.0-incubating/sedona-python-adapter-2.4_2.12-1.2.0-incubating.pom.asc' is not a valid signature for 'sedona-python-adapter-2.4_2.12-1.2.0-incubating.pom'.
failureMessage  Invalid Signature: '/org/apache/sedona/sedona-python-adapter-2.4_2.11/1.2.0-incubating/sedona-python-adapter-2.4_2.11-1.2.0-incubating.pom.asc' is not a valid signature for 'sedona-python-adapter-2.4_2.11-1.2.0-incubating.pom'.
failureMessage  Invalid Signature: '/org/apache/sedona/sedona-python-adapter-3.0_2.12/1.2.0-incubating/sedona-python-adapter-3.0_2.12-1.2.0-incubating.pom.asc' is not a valid signature for 'sedona-python-adapter-3.0_2.12-1.2.0-incubating.pom'.
failureMessage  Invalid Signature: '/org/apache/sedona/sedona-viz-2.4_2.12/1.2.0-incubating/sedona-viz-2.4_2.12-1.2.0-incubating.pom.asc' is not a valid signature for 'sedona-viz-2.4_2.12-1.2.0-incubating.pom'.
failureMessage  Invalid Signature: '/org/apache/sedona/sedona-viz-3.0_2.12/1.2.0-incubating/sedona-viz-3.0_2.12-1.2.0-incubating.pom.asc' is not a valid signature for 'sedona-viz-3.0_2.12-1.2.0-incubating.pom'.
failureMessage  Invalid Signature: '/org/apache/sedona/sedona-viz-2.4_2.11/1.2.0-incubating/sedona-viz-2.4_2.11-1.2.0-incubating.pom.asc' is not a valid signature for 'sedona-viz-2.4_2.11-1.2.0-incubating.pom'.

This is caused by a bug in the resolved-pom-maven-plugin in POM.xml. You will have to upload the signatures of the POM files mannualy.

Please run the following script to reupload ASC files to the staging repo. Please make sure you use the correct Sedona staging repo ID, ASF username and password.

#!/bin/bash
username=admin
password=admin123
stagingid=1016

wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-core-2.4_2.11/1.2.0-incubating/sedona-core-2.4_2.11-1.2.0-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-core-2.4_2.12/1.2.0-incubating/sedona-core-2.4_2.12-1.2.0-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-core-3.0_2.12/1.2.0-incubating/sedona-core-3.0_2.12-1.2.0-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-sql-2.4_2.11/1.2.0-incubating/sedona-sql-2.4_2.11-1.2.0-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-sql-2.4_2.12/1.2.0-incubating/sedona-sql-2.4_2.12-1.2.0-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-sql-3.0_2.12/1.2.0-incubating/sedona-sql-3.0_2.12-1.2.0-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-viz-2.4_2.11/1.2.0-incubating/sedona-viz-2.4_2.11-1.2.0-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-viz-2.4_2.12/1.2.0-incubating/sedona-viz-2.4_2.12-1.2.0-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-viz-3.0_2.12/1.2.0-incubating/sedona-viz-3.0_2.12-1.2.0-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-python-adapter-2.4_2.11/1.2.0-incubating/sedona-python-adapter-2.4_2.11-1.2.0-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-python-adapter-2.4_2.12/1.2.0-incubating/sedona-python-adapter-2.4_2.12-1.2.0-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-python-adapter-3.0_2.12/1.2.0-incubating/sedona-python-adapter-3.0_2.12-1.2.0-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-flink_2.12/1.2.0-incubating/sedona-flink_2.12-1.2.0-incubating.pom

gpg -ab sedona-core-2.4_2.11-1.2.0-incubating.pom
gpg -ab sedona-core-2.4_2.12-1.2.0-incubating.pom
gpg -ab sedona-core-3.0_2.12-1.2.0-incubating.pom
gpg -ab sedona-sql-2.4_2.11-1.2.0-incubating.pom
gpg -ab sedona-sql-2.4_2.12-1.2.0-incubating.pom
gpg -ab sedona-sql-3.0_2.12-1.2.0-incubating.pom
gpg -ab sedona-viz-2.4_2.11-1.2.0-incubating.pom
gpg -ab sedona-viz-2.4_2.12-1.2.0-incubating.pom
gpg -ab sedona-viz-3.0_2.12-1.2.0-incubating.pom
gpg -ab sedona-python-adapter-2.4_2.11-1.2.0-incubating.pom
gpg -ab sedona-python-adapter-2.4_2.12-1.2.0-incubating.pom
gpg -ab sedona-python-adapter-3.0_2.12-1.2.0-incubating.pom
gpg -ab sedona-flink_2.12-1.2.0-incubating.pom

curl -v -u $username:$password --upload-file sedona-python-adapter-2.4_2.11-1.2.0-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-python-adapter-2.4_2.11/1.2.0-incubating/sedona-python-adapter-2.4_2.11-1.2.0-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-python-adapter-2.4_2.12-1.2.0-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-python-adapter-2.4_2.12/1.2.0-incubating/sedona-python-adapter-2.4_2.12-1.2.0-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-python-adapter-3.0_2.12-1.2.0-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-python-adapter-3.0_2.12/1.2.0-incubating/sedona-python-adapter-3.0_2.12-1.2.0-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-viz-2.4_2.11-1.2.0-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-viz-2.4_2.11/1.2.0-incubating/sedona-viz-2.4_2.11-1.2.0-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-viz-2.4_2.12-1.2.0-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-viz-2.4_2.12/1.2.0-incubating/sedona-viz-2.4_2.12-1.2.0-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-viz-3.0_2.12-1.2.0-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-viz-3.0_2.12/1.2.0-incubating/sedona-viz-3.0_2.12-1.2.0-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-core-2.4_2.11-1.2.0-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-core-2.4_2.11/1.2.0-incubating/sedona-core-2.4_2.11-1.2.0-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-core-2.4_2.12-1.2.0-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-core-2.4_2.12/1.2.0-incubating/sedona-core-2.4_2.12-1.2.0-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-core-3.0_2.12-1.2.0-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-core-3.0_2.12/1.2.0-incubating/sedona-core-3.0_2.12-1.2.0-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-sql-2.4_2.11-1.2.0-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-sql-2.4_2.11/1.2.0-incubating/sedona-sql-2.4_2.11-1.2.0-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-sql-2.4_2.12-1.2.0-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-sql-2.4_2.12/1.2.0-incubating/sedona-sql-2.4_2.12-1.2.0-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-sql-3.0_2.12-1.2.0-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-sql-3.0_2.12/1.2.0-incubating/sedona-sql-3.0_2.12-1.2.0-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-flink_2.12-1.2.0-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-flink_2.12/1.2.0-incubating/sedona-flink_2.12-1.2.0-incubating.pom.asc

rm sedona-core-2.4_2.11-1.2.0-incubating.pom.asc
rm sedona-core-2.4_2.12-1.2.0-incubating.pom.asc
rm sedona-core-3.0_2.12-1.2.0-incubating.pom.asc
rm sedona-sql-2.4_2.11-1.2.0-incubating.pom.asc
rm sedona-sql-2.4_2.12-1.2.0-incubating.pom.asc
rm sedona-sql-3.0_2.12-1.2.0-incubating.pom.asc
rm sedona-viz-2.4_2.11-1.2.0-incubating.pom.asc
rm sedona-viz-2.4_2.12-1.2.0-incubating.pom.asc
rm sedona-viz-3.0_2.12-1.2.0-incubating.pom.asc
rm sedona-python-adapter-2.4_2.11-1.2.0-incubating.pom.asc
rm sedona-python-adapter-2.4_2.12-1.2.0-incubating.pom.asc
rm sedona-python-adapter-3.0_2.12-1.2.0-incubating.pom.asc
rm sedona-flink_2.12-1.2.0-incubating.pom.asc

admin is your Apache ID username and admin123 is your Apache ID password. You can find the correct upload path from the web interface.

Once the staging repo is closed, click "Release" on the web interface.

Publish the doc website¶

Run mkdocs build in Sedona root directory. Copy all content in the site folder.
Check out GitHub incubator-sedona-website asf-site branch
Use the copied content to replace all content in asf-site branch and upload to GitHub. Then sedona.apache.org will be automatically updated.
You can also push the content to asf-staging branch. The staging website will be then updated: sedona.staged.apache.org

Javadoc and Scaladoc¶

Compile

You should first compile the entire docs using mkdocs build to get the site folder.

Javadoc: Use Intelij IDEA to generate Javadoc for core and viz module
Scaladoc: Run scaladoc -d site/api/javadoc/sql/ sql/src/main/scala/org/apache/sedona/sql/utils/*.scala

Copy

Copy the generated Javadoc (Scaladoc should already be there) to the corresponding folders in site/api/javadoc
Deploy Javadoc and Scaladoc with the project website

Compile R html docs¶

Make sure you install R, tree and curl on your Ubuntu machine. On Mac, just do brew install tree
```
sudo apt install littler tree libcurl4-openssl-dev
```

In the Sedona root directory, run the script below. This will create rdocs folder in Sedona /docs/api/rdocs

#!/bin/bash
Rscript generate-docs.R
cd ./docs/api/rdocs && tree -H '.' -L 1 --noreport --charset utf-8 -o index.html && cd ../../../

Last update: March 13, 2022 04:43:01