Skip to content

Publish Sedona

  1. Download Apache Rat binary (.jar file).
  2. Run the following terminal script:
    #!/bin/bash
    git clone --shared --branch master https://github.com/apache/incubator-sedona.git sedona-src
    java -jar apache-rat-0.13.jar -d sedona-src > report.txt
    
  3. Read the generated report.txt file and make sure all source code files have ASF header.
  4. Delete the generated report and cloned files
    rm -rf sedona-src
    rm report.txt
    

Note

Please read the following guidelines first: 1. ASF Incubator Distribution Guidelines: https://incubator.apache.org/guides/distribution.html 2. ASF Release Guidelines: https://infra.apache.org/release-publishing.html 3. ASF Incubator Release Votes Guidelines: https://issues.apache.org/jira/browse/LEGAL-469

Publish SNAPSHOTs

Publish Maven SNAPSHOTs

This step is to publish the SNAPSHOTs to https://repository.apache.org

The detailed requirement is on ASF Infra website

Prepare for Spark 3.0 and Scala 2.12

  1. Prepare the SNAPSHOTs
    mvn clean -Darguments="-DskipTests" release:prepare -DdryRun=true -DautoVersionSubmodules=true -Dresume=false
    
  2. Deploy the SNAPSHOTs
    mvn deploy -DskipTests
    

Prepare for Spark 2.4 and Scala 2.11

  1. Prepare the SNAPSHOTs
    mvn clean release:prepare -DdryRun=true -DautoVersionSubmodules=true -Dresume=false -DcheckModificationExcludeList=sql/src/main/scala/org/apache/sedona/sql/UDF/UdfRegistrator.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/JoinQueryDetector.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/TraitJoinQueryExec.scala -Darguments="-DskipTests -Dscala=2.11 -Dspark=2.4"
    
  2. Deploy the SNAPSHOTs
    mvn deploy -DskipTests -Dscala=2.11 -Dspark=2.4
    

Prepare for Spark 2.4 and Scala 2.12

  1. Prepare the SNAPSHOTs
    mvn clean release:prepare -DdryRun=true -DautoVersionSubmodules=true -Dresume=false -DcheckModificationExcludeList=sql/src/main/scala/org/apache/sedona/sql/UDF/UdfRegistrator.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/JoinQueryDetector.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/TraitJoinQueryExec.scala -Darguments="-DskipTests -Dscala=2.12 -Dspark=2.4"
    
  2. Deploy the SNAPSHOTs
    mvn deploy -DskipTests -Dscala=2.12 -Dspark=2.4
    

Publish releases

Update Sedona Python, R and Zeppelin versions

Make sure the Sedona version in the following files are 1.1.1-incubating. Note that: Python and R versions cannot have "incubating" postfix.

  1. https://github.com/apache/incubator-sedona/blob/master/python/sedona/version.py
  2. https://github.com/apache/incubator-sedona/blob/master/R/DESCRIPTION
  3. https://github.com/apache/incubator-sedona/blob/master/zeppelin/package.json

Stage the Release Candidate

This step is to stage the release to https://repository.apache.org

For Spark 3.0 and Scala 2.12

  1. Prepare a release. Manually enter the following variables in the terminal: release id: 1.1.1-incubating, scm tag id: sedona-1.1.1-incubating-rc1. You also need to provide GitHub username and password three times.
    mvn clean release:prepare -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests"
    
  2. Stage a release
    mvn clean release:perform -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests" 
    
  3. Now the releases are staged. A tag and two commits will be created on Sedona GitHub repo.

Now let's repeat the process to other Sedona modules. Make sure you use the correct SCM Git tag id sedona-1.1.1-incubating-rc1 (see below).

For Spark 2.4 and Scala 2.11

mvn org.apache.maven.plugins:maven-release-plugin:2.3.2:perform -DconnectionUrl=scm:git:https://github.com/apache/incubator-sedona.git -Dtag=sedona-1.1.1-incubating-rc1 -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests -Dscala=2.11 -Dspark=2.4"

For Spark 2.4 and Scala 2.12

mvn org.apache.maven.plugins:maven-release-plugin:2.3.2:perform -DconnectionUrl=scm:git:https://github.com/apache/incubator-sedona.git -Dtag=sedona-1.1.1-incubating-rc1 -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests -Dscala=2.12 -Dspark=2.4"

Upload Release Candidate

All release candidates must be first placed in ASF Dist Dev SVN before vote: https://dist.apache.org/repos/dist/dev/incubator/sedona

  1. Make sure your armored PGP public key (must be encrypted by RSA-4096) is included in the KEYS file: https://dist.apache.org/repos/dist/dev/incubator/sedona/KEYS, and publish in major key servers: https://pgp.mit.edu/, https://keyserver.ubuntu.com/, http://keys.gnupg.net/
  2. Create a folder on SVN, such as sedona-1.1.1-incubating-rc1
    #!/bin/bash
    svn mkdir -m "Adding folder" https://dist.apache.org/repos/dist/dev/incubator/sedona/1.1.1-incubating-rc1
    
  3. In a folder other than the Sedona git repo, run the following script to create six files and two folders.
    #!/bin/bash
    git clone --shared --branch sedona-1.1.1-incubating-rc1 https://github.com/apache/incubator-sedona.git apache-sedona-1.1.1-incubating-src
    rm -rf apache-sedona-1.1.1-incubating-src/.git
    tar czf apache-sedona-1.1.1-incubating-src.tar.gz apache-sedona-1.1.1-incubating-src
    mkdir apache-sedona-1.1.1-incubating-bin
    cd apache-sedona-1.1.1-incubating-src && mvn clean install -DskipTests -Dscala=2.12 -Dspark=3.0 && cd ..
    cp apache-sedona-1.1.1-incubating-src/core/target/sedona-*1.1.1-incubating.jar apache-sedona-1.1.1-incubating-bin/
    cp apache-sedona-1.1.1-incubating-src/sql/target/sedona-*1.1.1-incubating.jar apache-sedona-1.1.1-incubating-bin/
    cp apache-sedona-1.1.1-incubating-src/viz/target/sedona-*1.1.1-incubating.jar apache-sedona-1.1.1-incubating-bin/
    cp apache-sedona-1.1.1-incubating-src/python-adapter/target/sedona-*1.1.1-incubating.jar apache-sedona-1.1.1-incubating-bin/
    cd apache-sedona-1.1.1-incubating-src && mvn clean install -DskipTests -Dscala=2.11 -Dspark=2.4 && cd ..
    cp apache-sedona-1.1.1-incubating-src/core/target/sedona-*1.1.1-incubating.jar apache-sedona-1.1.1-incubating-bin/
    cp apache-sedona-1.1.1-incubating-src/sql/target/sedona-*1.1.1-incubating.jar apache-sedona-1.1.1-incubating-bin/
    cp apache-sedona-1.1.1-incubating-src/viz/target/sedona-*1.1.1-incubating.jar apache-sedona-1.1.1-incubating-bin/
    cp apache-sedona-1.1.1-incubating-src/python-adapter/target/sedona-*1.1.1-incubating.jar apache-sedona-1.1.1-incubating-bin/
    cd apache-sedona-1.1.1-incubating-src && mvn clean install -DskipTests -Dscala=2.12 -Dspark=2.4 && cd ..
    cp apache-sedona-1.1.1-incubating-src/core/target/sedona-*1.1.1-incubating.jar apache-sedona-1.1.1-incubating-bin/
    cp apache-sedona-1.1.1-incubating-src/sql/target/sedona-*1.1.1-incubating.jar apache-sedona-1.1.1-incubating-bin/
    cp apache-sedona-1.1.1-incubating-src/viz/target/sedona-*1.1.1-incubating.jar apache-sedona-1.1.1-incubating-bin/
    cp apache-sedona-1.1.1-incubating-src/python-adapter/target/sedona-*1.1.1-incubating.jar apache-sedona-1.1.1-incubating-bin/
    tar czf apache-sedona-1.1.1-incubating-bin.tar.gz apache-sedona-1.1.1-incubating-bin
    shasum -a 512 apache-sedona-1.1.1-incubating-src.tar.gz > apache-sedona-1.1.1-incubating-src.tar.gz.sha512
    shasum -a 512 apache-sedona-1.1.1-incubating-bin.tar.gz > apache-sedona-1.1.1-incubating-bin.tar.gz.sha512
    gpg -ab apache-sedona-1.1.1-incubating-src.tar.gz
    gpg -ab apache-sedona-1.1.1-incubating-bin.tar.gz
    
  4. Upload six files to SVN and delete all created files using the following script
    #!/bin/bash
    svn import -m "Adding file" apache-sedona-1.1.1-incubating-src.tar.gz https://dist.apache.org/repos/dist/dev/incubator/sedona/1.1.1-incubating-rc1/apache-sedona-1.1.1-incubating-src.tar.gz
    svn import -m "Adding file" apache-sedona-1.1.1-incubating-src.tar.gz.asc https://dist.apache.org/repos/dist/dev/incubator/sedona/1.1.1-incubating-rc1/apache-sedona-1.1.1-incubating-src.tar.gz.asc
    svn import -m "Adding file" apache-sedona-1.1.1-incubating-src.tar.gz.sha512 https://dist.apache.org/repos/dist/dev/incubator/sedona/1.1.1-incubating-rc1/apache-sedona-1.1.1-incubating-src.tar.gz.sha512
    svn import -m "Adding file" apache-sedona-1.1.1-incubating-bin.tar.gz https://dist.apache.org/repos/dist/dev/incubator/sedona/1.1.1-incubating-rc1/apache-sedona-1.1.1-incubating-bin.tar.gz
    svn import -m "Adding file" apache-sedona-1.1.1-incubating-bin.tar.gz.asc https://dist.apache.org/repos/dist/dev/incubator/sedona/1.1.1-incubating-rc1/apache-sedona-1.1.1-incubating-bin.tar.gz.asc
    svn import -m "Adding file" apache-sedona-1.1.1-incubating-bin.tar.gz.sha512 https://dist.apache.org/repos/dist/dev/incubator/sedona/1.1.1-incubating-rc1/apache-sedona-1.1.1-incubating-bin.tar.gz.sha512
    rm apache-sedona-1.1.1-incubating-src.tar.gz
    rm apache-sedona-1.1.1-incubating-src.tar.gz.asc
    rm apache-sedona-1.1.1-incubating-src.tar.gz.sha512
    rm apache-sedona-1.1.1-incubating-bin.tar.gz
    rm apache-sedona-1.1.1-incubating-bin.tar.gz.asc
    rm apache-sedona-1.1.1-incubating-bin.tar.gz.sha512
    rm -rf apache-sedona-1.1.1-incubating-src
    rm -rf apache-sedona-1.1.1-incubating-bin
    

Vote in dev sedona.apache.org

  1. Check the status of the staging repo: Locate and Examine Your Staging Repository . You should see 12 Sedona modules in total.
  2. Call for a vote in Sedona community and Apache incubator. Then close the staging repo.

Here is a generated vote email. Please add changes at the end if needed:

Subject: [VOTE] Release Apache Sedona 1.1.1-incubating-rc1

Hi all,

This is a call for vote on Apache Sedona 1.1.1-incubating-rc1. Please refer to the changes listed at the bottom of this email.

Release notes:
https://github.com/apache/incubator-sedona/blob/sedona-1.1.1-incubating-rc1/docs/setup/release-notes.md

Build instructions:
https://github.com/apache/incubator-sedona/blob/sedona-1.1.1-incubating-rc1/docs/setup/compile.md

GitHub tag:
https://github.com/apache/incubator-sedona/releases/tag/sedona-1.1.1-incubating-rc1

GPG public key to verify the Release:
https://downloads.apache.org/incubator/sedona/KEYS

Source code and binaries:
https://dist.apache.org/repos/dist/dev/incubator/sedona/1.1.1-incubating-rc1/

The vote will be open for at least 72 hours or until a majority of at least 3 "approve" PMC votes are cast

Please vote accordingly:

[ ] +1 approve

[ ] +0 no opinion

[ ] -1 disapprove with the reason

Checklist for reference (because of DISCLAIMER-WIP, other checklist items are not blockers):

[ ] Download links are valid.

[ ] Checksums and PGP signatures are valid.

[ ] DISCLAIMER is included.

[ ] Source code artifacts have correct names matching the current release.

For a detailed checklist  please refer to:
https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist

------------

Changes according to the comments on the previous release
Original comment (Permalink from https://lists.apache.org/list.html): 

Here is a generated "pass" email:

Subject: [RESULT][VOTE] Release Apache Sedona 1.1.1-incubating-rc1

Dear all,

The vote closes now as 72hr have passed. The vote PASSES with

+? (binding): NAME1, NAME2, NAME3
+? (non-binding): NAME4
No -1 votes

The vote thread (Permalink from https://lists.apache.org/list.html):

I will now bring the vote to general@incubator.apache.org to get
approval by the IPMC. If this vote passes too, the release is accepted and will be published.

Vote in general incubator.apache.org

Here is a generated vote email. Please add changes at the end if needed:

Subject: [VOTE] Release Apache Sedona 1.1.1-incubating-rc1

Hi all,

This is a call for vote on Apache Sedona 1.1.1-incubating-rc1. Please refer to the changes listed at the bottom of this email.

Sedona Community vote thread (Permalink from https://lists.apache.org/list.html):

Sedona community vote result thread (Permalink from https://lists.apache.org/list.html):

Release notes:
https://github.com/apache/incubator-sedona/blob/sedona-1.1.1-incubating-rc1/docs/setup/release-notes.md

Build instructions:
https://github.com/apache/incubator-sedona/blob/sedona-1.1.1-incubating-rc1/docs/setup/compile.md

GitHub tag:
https://github.com/apache/incubator-sedona/releases/tag/sedona-1.1.1-incubating-rc1

GPG public key to verify the Release:
https://downloads.apache.org/incubator/sedona/KEYS

Source code and binaries:
https://dist.apache.org/repos/dist/dev/incubator/sedona/1.1.1-incubating-rc1/

The vote will be open for at least 72 hours or until a majority of at least 3 "approve" PMC votes are cast

Please vote accordingly:

[ ] +1 approve

[ ] +0 no opinion

[ ] -1 disapprove with the reason

Checklist for reference (because of DISCLAIMER-WIP, other checklist items are not blockers):

[ ] Download links are valid.

[ ] Checksums and PGP signatures are valid.

[ ] DISCLAIMER is included.

[ ] Source code artifacts have correct names matching the current release.

For a detailed checklist  please refer to:
https://cwiki.apache.org/confluence/display/INCUBATOR/Incubator+Release+Checklist

------------

Changes according to the comments on the previous release
Original comment (Permalink from https://lists.apache.org/list.html): 

Here is a generated "pass" email:

Subject: [RESULT][VOTE] Release Apache Sedona 1.1.1-incubating-rc1

Dear all,

The vote closes now as 72hr have passed. The vote PASSES with

+? (binding): NAME1, NAME2, NAME3
+? (non-binding): NAME4
No -1 votes

The vote thread (Permalink from https://lists.apache.org/list.html):

I will publish the release and make an annoucement once it is done.

Here is a generated "announce" email. This email should be CCed to dev@sedona.apache.org:

Subject: [ANNOUNCE] Apache Sedona 1.1.1-incubating released

Dear all,

We are happy to report that we have released Apache Sedona (incubating) 1.1.1-incubating. Thank you again for your help.

Apache Sedona (incubating) is a cluster computing system for processing large-scale spatial data. 


Vote thread (Permalink from https://lists.apache.org/list.html):


Vote result thread (Permalink from https://lists.apache.org/list.html):


Website:
http://sedona.apache.org/

Release notes:
https://github.com/apache/incubator-sedona/blob/sedona-1.1.1-incubating/docs/setup/release-notes.md

Download links:
https://github.com/apache/incubator-sedona/releases/tag/sedona-1.1.1-incubating

Additional resources:
Get started: http://sedona.apache.org/setup/overview/
Tutorials: http://sedona.apache.org/tutorial/rdd/
Mailing list: dev@sedona.apache.org
Twitter: https://twitter.com/ApacheSedona
Gitter: https://gitter.im/apache/sedona

Regards,
Apache Sedona (incubating) Team

Failed vote

If a vote failed, please first drop the staging repo on repository.apache.org. Then redo all the steps above. Make sure you use a new scm tag for the new release candidate when use maven-release-plugin (i.e., 1.1.1-incubating-rc2). You can change the sedona.current_rc and sedona.current_git_tag in mkdocs.yml to generate the script listed on this webpage.

Release the package

  1. Move all files in https://dist.apache.org/repos/dist/dev/incubator/sedona to https://dist.apache.org/repos/dist/release/incubator/sedona, using svn
    #!/bin/bash
    svn mkdir -m "Adding folder" https://dist.apache.org/repos/dist/release/incubator/sedona/1.1.1-incubating
    wget https://dist.apache.org/repos/dist/dev/incubator/sedona/1.1.1-incubating-rc1/apache-sedona-1.1.1-incubating-src.tar.gz
    wget https://dist.apache.org/repos/dist/dev/incubator/sedona/1.1.1-incubating-rc1/apache-sedona-1.1.1-incubating-src.tar.gz.asc
    wget https://dist.apache.org/repos/dist/dev/incubator/sedona/1.1.1-incubating-rc1/apache-sedona-1.1.1-incubating-src.tar.gz.sha512
    wget https://dist.apache.org/repos/dist/dev/incubator/sedona/1.1.1-incubating-rc1/apache-sedona-1.1.1-incubating-bin.tar.gz
    wget https://dist.apache.org/repos/dist/dev/incubator/sedona/1.1.1-incubating-rc1/apache-sedona-1.1.1-incubating-bin.tar.gz.asc
    wget https://dist.apache.org/repos/dist/dev/incubator/sedona/1.1.1-incubating-rc1/apache-sedona-1.1.1-incubating-bin.tar.gz.sha512
    svn import -m "Adding file" apache-sedona-1.1.1-incubating-src.tar.gz https://dist.apache.org/repos/dist/release/incubator/sedona/1.1.1-incubating/apache-sedona-1.1.1-incubating-src.tar.gz
    svn import -m "Adding file" apache-sedona-1.1.1-incubating-src.tar.gz.asc https://dist.apache.org/repos/dist/release/incubator/sedona/1.1.1-incubating/apache-sedona-1.1.1-incubating-src.tar.gz.asc
    svn import -m "Adding file" apache-sedona-1.1.1-incubating-src.tar.gz.sha512 https://dist.apache.org/repos/dist/release/incubator/sedona/1.1.1-incubating/apache-sedona-1.1.1-incubating-src.tar.gz.sha512
    svn import -m "Adding file" apache-sedona-1.1.1-incubating-bin.tar.gz https://dist.apache.org/repos/dist/release/incubator/sedona/1.1.1-incubating/apache-sedona-1.1.1-incubating-bin.tar.gz
    svn import -m "Adding file" apache-sedona-1.1.1-incubating-bin.tar.gz.asc https://dist.apache.org/repos/dist/release/incubator/sedona/1.1.1-incubating/apache-sedona-1.1.1-incubating-bin.tar.gz.asc
    svn import -m "Adding file" apache-sedona-1.1.1-incubating-bin.tar.gz.sha512 https://dist.apache.org/repos/dist/release/incubator/sedona/1.1.1-incubating/apache-sedona-1.1.1-incubating-bin.tar.gz.sha512
    rm apache-sedona-1.1.1-incubating-src.tar.gz
    rm apache-sedona-1.1.1-incubating-src.tar.gz.asc
    rm apache-sedona-1.1.1-incubating-src.tar.gz.sha512
    rm apache-sedona-1.1.1-incubating-bin.tar.gz
    rm apache-sedona-1.1.1-incubating-bin.tar.gz.asc
    rm apache-sedona-1.1.1-incubating-bin.tar.gz.sha512
    
  2. Add the download link to Download page and create a GitHub release.
  3. (1) Publish Python project to PyPi using twine. You must have the maintainer priviledge of https://pypi.org/project/apache-sedona/. (2) Publish Zeppelin plugin to NPM
    #!/bin/bash
    git clone --shared --branch sedona-1.1.1-incubating-rc1 https://github.com/apache/incubator-sedona.git apache-sedona-1.1.1-incubating-src
    cd apache-sedona-1.1.1-incubating-src/python && python3 setup.py sdist bdist_wheel && twine upload dist/* && cd ..
    cd zeppelin && npm publish && cd ..
    rm -rf apache-sedona-1.1.1-incubating-src
    
  4. Publish Sedona R to CRAN. More details to be added.
    #!/bin/bash
    R CMD build .
    R CMD check --as-cran apache.sedona_*.tar.gz
    
  5. Instructions on how to submit a R package to CRAN are at the bottom of the CRAN front page, “Submitting to CRAN.” Submission is now via a web form.
  6. Close the staging repo on https://repository.apache.org. If the staging repo has been automatically closed by the system, please read below.

Use Maven Release Plugin directly from an existing tag

The staging repo on repository.apache.org is usually automatically closed before the voting is closed. If so, you need to do mvn release:perform from an existing tag. Note that: you have to use org.apache.maven.plugins:maven-release-plugin:2.3.2:perform due to a bug in maven release plugin from v2.4 (https://issues.apache.org/jira/browse/SCM-729). Make sure you use the correct scm tag (i.e., sedona-1.1.1-incubating-rc1).

For Spark 3.0 and Scala 2.12
mvn org.apache.maven.plugins:maven-release-plugin:2.3.2:perform -DconnectionUrl=scm:git:https://github.com/apache/incubator-sedona.git -Dtag=sedona-1.1.1-incubating-rc1 -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests"
For Spark 2.4 and Scala 2.11
mvn org.apache.maven.plugins:maven-release-plugin:2.3.2:perform -DconnectionUrl=scm:git:https://github.com/apache/incubator-sedona.git -Dtag=sedona-1.1.1-incubating-rc1 -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests -Dscala=2.11 -Dspark=2.4"
For Spark 2.4 and Scala 2.12
mvn org.apache.maven.plugins:maven-release-plugin:2.3.2:perform -DconnectionUrl=scm:git:https://github.com/apache/incubator-sedona.git -Dtag=sedona-1.1.1-incubating-rc1 -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests -Dscala=2.12 -Dspark=2.4"

Fix the error when close the staged repo

In the last step, you may see 6 errors similar to the following:

typeId  signature-staging
failureMessage  Invalid Signature: '/org/apache/sedona/sedona-python-adapter-2.4_2.12/1.1.1-incubating/sedona-python-adapter-2.4_2.12-1.1.1-incubating.pom.asc' is not a valid signature for 'sedona-python-adapter-2.4_2.12-1.1.1-incubating.pom'.
failureMessage  Invalid Signature: '/org/apache/sedona/sedona-python-adapter-2.4_2.11/1.1.1-incubating/sedona-python-adapter-2.4_2.11-1.1.1-incubating.pom.asc' is not a valid signature for 'sedona-python-adapter-2.4_2.11-1.1.1-incubating.pom'.
failureMessage  Invalid Signature: '/org/apache/sedona/sedona-python-adapter-3.0_2.12/1.1.1-incubating/sedona-python-adapter-3.0_2.12-1.1.1-incubating.pom.asc' is not a valid signature for 'sedona-python-adapter-3.0_2.12-1.1.1-incubating.pom'.
failureMessage  Invalid Signature: '/org/apache/sedona/sedona-viz-2.4_2.12/1.1.1-incubating/sedona-viz-2.4_2.12-1.1.1-incubating.pom.asc' is not a valid signature for 'sedona-viz-2.4_2.12-1.1.1-incubating.pom'.
failureMessage  Invalid Signature: '/org/apache/sedona/sedona-viz-3.0_2.12/1.1.1-incubating/sedona-viz-3.0_2.12-1.1.1-incubating.pom.asc' is not a valid signature for 'sedona-viz-3.0_2.12-1.1.1-incubating.pom'.
failureMessage  Invalid Signature: '/org/apache/sedona/sedona-viz-2.4_2.11/1.1.1-incubating/sedona-viz-2.4_2.11-1.1.1-incubating.pom.asc' is not a valid signature for 'sedona-viz-2.4_2.11-1.1.1-incubating.pom'.

This is caused by a bug in the resolved-pom-maven-plugin in POM.xml. You will have to upload the signatures of the POM files mannualy.

Please run the following script to reupload ASC files to the staging repo. Please make sure you use the correct Sedona staging repo ID, ASF username and password.

#!/bin/bash
username=admin
password=admin123
stagingid=1016

wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-core-2.4_2.11/1.1.1-incubating/sedona-core-2.4_2.11-1.1.1-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-core-2.4_2.12/1.1.1-incubating/sedona-core-2.4_2.12-1.1.1-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-core-3.0_2.12/1.1.1-incubating/sedona-core-3.0_2.12-1.1.1-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-sql-2.4_2.11/1.1.1-incubating/sedona-sql-2.4_2.11-1.1.1-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-sql-2.4_2.12/1.1.1-incubating/sedona-sql-2.4_2.12-1.1.1-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-sql-3.0_2.12/1.1.1-incubating/sedona-sql-3.0_2.12-1.1.1-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-viz-2.4_2.11/1.1.1-incubating/sedona-viz-2.4_2.11-1.1.1-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-viz-2.4_2.12/1.1.1-incubating/sedona-viz-2.4_2.12-1.1.1-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-viz-3.0_2.12/1.1.1-incubating/sedona-viz-3.0_2.12-1.1.1-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-python-adapter-2.4_2.11/1.1.1-incubating/sedona-python-adapter-2.4_2.11-1.1.1-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-python-adapter-2.4_2.12/1.1.1-incubating/sedona-python-adapter-2.4_2.12-1.1.1-incubating.pom
wget https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-python-adapter-3.0_2.12/1.1.1-incubating/sedona-python-adapter-3.0_2.12-1.1.1-incubating.pom

gpg -ab sedona-core-2.4_2.11-1.1.1-incubating.pom
gpg -ab sedona-core-2.4_2.12-1.1.1-incubating.pom
gpg -ab sedona-core-3.0_2.12-1.1.1-incubating.pom
gpg -ab sedona-sql-2.4_2.11-1.1.1-incubating.pom
gpg -ab sedona-sql-2.4_2.12-1.1.1-incubating.pom
gpg -ab sedona-sql-3.0_2.12-1.1.1-incubating.pom
gpg -ab sedona-viz-2.4_2.11-1.1.1-incubating.pom
gpg -ab sedona-viz-2.4_2.12-1.1.1-incubating.pom
gpg -ab sedona-viz-3.0_2.12-1.1.1-incubating.pom
gpg -ab sedona-python-adapter-2.4_2.11-1.1.1-incubating.pom
gpg -ab sedona-python-adapter-2.4_2.12-1.1.1-incubating.pom
gpg -ab sedona-python-adapter-3.0_2.12-1.1.1-incubating.pom

curl -v -u $username:$password --upload-file sedona-python-adapter-2.4_2.11-1.1.1-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-python-adapter-2.4_2.11/1.1.1-incubating/sedona-python-adapter-2.4_2.11-1.1.1-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-python-adapter-2.4_2.12-1.1.1-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-python-adapter-2.4_2.12/1.1.1-incubating/sedona-python-adapter-2.4_2.12-1.1.1-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-python-adapter-3.0_2.12-1.1.1-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-python-adapter-3.0_2.12/1.1.1-incubating/sedona-python-adapter-3.0_2.12-1.1.1-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-viz-2.4_2.11-1.1.1-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-viz-2.4_2.11/1.1.1-incubating/sedona-viz-2.4_2.11-1.1.1-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-viz-2.4_2.12-1.1.1-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-viz-2.4_2.12/1.1.1-incubating/sedona-viz-2.4_2.12-1.1.1-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-viz-3.0_2.12-1.1.1-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-viz-3.0_2.12/1.1.1-incubating/sedona-viz-3.0_2.12-1.1.1-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-core-2.4_2.11-1.1.1-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-core-2.4_2.11/1.1.1-incubating/sedona-core-2.4_2.11-1.1.1-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-core-2.4_2.12-1.1.1-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-core-2.4_2.12/1.1.1-incubating/sedona-core-2.4_2.12-1.1.1-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-core-3.0_2.12-1.1.1-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-core-3.0_2.12/1.1.1-incubating/sedona-core-3.0_2.12-1.1.1-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-sql-2.4_2.11-1.1.1-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-sql-2.4_2.11/1.1.1-incubating/sedona-sql-2.4_2.11-1.1.1-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-sql-2.4_2.12-1.1.1-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-sql-2.4_2.12/1.1.1-incubating/sedona-sql-2.4_2.12-1.1.1-incubating.pom.asc

curl -v -u $username:$password --upload-file sedona-sql-3.0_2.12-1.1.1-incubating.pom.asc https://repository.apache.org/service/local/repositories/orgapachesedona-$stagingid/content/org/apache/sedona/sedona-sql-3.0_2.12/1.1.1-incubating/sedona-sql-3.0_2.12-1.1.1-incubating.pom.asc

rm sedona-core-2.4_2.11-1.1.1-incubating.pom.asc
rm sedona-core-2.4_2.12-1.1.1-incubating.pom.asc
rm sedona-core-3.0_2.12-1.1.1-incubating.pom.asc
rm sedona-sql-2.4_2.11-1.1.1-incubating.pom.asc
rm sedona-sql-2.4_2.12-1.1.1-incubating.pom.asc
rm sedona-sql-3.0_2.12-1.1.1-incubating.pom.asc
rm sedona-viz-2.4_2.11-1.1.1-incubating.pom.asc
rm sedona-viz-2.4_2.12-1.1.1-incubating.pom.asc
rm sedona-viz-3.0_2.12-1.1.1-incubating.pom.asc
rm sedona-python-adapter-2.4_2.11-1.1.1-incubating.pom.asc
rm sedona-python-adapter-2.4_2.12-1.1.1-incubating.pom.asc
rm sedona-python-adapter-3.0_2.12-1.1.1-incubating.pom.asc
admin is your Apache ID username and admin123 is your Apache ID password. You can find the correct upload path from the web interface.

Once the staging repo is closed, click "Release" on the web interface.

Publish the doc website

  1. Run mkdocs build in Sedona root directory. Copy all content in the site folder.
  2. Check out GitHub incubator-sedona-website asf-site branch
  3. Use the copied content to replace all content in asf-site branch and upload to GitHub. Then sedona.apache.org will be automatically updated.
  4. You can also push the content to asf-staging branch. The staging website will be then updated: sedona.staged.apache.org

Javadoc and Scaladoc

Compile

You should first compile the entire docs using mkdocs build to get the site folder.

  • Javadoc: Use Intelij IDEA to generate Javadoc for core and viz module
  • Scaladoc: Run scaladoc -d site/api/javadoc/sql/ sql/src/main/scala/org/apache/sedona/sql/utils/*.scala

Copy

  1. Copy the generated Javadoc (Scaladoc should already be there) to the corresponding folders in site/api/javadoc
  2. Deploy Javadoc and Scaladoc with the project website

Compile R html docs

  1. Make sure you install R, tree and curl on your Ubuntu machine. On Mac, just do brew install tree
    sudo apt install littler tree libcurl4-openssl-dev
    
  2. In the Sedona root directory, run the script below. This will create rdocs folder in Sedona /docs/api/rdocs
    #!/bin/bash
    Rscript generate-docs.R
    cd ./docs/api/rdocs && tree -H '.' -L 1 --noreport --charset utf-8 -o index.html && cd ../../../
    

Last update: November 23, 2021 11:46:44
Back to top