minus34/gnafloader repository overview

⁠gnaf-loader

A quick way to load the complete Geocoded National Address File of Australia (GNAF) and Australian Administrative Boundaries into Postgres, simplified and ready to use as reference data for geocoding, analysis, visualisation and aggregation.

⁠What's GNAF?

Have a look at these intro slides⁠ (PDF⁠), as well as the data.gov.au page⁠.

⁠Process

1. In your docker environment pull the image using docker pull minus34/gnafloader:latest
2. Run using docker run --publish=5433:5432 minus34/gnafloader:latest
3. Access Postgres in the container via port 5433. Default login is - user: postgres, password: password

The data is also available in GDA2020. Use the tags with gda2020 in them.

Note: the compressed Docker images are 7-8Gb, uncompressed 21-25Gb

WARNING: The default postgres superuser password is insecure and should be changed using:

ALTER USER postgres PASSWORD '<something a lot more secure>'

⁠Changelog

⁠November 2024 Release

• Docker images are now available for ARM64 as well as AMD64
• Docker images have been upgraded to Postgres 16

⁠February 2023 Release

• Docker images have been upgraded to Postgres 15

⁠August 2022 Release

• Docker images have been upgraded to Postgres 14

⁠May 2022 Release

• Boundary concordance tables have been added to the GNAF schema (boundary_concordance & boundary_concordance_score. These solve the problem of trying to merge 2 or more datasets based on different census or administrative boundaries such as statistical areas or postcodes. Find out more here⁠.

⁠November 2021 Release

• Geoscape have removed the ABS Census 2011 boundaries and references from the GNAF tables
• old_locality_pid field has been removed from the following GNAF tables as the new and old locality_pid lookup table has been removed. Maintaining the field would have introduced a dependancy on the previous version of GNAF, overcomplicating the processing: address_principals, address_aliases, localities, streets, address_principal_admin_boundaries, address_alias_admin_boundaries
• old_locality_pid field has been removed from the following Admin Bdy tables for the above reasons: locality_bdys, locality_bdys_analysis
• The ABS Census meshblock boundary tables abs_20**_mb have had their meshblock code (mb**_code) fields changed to bigint type to bring them inline with GNAF tables, to speed up joins
• All ABS Census 2021 boundary tables have had their columns re-ordered into a similar structure to the 2016 tables. The state_pid field has been removed
• Added fix for missing coordinates in default geocode table. Affects 10 South Australian addresses

⁠August 2021 Release

• Existing locality_pids have been replaced by Geoscape
• old_locality_pid field has been added to the following GNAF tables: address_principals, address_aliases, localities, streets, address_principal_admin_boundaries, address_alias_admin_boundaries
• old_locality_pid field has been added to the following Admin Bdy tables: locality_bdys, locality_bdys_analysis
• Table, columns and foreign keys for ABS Census 2021 meshblocks have been added to GNAF
• mb_2021_code field has been added to address_principals, address_aliases
• ABS Census 2021 meshblock, SA1, SA2, SA3, SA4 and GCSSA boundaries have been added to Admin Bdys
• QA process now checks row counts between new & previous versions
• --previous-geoscape-version, --previous-gnaf-schema, --previous-admin-schema runtime parameters added to enable QA row count dcomparison
• minus34.com is now a secure website (long overdue) - all file downloads are now over https:// only

⁠May 2021 Release

• Renamed all references to PSMA to Geoscape, reflecting the data provider's new name
• The docker image build process has been completely redone
• Changes in the Geoscape Admin Boundaries folder structure, resulting in duplicate Authority files, is now handled correctly.
• Due to the above fix, all authority tables now have a standardised table structure of gid, code, name, description.