Australian State Government Department
Challenge: Making spatial data more accessible to the public with better data protection and efficiency
Solution: A cloud-based spatial data delivery platform built on FME and PostGIS
Key Benefits:
- Comprehensive range of spatial data formats available to meet the needs of the public
- Increased scalability, flexibility and business continuity with a cloud-hosted platform
- Faster availability of new spatial data to the public with improved quality assurance
- More efficient, transparent and sustainable processes for managing spatial data
- Improved autonomy and self-service capabilities for spatial data custodians
“1Spatial helped us rearchitect our vector data library to meet our objective of a highly available and reliable cloud-based data delivery platform. The scalability and flexibility the cloud offers is critical. You can’t just keep expanding data centre storage like you can in the cloud. That is one of the big benefits as well as the reliability of service and data continuity which the cloud will give you in spades.”
Manager of the Spatial Services department
Overview
1Spatial Australia has been working with government departments to transform its spatial data supply and delivery processes and to re-architect and migrate their spatial data libraries to the cloud to support their strategies to help the community make better decisions about the natural and built environment.
A key driver was to meet increasing public demand for spatial data in raster or point cloud formats through a new data sharing service. This replaced and extended the earlier Spatial data service that could only deliver spatial data in traditional vector formats.
Other important drivers included the increased scalability, flexibility and business continuity that the cloud provides. The department began its cloud migration with a new spatial data platform for its rapidly growing raster data in the Amazon cloud. The need to migrate all spatial data to the cloud – including vector-based data – became more urgent after a service outage highlighted the need to be free of on premises services.
Challenge
To meet demands from the public to provide increasing volumes of spatial data, in a wider range of formats, and in a more timely manner, the department needed to transform its spatial data platform. There were two aspects to this. The first was to replace the back-end processes that extracted and transformed data from the existing spatial data library.
These processes had previously been automated using an FME Objects solution from Safe Software and custom coding developed in Java. However, the custom coding made them difficult to maintain. In particular, the range of formats that could be delivered were limited, did not include raster-based imagery, and could not easily be expanded.
The second aspect was the ingestion of new vector-based spatial data into the spatial data library which was not previously automated. Spatial data custodians had to submit data to the Information Services Division to configure individual components and store them in an Oracle database. The custodians then had to verify that the transformed data was loaded correctly with its spatial integrity maintained.
In addition, the department needed to rearchitect the library and migrate it to a new cloud-hosted database – alongside its cloud-based library for raster data – to provide increased scalability, flexibility and business continuity.
Solution
The department initially engaged 1Spatial, the Premier Platinum Partner of Safe Software and value added reseller of FME in Australia, to conduct a review of the department’s existing spatial data service system and, specifically, the components of the system which provide “clip, zip and ship” data delivery capabilities.
The decision was then made to replace them with a modern solution, based on FME Server and FME Desktop, that enhanced existing capabilities. The new solution could not only extract data from both the department’s vector and raster-based data libraries but also transform and deliver it in a comprehensive range of spatial data formats.
The decision to use FME was based on the department’s familiarity with it, the fact it is the leading tool for spatial data transformation and workflow configuration, and the ability it gives the department to remain independent of proprietary data formats and adopt new formats in the future.
Because 1Spatial configured the new solution using standard FME functionality, no custom coding was required. Not only does this simplify support and maintenance, it also makes it easy to adopt new capabilities – such as transformations to new spatial data formats – as they become available in future versions of FME. This enabled the department to replace bespoke code with configurable workbenches that are self-documenting.
Following the success of the first project, the department decided to accelerate its cloud migration by engaging 1Spatial to rearchitect its Oracle-based spatial data supply process. This included the migration to a new PostGIS spatial database in the cloud.
1Spatial configured FME to streamline the ingestion of new vector data into the cloud data library. It was able to automate previously manual processes and give data custodians the ability to load, secure and publish their own data through an easy to use browser based interface and APIs. In particular, the department is now able to leverage the quality assurance (QA) capabilities of FME to automatically verify the spatial integrity of the data uploaded to the cloud which will assure reliability of services.