The introduction of the cyclone pool four years ago significantly increased data volumes and analytical requirements. ARPC is shifting towards being a data-driven, insight led organisation with an enterprise grade data and analytics platform.

ARPC has selected Databricks as its enterprise data and analytics platform following a platform assessment and platform capability validation based on organisational needs.

This Request for Information (RFI) seeks to identify information about potential implementation partners with demonstrated experience in configuring, integrating, and operationalising the Databricks environment within a Microsoft Azure ecosystem. This will include configuration of fit for purpose data layers and tooling for advanced actuarial analytics, and connections to existing Virtual Machines and outside system catastrophe and geospatial models. Ideally implementation partners will have experience deploying Databricks in an insurance context and within a Government environment.

ARPC anticipates a procurement process being undertaken upon completion of this RFI. Responding to this RFI does not guarantee that your organisation will be contacted again or invited to take part in any future procurement process.

Current State

ARPC’s current data architecture is fully cloud-based, leveraging Australian Government hosting arrangements and primarily using Azure Blob Storage for raw & unprocessed data storage, Azure SQL Databases for structured data storage and virtual machines for advanced analytics.

ARPC’s existing data environment is relatively straightforward, comprising a small number of structured data sources and well-defined data models. As a result, the ingestion and transformation of data into the Databricks environment is expected to be technically uncomplicated. Vendors should, however, ensure that proposed solutions maintain appropriate governance, validation, and traceability consistent with Australian Government data management standards.

Target State

ARPC has selected Databricks as its enterprise data and analytics platform following a comprehensive market assessment and platform validation process.

The target state is to establish a secure, scalable, and governed data and analytics environment that enables ARPC to deliver accurate, timely, and consistent insights across its terrorism and cyclone reinsurance pools.

The implementation partner will be required to deliver the following outcomes:

Platform Implementation and Integration

• Deploy and configure the Databricks platform and associated systems within ARPC’s Azure cloud environment.
• Establish all required connections, ingestion pipelines, and ETL/ELT processes between existing data sources, operational systems, and downstream reporting and analytics tools.
• Ensure alignment with ARPC’s enterprise architecture, security, and hosting arrangements.

Data Architecture, Governance and Security

• Design and implement the full data architecture, including raw (bronze), curated (silver), and presentation (gold) data layers.
• Establish a comprehensive framework for governance, metadata management, and data security that aligns with leading industry standards and supports long-term resilience, compliance and regulatory (e.g. ASD’s ISM) objectives.
• Implement data lineage, quality management, and audit mechanisms to ensure traceability, integrity, and compliance.

Transition to Business-as-Usual and Capability Uplift

• Develop detailed operational documentation, run books, and support models for post-implementation activities.
• Provide structured knowledge transfer and targeted capability uplift for ARPC technical and business teams to enable ongoing platform maintenance, enhancement, and self-service analytics.
• Support a smooth transition to business-as-usual operations, ensuring ARPC is positioned to sustain and evolve the platform independently.

The users and their needs

The implementation will support a defined group of internal users who require secure, accurate, and timely information to enable analytics, reporting, and decision-making across ARPC’s insurance pools.

User Landscape

ARPC’s data and analytics environment supports a targeted internal user base operating within the Azure cloud.

Approximately five specialist users (data engineers, actuaries, and analysts) will work directly in Databricks, supported by around 30 business and risk users who will access curated data and dashboards through Power BI.

Primary user groups:

• Analytical and Actuarial Teams – use Databricks to prepare, model, and analyse data to support pricing, exposure, and claims insights.
• Business and Risk Teams – access validated data and standardised metrics via Power BI for operational, performance, and compliance reporting.
• Executive and Board Users – receive high-level dashboards and reporting drawn from a single, governed data source to support strategic oversight.
• External Stakeholders – continue to receive standard published reports; no direct system access is required at this stage.

Cross-Cutting Requirements

• Governance and Security: The solution must enforce robust access controls, audit logging, and lineage consistent with the Protective Security Policy Framework (PSPF) and Information Security Manual (ISM).
• Integration: Initial scope covers integration with ARPC’s Azure data warehouse and associated data storage services.
• Scalability: The design should accommodate future expansion of data sources, users, and analytical capability.
• Knowledge Transfer: Partners must provide structured documentation and knowledge transfer to support effective transition to business-as-usual management.
• Upskilling: ARPC seeks information on partner capability to facilitate staff enablement in Databricks and Power BI as part of implementation.

Expected Outcome

The implemented solution will enable all user groups to access governed, reliable data through curated layers and dashboards; streamline analytical processes; and provide a secure, scalable foundation for ARPC’s data-driven decision-making.

Work already done

ARPC engaged a consultant who conducted an engagement to assess ARPC’s current state, define future ambitions, and develop a Data Strategy Roadmap, and target architecture system landscapes. Key deliverables include a prioritised list of use cases, technology architecture recommendations, and a phased implementation plan across three sprints.

Technical/business constraints

ARPC operates within a secure Microsoft Azure environment and has selected Databricks as its enterprise data and analytics platform, integrated with ARPC’s Azure data warehouse and Power BI. Implementation must align with the compliance and regulatory objectives noted in the problem solving statement, and ensuring data remains hosted in Australia. The solution should operate within ARPC’s existing ICT governance and change-control processes, support efficient transition to business-as-usual, and enable scalable growth without material re-engineering or disruption to existing reporting.