1 x Data Engineer
Tender ID: 454110
Tender Details
Tender Description
This Tender is invited by the Issuer.
IP Australia is seeking an experienced Data Engineer who will work in the Centre of Data Excellence and be responsible for the ongoing support, maintenance and enhancement of agency’s IP Data Platform (data lake), using Amazon Web Services (AWS) and other tools.
The primary responsibilities of the Data Engineer will be to support business users, data stewards and technical staff in the management and use of the platform:
• Configuring and supporting the AWS applications and tools on the platform for users and technical staff to manage access, security, data ingestion, delta merge, performance, data quality, data modelling, analytics and reporting.
• Managing DevOps automated deployment tools including Jenkins, Ansible and GitHub.
• Analysing and supporting data processes, analytics and reporting on the platform, including:
o Data analysis on the platform and its contributing source systems to identify problems that reduce the accuracy, data quality or performance of analytics products and reports.
o Remediating these issues by developing necessary cleaning rules, ETL programs, etc.
o Supporting users and technical staff to resolve issues with data ingestion, processing, data quality, access, tool use, etc.
o Adding new datasets.
• Helping design and develop a new modern data warehouse on the platform, with processes for access, security, data loads, data models, enrichment, reporting and analytics.
• Being proactive in the resolution of problems that arise.
Location
Similar Tenders
Active opportunities matching this tender's categories and regions.