Data Engineers (Multiple)

⁠⁠⁠The Department of Agriculture, Fisheries and Forestry (DAFF) is looking for Data Engineers with strong experience developing Extract, Transform, Load (ETL) and Extract, Load, transform (ELT) processes across several data and analytics platforms to join its Enterprise Analytics section.

The role will be responsible for design, development and unit testing activities across several data movement and transformation processes within DAFF. These data movement processes are being developed to focus on the preparation of data for use in decision making processes across the department, utilising modern cloud technology (Azure) to enable operational analytics use cases.

The successful candidate will require experience with the following techniques and technologies:

1.MS Azure Stack

Data Integration

1. Data Factory
2. SQL Server Integration Services
3. Databricks

Data Store

• SQL Server
• Data Lake Storage

Analytics

• Azure Databricks
• Azure Machine Learning
• ArcGIS Enterprise

2. Development Tools – DevOps, Visual Studio, VS Code

3. Data technology solutions – sourcing (Oracle, Ingres, Azure, SQL Server), collecting, ingesting and storing

4. Data Preparation

Transformation of data into formats tailored to analytics use cases.

• Parquet
• Delta