Data Engineering & Warehousing - Infinite Consulting
Job Description Data Engineer Contract up to 30 June 2025 Location – ACT – Flexible work arrangement can be discussed Australian Citizens with Baseline Clearance Infinite Consulting is seeking an experienced Data Engineer for our esteemed Federal Government Client. The contract duration is up to 30 June 2025 with an Oct. start. About the role: You will have strong experience in developing Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes, and /or the development of data products and complex data visualisations. You will be responsible for design, development and unit testing activities across several data movement, data transformation, and data visualisation processes. You will have experience with the following techniques and technologies: MS Azure Stack; Data Integration - Data Factory, SQL Server Integration Services and/or Databricks, LogicApp and/or FuncationApp; Data Store - SQL Server and/or Data Lake Storage, Unity Catalog (Medallion Architecture); Analytics - Azure Databricks, Azure Machine Learning, ArcGIS Enterprise; Development tools – DevOps, Visual Studio, VS Code; Data technology solutions – sourcing (Flat file, Ingres, Azure, SQL Server), collecting, ingesting and storing; SQL, Python, R, .Net; Data Preparation; Data Visualisation. Role specific requirements: Demonstrated experience developing ETL/ELT processes for complex and/or large data movement, transformation and/or visualisations, particularly in a cloud environment. Experience preparing data optimised for query performance in cloud computed engines - Distributed computing engines (Spark), Azure SQL, Python, R. Experience working with Engineering, Storage and Analytics services in cloud infrastructure. Experience working collaboratively in an agile development team. Submission Requirements: Duration: Contract up to 30 June Clearance: Australian Citizens with Baseline Clearance Submission deadline: 11/09/2024 If you are interested in finding out more about the role, apply today or contact Varsha on 02-6257 8888 for a full assignment brief.