PC-1513-Data Engineer (ADF / Dataflow Specialist)

Role Basics

Key Responsibilities

Pipeline & Product Engineering

• Design & Build Pipelines: Develop, orchestrate, and maintain scalable data ingestion and transformation pipelines using Azure Data Factory (ADF) and Dataflows.
• Accelerate Migrations: Build automated data solutions and core data assets focusing on the Data Migration Accelerator for Dynamics 365, Dataverse, and Microsoft Fabric.
• Embed Agentic Logic: Develop and integrate intelligent, automated agents (including validation, reconciliation, and data-stewardship agents) within pipelines to shift client value from one-time migration builds to ongoing, subscription-based service models.
• Analytics Delivery: Create and pre-package robust Analytics & Insights Accelerators utilizing Microsoft Fabric and Power BI to maximize day-one reporting capabilities for end-users.

Governance, Delivery Standards & Quality

• Data Governance: Implement and enforce native data governance, security baselines, and tracking frameworks seamlessly across environments using Microsoft Purview.
• Agile Delivery: Deliver and deploy all assigned data products utilizing the internal Agentic Development Lifecycle (AiDLC), adhering strictly to a 90-day development-to-production cycle (the "3-month rule").
• Quality Assurance: Ensure all data pipelines and products strictly align with ISO/IEC 25010 software quality standards and pass uncompromising security clearance checks before entering active client environments.

Required Technical Skills

Qualifications & Certifications

• Education: Bachelor's degree in Computer Science, Information Technology, Software Engineering, or a related technical discipline.
• Experience: 4–6 years of professional data engineering experience, with a heavy emphasis on building cloud data pipelines (ADF/Dataflows), reusable accelerators, or SaaS-based data integrations.
• Mandatory Certification Timeline: Must currently hold, or explicitly commit to achieving, the DP-203 (Azure Data Engineer Associate) or DP-600 (Fabric Analytics Engineer Associate) along with PL-300 (Power BI Data Analyst) certifications by December 2026 to support Softobiz's Solutions Partner for Data & AI designation roadmap.

Soft Skills & Cultural Fit

• Accountability & Drive: High ownership mindset with a proven ability to independently drive complex engineering milestones to completion under 90-day cycles.
• Cross-Border Communication: Strong written and verbal communication skills, with the capability to clearly articulate technical logic, documentation, and product requirements.
• Product-Centric Thinking: Ability to design data flows with modularity and reusability in mind, looking past single-project silos to build scalable platforms.

What We Offer

• Leading-Edge Innovation: Deep, direct engagement with emerging technologies like Agentic AI orchestration, Micro-Agent Architectures, and advanced Microsoft Fabric implementations.
• Global Exposure: Opportunity to contribute directly to data systems deployed for premier enterprise clients across Australia, the US, and India.
• Upskilling & Certification Support: Structured organizational tracking and learning assistance to clear premier Microsoft and Azure technical certifications.