Azure Data Engineer

COMPANY ENVIRONMENT Adaptiv is the leader in data and integration consulting and development in NZ, delivering innovative solutions to meet our clients' needs through cloud-based services. We employ the best of the best in the industry which makes it easy to support our staff in gaining the skills necessary to become data and integration experts.  No two days are the same, and while we provide complex solutions for some impressive clients, we know when to switch off and have fun. With no office politics, an excellent company culture and a modern rooftop office (BBQ anyone?), this kind of opportunity does not come around often. POSITION SUMMARY The Azure Data Engineer position is a critical role as it provides data consulting across the Company's partner businesses (clients). The position is responsible for assisting with the design, implementation, review, and updates of the Company's IT solutions for clients.  This is a varied position with exposure to data technologies both on-premises and on Azure. This position will be required to work on multiple projects at any one time and balance workload accordingly. The role is required to use tools and techniques related to cloud development in a dynamic, constantly changing environment. This position is highly responsive to the requests of clients with work priorities largely influenced by these stakeholders. POSITION RESPONSIBILITIES Data Engineering Deliver data solution architecture for clients (data lakes, cloud data warehouses, data enhancement via machine learning APIs)Be part of a team on larger scale deployment and deployments Lead in the development and implementations of the company's data engineering solutions on AzureUndertake hands-on development for client projects Provide guidance and demonstrate best practices when delivering solutions Understand and utilise modern data platforms (cloud or on-premises)Most of the work will be done using tools of the trade (Azure Data Factory) Knowledge in both SQL and Python required. Data Architecture  Provide consultancy services to our customers Develop principles and policies for development of a data lake, cloud data warehouse (CDW), machine learning Continuous Integration and Infrastructure as Code Experienced in use of industry-leading CI/CD platforms such as Git, Azure DevOpsCan design and implement full CI/CD pipelines for a data solution Integration Testing Build test driven practices utilising best of breed frameworks for unit and integration testingTest and UAT environment provisioning for clients Cloud Integration Create and design compelling architectural blueprints to deliver value to our clientsComplete independent vendor evaluationImplement data engineering and machine learning solutions on the Azure technology stackImplementation assistance on projectsImplement proof of concept prototypes Training We will provide access and support to any data engineering training needs on any platforms (GCP, Azure, AWS). You will be able to choose your own path.Getting certified is highly encouraged, and paid for Continuous Improvement Identify and propose development and architectural improvements to existing systemsIdentify and introduce industry best practice standards in all projects, work requests and responsibilitiesSeek to educate team members and stakeholders about best practice where appropriateWork with partner businesses/clients to help drive "thought leadership" on data and cloud architectureConstantly up skill on latest technologies to remain at the forefront of service deliveryAssist with driving Adaptiv's thought leadership via social media  Work Planning & Management Manage daily tasks and projects to ensure work is completed consistent with assigned priorities and deadlinesAssist in evaluating work requests on a technical, architectural and consistency level to provide feedback to stakeholders on viabilityParticipate in planning meetings as requiredInitiate and attend meetings with team and stakeholders to give timely updates on work progress and resolution of issuesReport progress to team and Project Manager as appropriate.Assist the executive team with presales and project establishment    Occupational Health & Safety Responsible for taking reasonable care to ensure own health and safety at work, and to avoid adversely affecting the safety or health of any other person at workEnsuring adherence to organisation-wide policies, procedures and monitoring the compliance of all team members Responsibilities on Demand Due to the fluid and dynamic environment within the group, new, additional, or amended position responsibilities may be required at any timeSuccessful demonstration of change orientation is an ongoing responsibility of all positions KEY RESULT AREAS Act as a subject matter expert in data engineering and Azure data technologiesWork with client teams to design and implement modern, scalable data solutions using a range of new and emerging technologies from AzureWork with Agile and DevOps techniques and implementation approaches in the deliveryShowcase your Azure Data engineering experience when communicating with clients on their requirements, turning these into technical data solutionsBuild and deliver Data solutions using Azure products and offeringsWillingness to learn and upskill yourself on other cloud platforms (GCP, AWS).  Getting certified is highly encouragedRepresent the Adaptiv brand on the turf and help us deliver projects on time and on budgetCo-own and build our Azure community, contributing in the knowledge exchange learning programme of the platform either via blog posts, LinkedIn articles, conferences and roadshows PERSON SPECIFICATION Qualifications At least 5 years of professional experience in a consulting environment on a cloud Platform with a focus on Azure.  University degree not necessarily required as we believe more in people than diplomas. Experience matters more.Ideally you should at least have one valid and active Azure certification. Skills Hands on and experience building Data Analytics solutions on Azure (e.g. ADLS Gen2, Synapse Analytics, SQL Database, CosmosDB, Azure Data Factory, Azure Functions, Azure Logic Apps, Event Hubs,  Databricks, PowerBi, Azure DevOps).Experience in Spark (Scala/Python/Java) and Kafka.Experience architecting and building Data Lakes on Azure (ADLS Gen2)Experience building data models in a CDW (Synapse) based on Start Schemas, Wide Tables (or OBT).Experience working with AI/ML as a serviceKnowledge in MDM, Metadata Management, Data Quality, Data Lineage tools and more generally in Data Governance.End to End Data Engineering and Lifecycle (including non-functional requirements and operations) management.Regulatory and Compliance work in Data Management.End to End Solution Design skills - Prototyping, Usability testing and data visualization literacy.Experience with SQL and NoSQL modern data stores.Knowledge in both SQL and PythonExperienced in use of industry-leading CI/CD platforms such as Git, Azure DevOps Personal Competencies & Attributes Excellent communication skills both verbal and writtenA strong eye for detailSelf-managing with a highly motivated and results driven approachSense of urgency, can-do and proactive attitudeAbility to juggle multiple tasks and deadlinesExcellent relationship/interpersonal skillsAbility to think outside the box and demonstrates sound problem-solving mindsetFlexible and adaptableComplete professionalismSense of humourOur offer Competitive remuneration packageWith us, the focus in HR is more on the Human than the ResourcesCasual Friday morning tea and early evening nibbles and drinks are on usYou choose your weapon: either a MacBook Pro or a Windows workstationYour mobile subscription is on usA central office in the heart of Ponsonby and Grey LynnIf you've got a dog, bring it to the officeAccess to Azure certification trainings and exams