Etl Engineer

We're not your conventional data engineering team by any stretch of the imagination. Firstly, we dabble a lot in the development space to build bespoke data pipelines, it's fast-paced and very commercial given the sensitivity of handling customer data. We regularly build for new source practice management software (PMS) and DB architectures - working across ~70+ custom scripts and operating on ~40+ different DB. architectures. Data engineering is part of** ETL**, so what does that process look like? **Extract** - we have an app built in C# used to extract from a large number of scripts (> 45) the tools are designed to convert the source system into MySQL in raw format (i.e. what the data looked like in their MSSQL system) **Transform** - PHP Data Conversion Script - a core framework built to ‘standardise' the conversion process, and components added custom to the script we're converting from **Load **- data piped up to production databases via an automated Linux script **So what else?** Integration is also part of our daily work. We build a lot of data pipelines across many services. For example: We help Sales build and maintain event-driven data pipelines to reduce their workload (PipeDrive / FreshDesk / Grafana projects). We design new data tools to help drive business success (Data Warehouse / Global Query / Data UI / Data Mapper projects). We use 3rd party services to enrich the information we gather (Google API services with PipeDrive, Jira with FreshDesk). We also do a lot of R/D by allowing our data engineers to each lead their projects with a lot of freedom (ezyVet Live / AI Machine learning like Deep Racer where we placed 3rd in 2021 - Shameless plug;) Essentially we're we strive to automate our data conversion process daily **What your day might look like**: - Get ready with a fresh toast from our kitchen and stock up on a steaming cup of coffee - every day is busy and we want you to be pumped - You may start the day by conducting some pre-go-live system audits or carrying out data checks to assess the quality of conversion data - You'll need to assess, clean, and prepare bulk customer data for loading into ezyVet - this can be pretty manual so be prepared to break up the tasks with some team banter - You might throw in some documentation of data maps and develop and execute the customer sign-off process for data uploads - You'll need to work across teams - today you may support key account data management strategies during implementation - Time for a coffee top-up - Next, you may look at where it could be possible to design, build and manage data automation processes, including testing - This is a massive focus for us to shift the dial. We want you to get creative - Finishing off the day with something a bit lighter - business process documentation - how-to guides for individual legacy systems like AVImark and Cornerstone. - We put the work in where it needs - and work as a team to get it done We do work to some pretty tight deadlines, and there can be hiccups along the way, but we see through the challenges as a team and they're always great to learn from. **What you'll bring**: - A hunger and excitement to learn and adapt - A great attitude - our team is filled with a bunch of inspirational and driven individuals - Natural ability to build rapport with clients stakeholders - Knowledge of data modelling with large and varied data sets - Data visualization and communication of complex data models - Data testing and automated testing tools would be an advantage - An ability to read data models and comprehend database structures and relationships. - A passion for mentoring and helping our juniors **Experience with some or all of these will get you noticed**: - OOP, C#, PHP, MySQL, Python, Laravel, AWS, Jira, Grafana, Confluence, Slack - Automating repetitive processes and even dabbled in machine learning **What you get**: - Structured onboarding, induction, and ongoing training + plenty of challenges that build careers - Meaningful work with real global purpose. The type of challenge that build careers - Structured onboarding, induction, ongoing training and transparent performance driven professional development - Rewarding salary packages including lucrative retention and incentive schemes for all - Continuous L&D (both internal and externally) - Great tech kit for both work and personal use - Sweet office space to collaborate - including a gym and roof top bar - Coffee + snacks + catered lunches at least three days a week - Awesome colleagues who will quickly become your second family - Animal friendly office - woof woof **What's next?** If you enjoy learning in a fast-paced dynamic environment and are eager to show what you know, this is the opportunity. We're looking for drive, passion, and a willingness to learn - if we're preaching what you're practicing, we'd love to hear from you. Go on what's the worst that could happen? You get to work with an amazing group of