Principal Data Engineer

About the role

<p style="text-align: left;"><strong>Working at CreateFuture</strong><br><br><a href="https://createfuture.com/" target="_blank">CreateFuture</a> is an&nbsp;<strong>AI-native consulting partner&nbsp;</strong>where people do work that matters and are supported to do it well. We work alongside organisations such as PayPal, adidas, NatWest, FanDuel and Money Saving Expert, building digital products and services that make a difference&nbsp; while always putting people first.</p> <p style="text-align: left;">We’re a team of creators. We write code, shape delivery, build go-to-market strategies, develop AI solutions and create the practices that support our people. We work side by side with our clients, challenging what’s not working and helping them to build the future. Our commitment to craft, quality, and culture has helped us scale to over 600 people in just a few years.<br><br>CreateFuture is a <a href="https://www.greatplacetowork.co.uk/certified-company/1572759" target="_blank">Great Place to Work-Certified™ company </a>and has won Best Workplaces UK multiple years in a row.<br><strong><br>Join us on our journey. Let’s create tomorrow, together, today.</strong></p> <p style="text-align: left;"><strong>About the role and team:</strong></p> <p style="text-align: left;">We're looking for a Principal Data Engineer to join our Data Practice and lead the technical direction of our engineering capability. You'll work across a portfolio of clients spanning multiple industries, helping some of the most ambitious organisations in the UK solve their hardest data problems.A Principal at CreateFuture operates above the delivery line as well as within it. You'll define how we solve the hardest data engineering problems across our client base, influence the shape of engagements from pre-sales through to delivery, grow the data talent around you, and be a recognisable voice for CreateFuture in the data engineering community.</p> <p style="text-align: left;"><strong>What you'll be doing:</strong></p> <p style="text-align: left;"><strong>Technical leadership</strong></p> <ul style="text-align: left;"> <li>Defining and owning the data engineering architecture patterns CreateFuture uses across client engagements — migration frameworks, streaming architectures, data integrity standards, and Lakehouse design</li> <li>Acting as the most senior technical authority on client engagements — making critical architecture decisions, resolving design disputes, and setting the bar for quality</li> <li>Reviewing and signing off technical designs produced by Lead and Senior engineers across active engagements</li> <li>Identifying and driving the adoption of new tooling, patterns, and cloud services that improve delivery outcomes across the data practice</li> </ul> <p style="text-align: left;"><strong>Delivery</strong></p> <ul style="text-align: left;"> <li>Leading the technical design and execution of large-scale data migrations — moving high-volume transactional and event data from on-premises or legacy cloud estates to modern cloud platforms, without loss of fidelity or operational continuity</li> <li>Architecting real-time and near-real-time data pipelines for clients with demanding latency and correctness requirements</li> <li>Designing and enforcing data integrity frameworks across critical data domains — including reconciliation between source and target systems, anomaly detection, and audit trail requirements</li> <li>Overseeing the implementation of regulatory and compliance reporting pipelines where relevant to a client's sector</li> <li>Working with cloud data services (e.g. S3, Glue, Lambda, Athena, Redshift, RDS, Kinesis, MSK, Lake Formation, Step Functions, MWAA, or their equivalents on other platforms) — selecting the right tool for each problem rather than defaulting to a stack</li> </ul> <p style="text-align: left;"><strong>Practice and people</strong></p> <ul style="text-align: left;"> <li>Mentoring and growing Lead and Senior Data Engineers

Skills