Description
Senior Data Engineer
Powering the future requires serious data infrastructure. We’re looking for a Senior Data Engineer to design, scale, and champion modern data solutions for us.
About Sand
Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across healthcare, water, energy, telecommunications and infrastructure.
Our work delivers proven real-world impact. We have built AI systems that help manage London’s water supply, supported telecom network planning across hundreds of cities, and developed digital healthcare platforms serving tens of millions of people across Africa. From intelligent command centers to AI-powered infrastructure platforms, we help organizations sense, analyze and act in complex environments.
Our people are ambitious, curious and relentlessly practical. Our teams work alongside clients in the field, solving hard problems and deploying solutions that last. With colleagues across Africa, Europe, the UK and the US, we operate across the full stack - from research and engineering to deployment and capability building.
Our mission is simple: to harness AI to solve humanity’s most pressing challenges.
About the role
As a Senior Data Engineer, your primary mission is to design, build, and maintain scalable data pipelines and robust infrastructure to support data-intensive applications and advanced analytics solutions. Working with our UK-based Utilities client, you will handle critical infrastructure data, meaning reliability, scalability, and security are paramount.
In this role, you won't just write code, you will architect modern data solutions, oversee key engineering projects, and mentor growing engineering talent. You will collaborate closely with cross-functional teams to shape the strategic direction of our data initiatives.
What you’ll do
- Data Pipeline & ETL Development: Lead the design, implementation, and automation of scalable ETL/ELT workflows. Ingest, process, and transform large volumes of structured and unstructured data from diverse sources (including IoT and asset telemetry) into data lakes or lakehouses.
- Modern Data Architecture & Modeling: Architect efficient, modern data solutions (e.g., Lakehouse architectures). Design and optimize data models and schemas for high-performance storage, retrieval, and analysis.
- Big Data & Cloud Engineering: Leverage big data technologies (Spark, Kafka, Flink) and cloud-native services (AWS, Azure, or GCP) for distributed data processing and real-time streaming applications.
- Operations, DevOps & CI/CD: Build and maintain CI/CD pipelines, manage version control, and deploy containerized solutions. Monitor infrastructure performance, identify bottlenecks, and optimize for cost-efficiency and reliability.
- Data Quality & Governance: Implement and oversee robust data governance, quality frameworks, and security measures ensuring compliance with industry standards.
- Collaboration & Documentation: Partner with data scientists, analysts, and business stakeholders to translate requirements into technical reality. Create clear technical documentation, including data architecture diagrams and workflow maps.
- Leadership & Innovation: Evaluate and recommend emerging technologies and frameworks. Mentor and guide junior and mid-level data engineers, promoting engineering best practices.
Who you are
- Proven experience as a Senior Data Engineer, or in a similar role, with hands-on experience building and optimizing data pipelines and infrastructure, and designing data architectures.
- Proven experience working with Big Data and tools used to process Big Data
- Strong problem-solving and analytical skills with the ability to diagnose and resolve complex data-related issues.
- Excellent understanding of data engineering principles and practices.
- Excellent communication and collaboration skills to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
- Ability to adapt to new technologies, tools, and methodologies in a dynamic and fast-paced environment.
- Ability to write clean, scalable, robust code using python or similar programming languages. Background in software engineering is a plus.
- Knowledge of data governance frameworks and practices.
- Understanding of machine learning workflows and how to support them with robust data pipelines.
Desirable languages/tools
- Core Languages: Python, SQL, Scala, or Java (for data manipulation and scripting).
- Data Processing & Streaming: Apache Spark, Databricks, Kafka, Flink, or Spark Streaming.
- Cloud Platforms: Hands-on experience with at least one major cloud provider (AWS, Azure, or GCP) and their native data tools (e.g., S3/Blob, EMR, Redshift, Synapse, Glue, ADF, BigQuery, Dataflow).
- Data Orchestration & Warehousing: Apache Airflow, modern Lakehouse patterns, or enterprise ETL tools (Informatica, Talend).
- DevOps Tools: Git, CI/CD pipelines, and containerization tools (Docker/Kubernetes).
- Methodologies: Advanced relational and dimensional data modeling techniques.
How we work
Due to the highly collaborative and internationally distributed nature of our work, successful candidates must be comfortable operating in small teams while contributing to larger, globally coordinated efforts. A strong sense of ownership, self-motivation and discipline in maintaining clear and consistent communication through virtual collaboration tools and video conferencing is essential.
Similar jobs
Est. 90,000 GBP
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
Est. 124,000 USD
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
Est. 124,000 USD
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
Est. 90,000 GBP
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
Est. 80,000 USD
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
Est. 118,000 USD
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
Est. 90,000 GBP
Senior Data Engineer Who we are Artefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the ent…
Est. 140,000 USD
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
Est. 65,000 GBP
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
Senior Product Designer Are you an experienced, well-rounded product designer looking to do foundational work on AI products that are reshaping how critical industries operate globally? If so, we should probably talk! Ab…
Principal Software Engineer Looking for engineering problems that actually matter? Join Sand's Decision Intelligence Platform team and help build the semantic engines, data platforms, and AI-powered systems that enable g…
Platform Engineer Are you the kind of engineer who sees a cluster not as plumbing but as the foundation on which real lives depend? At Sand, you'll own the Kubernetes platform that ministries of health use to make decisi…
Platform Engineer Are you the kind of engineer who sees a cluster not as plumbing but as the foundation on which real lives depend? At Sand, you'll own the Kubernetes platform that ministries of health use to make decisi…
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
Est. 120,000 EUR
Senior Technical Product Manager You used to write the code; now you define the vision. We’re looking for a Senior Technical Product Manager who still loves getting their hands dirty. About Sand Sand Technologies is a gl…
Est. 84,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
Est. 25,000 USD
The Job in short The Data Enablement team is here to enable every team in the organisation with their data needs. Our job starts the moment that data enters our platform and ends when it reaches whoever needs it. We are…
Est. 120,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
Est. 840,000 SEK
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
About Sand Sand Technologies is a global Physical AI company using data and AI to make critical industries work better. We partner with governments, cities and enterprises to improve how essential systems operate across…
Project Description We are looking for a motivated Data Engineer to join our growing data team. This is a great opportunity for someone early in their career to gain hands-on experience with modern data technologies. You…
Est. 84,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
Who We Are Konrad is a next generation digital consultancy. We are dedicated to solving complex business problems for our global clients with creative and forward-thinking solutions. Our employees enjoy a culture built o…
Senior Data (Platform) Engineer Location: Hyderabad | Department: Technology, Data About the Role Are you passionate about building reliable, scalable data platforms that make analytics and AI development easier? As a Se…