inhousefyi
← Back to listings

Senior Data Engineer

Loka, IncRemote · Posted Sep 4, 2023
Full-timeRemoteEst. 120,000 USD
Apply now

Description

Years from now, history will look back at this moment as a landmark for the human race—the moment when generative artificial intelligence began to change everything. Luckily, you happen to be living through it. Now what?

If you’re one of those rare people driven to add their intellectual energy to the relentless momentum of technological advancement, consider Loka your optimal leverage point.

Loka is a globally distributed tech consultancy based in Silicon Valley, and we’re seeking a Senior Data Engineer to join our growing team. In this role you will design, implement and scale data solutions from batch to streaming, dealing with the low-latency requirements of a few megabytes up to several petabytes. You will be an evangelist of good practices and dwell at the cutting edge of new technologies and architectural patterns. Ultimately we expect that you will not just fit in with our Data crew but elevate it to new heights.

We help our clients launch innovations that fix the climate, defeat cancer, improve agricultural efficiencies, teach kids to read and more. We work with all kinds of companies, from Silicon Valley startups to major household brands, always guided by our fundamental belief that mission matters. We count more than 200 certified specialists, technical experts and PhDs among our colleagues—committed Lokals who contribute to their brilliance not only to serving our clients but to mentoring junior colleagues as well. We work entirely remotely, test new ideas with our in-house incubator and take every other Friday off (really).

To cap it off, at the end of 2024 Loka was recognized by AWS as Innovation Partner of the Year, beating more than 150,000 partners for the title.

We’re as proud of our culture as we are of our projects. You will be too. Join our team, feed your need to grow and ship projects you believe in with a team you’re proud to be a part of.

The Role

  • Build scalable production-grade data pipelines and real-time data streams.
  • Write and design scalable, cloud-ready applications.
  • Lead technical projects through architecture, design and implementation phases.
  • Collaborate with Machine Learning, Data Science, Design, Software Engineering and Business teams to triage data or ETL issues.
  • Build tests and health checks to maintain code and data quality.
  • Monitor and analyze data flowing through various systems by adding appropriate visualizations and dashboards.
  • Provide updates and offer guidance to clients.

Technical Requirements

  • Advanced Python and SQL
  • Experience in ETL design, implementation, and maintenance.
  • Experience in AWS (preferred), GCP, or Azure delivering data-centric product experiences
  • 5+ years experience in related role
  • Experience with in-memory and disk-based databases, relational and non-relational databases, full-text search engines, database design, development, and maintenance. (Such as MySQL, MongoDB, OpenSearch, and DynamoDB, with bonus for Graph Databases like Neo4j)
  • Experience with data warehousing and multidimensional data models (columnar data modeling)
  • Working knowledge in Data Lake, Data warehouse and massive parallel processing
  • Strong problem-solving ability and ability to work through ambiguity and incomplete specifications

Preferred but Not Required

  • Working knowledge in IAM, Federated Authentication, SSO, SAML, Encryption, Security, APIs, Disaster Recovery or Backup
  • Strong ability in distributed systems for large-scale data processing
  • Experience with Spark and Pandas
  • Experience with Open Tables (Hudi, Delta Lake, DataBricks, Iceberg as related to Data Lakehouse)
  • Experience with Infrastructure as Code and CI/CD Pipelines
  • Experience with QuickSight and DataViz

Additional Requirements

  • Excellent English - Being a global team, we work entirely in English for meetings, customer calls and business communications
  • CV written in English

Personality Profile

  • Curious: You strive to learn and grow into different industries with a modern tech stack.
  • Autonomous: You thrive in a fully remote, globally distributed team.
  • Collaborative: You enjoy working across departments.
  • Adaptable: You operate with a startup mindset and move at startup speed.

Benefits

  • Every other Friday off (26 extra days off a year)
  • Remote-first culture
  • Explore and Relocation programs (three months work abroad or full international relo)
  • Paid sick days and local holidays
  • Business English classes program
  • Continuous Learning Support
  • Fitness and/or Mental Health Subscriptions
  • Access to LokaLabs™, our internal research and development program
  • Defined career path

Your achievements matter to us! Ensure your CV and LinkedIn and GitHub profiles are up to date and accurately reflect your experience.

Similar jobs

Loka, IncRemote

At Loka we use a modern tech stack to support meaningful projects across a huge range of industries. In the last year our teams have helped clients advance the world’s #1 GenAI reading tutor, eliminate $1B in food waste…

Full-timeRemote
Loka, IncRemote

Est. 105,000 USD

Years from now, people will look back at this moment as the dawn of a new era, when generative AI began reshaping everything. At Loka, we’re not just watching this change—we’re building it. Loka is a remote-first, global…

Full-timeRemote
DevOps LeadSep 4, 2023
Loka, IncRemote

Est. 60,000 EUR

At Loka we use a modern tech stack to support meaningful projects across a huge range of industries. In the last year our teams have helped clients advance the world's #1 AI reading tutor, eliminate $1B in food waste and…

Full-timeRemote
Loka, IncRemote

Est. 120,000 USD

Years from now, history will look back at this moment as a landmark for the human race, the moment generative AI began to change everything. At Loka, we're not just watching it happen, we're building it. Our teams have h…

Full-timeRemote
Loka, IncRemote

Est. 120,000 USD

Years from now, history will look back at this moment as a landmark for the human race, the moment generative AI began to change everything. At Loka, our ML crew is in the thick of it, shipping GenAI into production acro…

Full-timeRemote
Loka, IncRemote

Est. 162,500 USD

At Loka our teams launch meaningful projects across a wide range of industries. In the last year we helped advance the world’s #1 AI reading tutor, transform rundown homes into green machines and accelerate novel drug di…

Full-timeRemote
Loka, IncRemote

Est. 80,000 GBP

At Loka our teams launch meaningful projects across a wide range of industries. In the last year we helped advance the world's #1 AI reading tutor, transform rundown homes into green machines and accelerate novel drug di…

Full-timeRemote
Loka, IncRemote

Est. 55,000 EUR

In the last 18 months at Loka, our teams have helped clients advance the world’s #1 AI reading tutor, eliminate $1B in food waste and develop novel drugs for fighting cancer. To cap it off, at the end of 2024 Loka was re…

Full-timeRemote
Data EngineerAug 24, 2023

Est. 80,000 USD

Who We Are Launchpad Technologies Inc. is a global technology partner connecting top talent with high-impact projects across North America and beyond. We specialize in Staff Augmentation and product development, helping…

Full-timeRemote
TolokaRemote

Est. 185,000 USD

Company Intro At Toloka AI we create data that powers leading GenAI models and innovations. We work with frontier labs, big tech, renowned AI startups, enterprises, and non-profit research organizations worldwide. We use…

Full-timeRemote
TolokaRemote

Est. 120,000 EUR

Company Intro At Toloka AI we create data that powers leading GenAI models and innovations. We work with frontier labs, big tech, renowned AI startups, enterprises, and non-profit research organizations worldwide. We use…

Full-timeRemote
TolokaRemote

Est. 120,000 EUR

Company Intro At Toloka AI we create data that powers leading GenAI models and innovations. We work with frontier labs, big tech, renowned AI startups, enterprises and non-profit research organizations worldwide. We use…

Full-timeRemote
Scale AILondon, United Kingdom

Est. 120,000 GBP

Software is eating the world, but AI is eating software. We live in unprecedented times – AI has the potential to exponentially augment human intelligence. Every person will have a personal tutor, coach, assistant, perso…

Full-time
Head of Data & AI10 months ago
JustMarketsRemote

Est. 150,000 USD

We are looking for a highly motivated and results-driven Head of Data & AI to join our team full-time. In this strategic role, you will shape the vision, architecture, and delivery frameworks for Data Engineering, Da…

Full-timeRemote
LighthouseRemote

Est. 80,000 EUR

Our Mission: Why Lighthouse? At Lighthouse, we’re on a mission to revolutionize commercial strategy as hospitality’s most powerful AI platform. We take the world's largest hotel data network and transform it into real-ti…

Full-timeRemote
LovelyticsRemote

Est. 130,000 USD

Founded in 2017, Lovelytics has helped some of the most complex enterprises across industries such as Energy & Utilities, Media & Entertainment, Manufacturing and Retail & CPG, modernize their data and put AI…

Full-timeRemote
TolokaRemote

Est. 120,000 EUR

About Toloka At Toloka AI we create data that powers leading GenAI models and innovations. We work with frontier labs, big tech, renowned AI startups, enterprises and non-profit research organizations worldwide. We use a…

Full-timeRemote
LVTAmerican Fork, Utah, United States

Est. 144,000 USD

ABOUT LVT LVT is redefining how businesses operate in the physical world, moving beyond traditional security solutions to deliver AI-driven, actionable intelligence that makes sites smarter, safer, and more secure. Since…

Full-time

Est. 60,000 EUR

We are Kaizen Gaming Kaizen Gaming, the team powering Betano, is one of the biggest GameTech companies in the world, operating in 20 markets. We always aim to leverage cutting-edge technology, providing the best experien…

Full-timeRemote

Location: Remote - MX ABOUT THE COMPANY: Clari + Salesloft are building the next era of enterprise revenue — one where teams make confident decisions powered by AI and real signals. By combining our scale, insights, and…

Full-timeRemote
CaylentRemote

Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…

Full-timeRemote
CaylentRemote

Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…

Full-timeRemote
CaylentRemote

Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…

Full-timeRemote
CaylentRemote

Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…

Full-timeRemote

A abertura atual é para a Artefact do Brasil, estamos em modelo Free Office. #LI-Remoto Who we are At Artefact Brasil, we believe in and live a culture based on empathy! A healthy work environment is a place where all vo…

Full-timeRemote
WorkatoSan Francisco, California, United States

Est. 157,000 USD

About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…

Full-time
LighthouseRemote

Est. 80,000 EUR

Our Mission: Why Lighthouse? At Lighthouse, we’re on a mission to revolutionize commercial strategy as hospitality’s most powerful AI platform. We take the world's largest hotel data network and transform it into real-ti…

Full-timeRemote
OktaBengaluru, India

Secure Every Identity, from AI to HumanIdentity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This…

Full-time
Scale AISan Francisco, California, United States

Est. 283,500 USD

Software is eating the world, but AI is eating software. We live in unprecedented times – AI has the potential to exponentially augment human intelligence. Every person will have a personal tutor, coach, assistant, perso…

Full-time
TolokaRemote

Est. 115,000 USD

Company Intro At Toloka AI we create data that powers leading GenAI models and innovations. We work with frontier labs, big tech, renowned AI startups, enterprises and non-profit research organizations worldwide. We use…

Full-timeRemote