Site Reliability Engineer - Data Engineering
IMCSydney, New South Wales, Australia · Posted 9 months agoDescription
Join our dynamic and high-impact Data Engineering team, where you'll be responsible for our large-scale data collection, storage, access and query platforms. The work includes the safe and reliable operation of the platform, as well as projects to evolve and expand the capabilities. This is a critical role in the organisation as the data platform drives a huge range of trader analysis, simulation, reporting and insights.
You will join a growing team of four in Sydney which is part of the larger APAC Data Team, and will collaborate with counterparts in Chicago, Mumbai and Amsterdam.
Your Core Responsibilities:
- Manage and monitor distributed systems, storage infrastructure, and data processing platforms, including Kafka, HDFS, Dremio, and in-house data pipelines.
- Drive heavy focus on systems automation and CI/CD to enable rapid deployment of hardware and software solutions.
- Collaborate closely with systems and network engineers, traders, and developers to support and troubleshoot their queries.
- Stay up to date with the latest technology trends in the industry; propose, evaluate, and implement innovative solutions.
Your Skills and Experience:
- 2+ years of experience in managing large-scale multi-petabyte data infrastructure in a similar role.
- Knowledge of Linux system administration and internals, with proven ability to troubleshoot issues in Linux environments.
- Experience in at least one of the following technologies: Kafka, HDFS, Kubernetes.
- Working knowledge of Docker, Kubernetes, and Helm.
- Experience with data access technologies such as Dremio and Presto.
- Familiarity with workflow orchestration tools like Airflow and Prefect.
- Exposure to cloud platforms such as AWS, GCP, or Azure.
About Us
IMC is a global trading firm powered by a cutting-edge research environment and a world-class technology backbone. Since 1989, we’ve been a stabilizing force in financial markets, providing essential liquidity upon which market participants depend. Across our offices in the US, Europe, Asia Pacific, and India, our talented quant researchers, engineers, traders, and business operations professionals are united by our uniquely collaborative, high-performance culture, and our commitment to giving back. From entering dynamic new markets to embracing disruptive technologies, and from developing an innovative research environment to diversifying our trading strategies, we dare to continuously innovate and collaborate to succeed.
Similar jobs
At IMC, technology is not a department; it’s at the heart of everything we do. Developed in-house, our innovative software makes millions of trading decisions daily, and we win by making better and faster decisions than…
At IMC, technology is the driving force behind everything we do. Our in-house developed software executes millions of trading decisions each day, enabling us to outperform the competition by making smarter and faster cho…
The Development Platform organization at IMC Trading is focused on accelerating tech team workflows by providing self-service tools, services, documentation, and support. We design, build, and maintain the platforms that…
At IMC, technology is not a department; it’s at the heart of everything we do. Developed in house, our innovative software makes millions of trading decisions daily, and we win by making better and faster decisions than…
Platform Engineering at IMC builds and runs the core platforms that power our business. This Site Reliability Engineer role within Platform Engineering is focused on security projects: embedding security into system desi…
Est. 200,000 USD
We are seeking a dedicated and experienced Data Engineer to join our Chicago team. The ideal candidate is energized by working in a cutting-edge environment that enables IMC to continue to be at the forefront of the evol…
The Research Engineering team develops and deploys the pipelines connecting a research idea all the way to its rollout in production. We exist to ensure that the entire pipeline describing our research is efficient, effe…
At IMC, technology is not a department; it’s at the heart of everything we do. Developed in-house, our innovative software makes millions of trading decisions daily, and we win by making better and faster decisions than…
Est. 200,000 USD
We are hiring an Engineer to join our Data Engineering Infrastructure team, where you will help build and scale the storage and data platforms that power our HFT business. This is a hands-on role for someone who enjoys w…
At IMC, technology is not a department; it’s at the heart of everything we do. Developed in house, our innovative software makes millions of trading decisions daily, and we win by making better and faster decisions than…
At IMC, data is pivotal in shaping trading decisions across a wide range of financial products. Better data means better decision making for both the research and trading teams. We’re on a mission to ensure that we have…
As a Performance Engineer at IMC, you will play a pivotal role in analysing, optimising, and tuning our systems' interaction with exchange systems holistically. Working closely with traders and engineers, you'll be taske…
Est. 200,000 USD
We’re looking for a hands-on, entrepreneurial Trading Engineer to join our Strategy Development team. This role sits at the heart of IMC’s trading operation, where technology, data, and market strategy meet. You’ll own s…
The Machine Learning Frameworks team exists for two reasons: making the research iteration loop as fast and frictionless as possible, and making production run as fast as the hardware allows. Both matter, and figuring ou…
Est. 157,500 USD
We are seeking a dedicated and experienced Data Center Engineer to join our team in Secaucus, NJ. This role requires hands-on work with our physical servers, network infrastructure, and IT components across various coloc…
The Research Engineering team develops and deploys the pipelines connecting a research idea all the way to its rollout in production. We exist to ensure that the entire pipeline describing our research is efficient, effe…
Est. 60,000 GBP
At IMC, technology is not a department; it’s at the heart of everything we do. Developed in-house, our innovative software makes millions of trading decisions daily, and we win by making better and faster decisions than…
Est. 95,000 EUR
At IMC, technology is not a department; it's at the heart of everything we do. Developed in-house, our innovative software makes millions of trading decisions daily, and we win by making better and faster decisions than…
Est. 200,000 USD
We are looking for a multi-talented and passionate Trading Systems Engineer to join our execution development team. In this role, you will take ownership of systems that sit directly in the critical path of live trading,…
Job description This role does require travel to colocation facilities in the area. We are seeking a dedicated and experienced Data Center Engineer to join our Mumbai team. This role requires hands-on work with our physi…
Est. 187,500 USD
We’re seeking a Linux Engineer with deep systems expertise and Python/scripting experience to join our growing global team. You will be responsible for engineering and operating Linux at scale across our mission critical…
Est. 80,000 GBP
At IMC, technology is at the core of everything we do. Our innovative in-house software drives millions of trading decisions daily, allowing us to outperform the competition through faster, more effective decision-making…
Est. 80,000 EUR
At IMC, technology is not a department; it's at the heart of everything we do. Developed in-house, our innovative software makes millions of trading decisions daily, and we win by making better and faster decisions than…
Est. 90,000 EUR
At IMC, technology is not a department; it’s at the heart of everything we do. Developed in-house, our innovative software makes millions of trading decisions daily, and we win by making better and faster decisions than…
Est. 200,000 USD
We are seeking a Software Engineer to help build the technology and analytical frameworks used to understand, measure, and optimize risk across the firm's trading businesses. Working directly with Risk Managers and softw…
Est. 200,000 USD
IMC is seeking a highly skilled C++ Software Engineer to join our Chicago team. As a Software Engineer, you will design and develop software solutions tailored to the hardware-specific needs of our global trading system…
Operations Engineer at IMC: You will collaborate with IMC employees throughout the organisation to diagnose, troubleshoot, and correct issues that interfere with access to critical enterprise systems. Daily responsibilit…
IMC has a strong presence in traditional Finance and has been expanding into Crypto over the last years. Through its overseas affiliates, IMC provides liquidity and trades on many cryptocurrency exchanges and DeFi protoc…
IMC has a strong presence in traditional finance and has been expanding its cryptocurrency trading activities over recent years. Through its global affiliates, IMC provides liquidity and trades across a broad range of cr…
Est. 205,000 USD
We are looking for a data-focused engineer with a strong operational focus to support the Performance Team’s data platform at IMC. This role is responsible for the reliability, correctness, and performance of data system…