Description
Job Description
Seeking a Lead Data Engineer / Mission Data Pipeline to serve as a Subject Matter Expert (SME). You will work directly with government, technical, and industry stakeholders design, implement, and sustain data pipelines that ingest, transform, store, and distribute mission-relevant data across the DIFC2 software ecosystem and external mission partner systems/ You will support the development and delivery of software capabilities that improve data accessibility, mission integration, operational visibility, and cross-system interoperability across a highly dynamic mission environment.
The focuses on enabling reliable, automated, and secure data flows that support mission capabilities on operational timelines. This position requires collaboration with mission system stakeholders, platform engineers, and security teams to define data exchange artifacts, develop pipeline implementations, and ensure interfaces comply with Risk Management Framework (RMF) requirements. The engineer will leverage both low-code/no-code ETL technologies and custom software development to implement scalable data pipelines that support the data architecture.
Typical job responsibilities Include:
- Mission-Relevant Data Artifact Identification:
- Analyze mission workflows and system architecture to identify the data artifacts required to support operational capabilities.
- Define the structure, semantics, and lifecycle of mission data products within the data architecture.
- Ensure data artifacts align with architectural standards for interoperability, traceability, and reuse across mission components.
- Coordinate with External Stakeholders:
- Serve as the primary technical liaison for defining data exchange interfaces between mission systems.
- Collaborate with mission partners to define message schemas, data formats, transport mechanisms, and interface expectations.
- Document data interface specifications to support both system integration and operational sustainment.
- RMF & Security Documentation Support:
- Support the RMF process by defining technical details for machine-to-machine data interfaces.
- Produce or contribute to required RMF artifacts including:
- Data message descriptions
- Ports, Protocols, and Services Management (PPSM) entries
- System topology diagrams and interface documentation
- Coordinate with cybersecurity engineers to ensure pipeline implementations meet DoW security and compliance requirements.
- Data Pipeline Development & Sustainment:
- Design and implement automated data pipelines that ingest, transform, persist, and expose data artifacts for use by internal and external stakeholders.
- Utilize government-provided data platform infrastructure to build scalable ETL workflows.
- Develop custom transformation logic when required using appropriate programming languages and data processing frameworks.
- Expose processed data products through standardized service interfaces such as REST APIs or platform-native services.
- Data Pipeline Development & Sustainment:
- Implement data validation, normalization, and transformation logic to ensure accuracy and usability of integrated datasets.
- Troubleshoot data pipeline failures and implement monitoring, logging, and recovery mechanisms.
- Optimize pipeline performance to support mission timelines and large-scale data processing requirements.
- Deliverables & Key Projects
- Design and implementation of production data pipelines enabling automated ingestion and dissemination of mission data across systems.
- Technical documentation describing data artifacts, including purpose and operational relevance, source systems and ingestion methods, transformation logic, and destination systems and access interfaces
- Interface documentation supporting integration with external mission partners.
- RMF technical artifacts supporting security authorization of data interfaces.
- Continuous improvement and sustainment of the data pipeline ecosystem to support evolving mission needs.
Qualifications
- 9 years of experience and a Bachelor’s degree in Computer Science, Software Engineering, Management Information Systems/Information Systems, or a related discipline; or a Master's degree and 7 years of experience; or a PhD/JD and 4 years of experience.
- 7+ years of experience supporting software engineering, systems integration, platform implementation, or application development efforts within DoD, IC, SAP/SCI, or other complex mission environments.
- Experience designing or implementing data pipelines, ETL workflows, or data integration architectures.
- Experience working with structured and semi-structured data formats (JSON, CSV, XML, etc.).
- Requires an active Top Secret clearance with the ability to obtain and maintain Sensitive Compartmented Information and Special Program access, as well as a willingness to consent to a polygraph examination.
You will wow us even more if you have experience will the following:
- Proficiency with low-code/no-code data orchestration technologies such as Apache NiFi, Apache Airflow, or similar ETL orchestration tools.
- Experience implementing data transformation logic using Python and data processing libraries such as Pandas and NumPy.
- Certification or demonstrated experience as a Palantir Foundry Data Engineer, including use of Code Repositories, Pipeline Builder, AIP Logic, and other platform-relevant technologies
- Experience designing pipelines that process and fuse large-scale datasets from multiple sources.
- Familiarity with DoW data architectures, mission system integration, or data interoperability frameworks.
- Ability to communicate effectively with engineers, architects, operators, and senior Government leadership while translating technical concepts into mission-relevant value.
- Proven ability to work in highly regulated, fast-moving environments where technical excellence, mission responsiveness, and stakeholder coordination are all critical to success.
Salary range for the position is $180,000 - $220,000 per year. Specific compensation will be determined by several factors including experience, education, skills, and knowledge. We also offer medical/dental/vision benefits and 401k contribution.
Blue Sky Innovators, Inc. is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law. If you are a qualified job seeker with a disability or a disabled veteran, you have the right to request an accommodation if you are unable or limited in your ability to use or access http://www.blueskyinnovators.com as a result of your disability. To request an accommodation, please email us at careers@blueskyinnovators.com and provide your name and contact information. Please note: this is only for job seekers with disabilities requesting an accommodation.
Similar jobs
Est. 200,000 USD
Senior Defense Technologist SME V, Systems Engineering and Technical Assistance (SETA) supporting Architecture Development and Deployment, Active Top Secret Clearance Description: As part of an engineering and developmen…
Est. 200,000 USD
Mission Summary This Data Architect role provides principal-level advisory and thought leadership to senior DARPA executives, including the Chief Information Security Officer (CISO) and senior ITD Staff. As a Data Archit…
Est. 200,000 USD
In this role, you will: Design, test, and maintain our cloud application/runtime infrastructure (AWS/GCP/Azure) and CI/CD pipelines. Contribute to internal operations projects, such as the introduction of new technology…
Est. 200,000 USD
Seeking a Systems Engineer with experience to perform on programs within the Department of Defense (DoD) , Intelligence Community (IC) and/or Department of State (DoS). Responsibilities • Participate in programmatic and…
Est. 200,000 USD
General Responsibilities: Maintain the overall data architecture and data flow design for the deployed systems Collaborate with and support external data users, acting as a direct liaison to external data users for the c…
Est. 200,000 USD
Experience: Seven (7) years of IT professional experience overseeing the creation of hybrid software, web and hardware products from initial specifications to final rollout and maintenance. Experience integrating various…
Est. 105,000 USD
Join Our Team in Development, Security, and Operations (DevSecOps)! Are you ready to take your career to the next level? We are seeking talented and passionate individuals to provide on-site support specializing in DevSe…
Est. 200,000 USD
Education: Bachelor’s degree in Computer, Electrical or Electronics Engineering or Mathematics with field of concentration in computer science. Experience: Seven (7) years with Masters or 11 years with Bachelor’s degree…
Est. 165,000 USD
At Two Six Technologies, we build, deploy, and implement innovative products that solve the world’s most complex challenges today. Through unrivaled collaboration and unwavering trust, we push the boundaries of what’s po…
Est. 200,000 USD
Security Requirements: TS/SCI (SAP eligible) Skills/Experience: Core Experience & Project Management: Fifteen (15) years of technical expertise related to cyber engineering and cyberspace test and evaluation with 10…
Est. 200,000 USD
Support DoD research programs in terms of technology management, engagement with research performers, deliverable review, and leading regular calls or meetings with research performers on a technical basis. Required Back…
Est. 200,000 USD
Seeking to fill multiple positions with highly motivated and experienced Technical Subject Matter Experts (SETA) to join our team. Successful candidates will lead activities in project management, technical and programma…
Est. 200,000 USD
Seeking experienced Technical SETA candidates to provide on-site support in the area of next-generation classified network development for enterprise-scale computing and operational functions. Successful candidates will…
Est. 155,000 USD
The Horizon 2 Program provides direct support to the United States Space Forces (USSF) Space Systems Command (SSC) mission in pioneering, developing and delivering sustainable joint space warfighting capabilities to defe…
Est. 125,000 USD
At Two Six Technologies, we build, deploy, and implement innovative products that solve the world’s most complex challenges today. Through unrivaled collaboration and unwavering trust, we push the boundaries of what’s po…
Est. 124,000 USD
This job requires active TS/SCI clearance with a CI Polygraph. Please apply only if you have an active TS/SCI clearance with a CI Polygraph. North Point Technology is hiring a Data Integration Lead to support our INSCOM…
Est. 200,000 USD
Education: Bachelor’s degree (Master's Preferred) in Cybersecurity, Computer, Electrical, or Electronics Engineering, or Mathematics with a concentration in computer science or equivalent; Individual shall be certified a…
Est. 150,000 USD
Seeking a cleared Microsoft Office Specialist to provide technical and analytical support to DARPA. This role will focus on developing and maintaining dashboards, managing data, and supporting software and tool developme…
Est. 200,000 USD
Location: Joint Base Anacostia-Bolling (JBAB), Washington, D.C. (On-site)Clearance: TS required (SCI eligibility required) Position Overview Blue Sky Innovators is seeking a motivated, entry-level engineer to support the…
Est. 120,000 USD
This job requires active TS/SCI clearance with a CI Polygraph. Please apply only if you have an active TS/SCI clearance with a CI Polygraph. Data Steward / Policy Manager – Senior Position / LCAT: Data Steward / Policy M…
Est. 247,500 USD
Blue Sky Innovators is seeking a Quantitative Analyst SETA to join our team in Arlington, VA. The successful candidate will support DARPA program managers in the development, integration, and scaling of complex adaptive…
Est. 109,200 USD
LOE required is 0.5 FTE. Description Candidates sought to provide technical program management support. The successful candidate will support the DARPA program manager by providing technical advice and industry knowledge…
Est. 238,500 USD
Blue Sky Innovators is seeking an Intelligence Targeter to join our team in Arlington, VA. The successful candidate will support the DARPA program manager supporting program execution, stakeholder integration, and techno…
Est. 120,000 USD
This job requires active TS/SCI clearance with a CI Polygraph. Please apply only if you have an active TS/SCI clearance with a CI Polygraph. North Point Technology is hiring a Data Integration Lead to support our INSCOM…
Est. 115,000 USD
Seeking a Systems Engineer with experience to perform on programs within the Department of Defense (DoD). Responsibilities • Participate in programmatic and technical discussions to initiate new program concepts • Demons…
Est. 109,200 USD
The level of effort is 25% with time dedicated to mission planning, test and evaluation, and technology assessments. Duties: Identify and implement mission planning for long range effects. Identify and translate requirem…
Est. 132,000 USD
Clarity Innovations is a trusted national security partner, dedicated to safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD…
Est. 200,000 USD
Security Requirements: Final TS/SCI (Special Access Program (SAP) eligible) Skill/Experience: Ten (10) years’ experience managing, planning, developing, and executing major research, engineering, and development efforts…
Est. 132,000 USD
Clarity Innovations is a trusted national security partner, dedicated to safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD…
Est. 157,500 USD
At Two Six Technologies, we build, deploy, and implement innovative products that solve the world’s most complex challenges today. Through unrivaled collaboration and unwavering trust, we push the boundaries of what’s po…