Description
CTEC is a leading technology firm that provides modernization, digital transformation, and application development services to the U.S. Federal Government. Headquartered in McLean, VA, CTEC has over 300 team members working on mission-critical systems and projects for agencies such as the Department of Homeland Security, Internal Revenue Service, and the Office of Personnel Management. The work we do effects millions of U.S. citizens daily as they interact with the systems we build. Our best-in-class commercial solutions, modified for our customers’ bespoke mission requirements, are enabling this future every day.
The Company has experienced rapid growth over the past 3 years and recently received a strategic investment from Main Street Capital Corporation (NYSE: MAIN). In addition to our recent growth in Federal Civilian agencies, we are seeking to expand our capabilities in cloud development and footprint in national-security focused agencies within the Department of Defense and U.S. Intelligence Community.
We are seeking to hire a Data Engineer to our team!
Client:
CTEC develops and delivers innovative customer-centric technologies and solutions that support the Office of Personnel Management’s (OPM) Health and Insurance business unit and Office of the Chief Information Officer (OCIO).
Duties and Responsibilities:
- Data Pipeline & ETL Development: Design, develop, and maintain scalable ETL pipelines and data workflows to ingest, transform, and integrate data from legacy systems and external sources into modern cloud-based data platforms.
- Cloud Data Platform & Databricks Implementation: Build, optimize, and maintain data processing solutions using Azure Databricks and lakehouse architectures to support analytical, operational, and reporting use cases.
- Data Migration Support: Support phased data migration from legacy databases and ETL tools to Azure Databricks environments, including transformation documentation and data mapping.
- Lakehouse & Data Layer Design: Implement layered lakehouse data architectures (e.g., bronze, silver, gold layers) in Databricks to support data quality, performance, and downstream reporting needs.
- Python & PySpark Development: Develop data processing notebooks, workflows, and distributed data transformations using Python and PySpark within Databricks environments.
- Data Quality & Validation: Develop data validation, reconciliation, and testing processes to ensure data accuracy, completeness, and consistency across data domains.
- Data Integration & Interoperability: Integrate Databricks data platforms with analytics and reporting tools to enable business intelligence and operational dashboards.
- Data Governance & Security Implementation: Support data governance initiatives including metadata management, data catalog integration, encryption, access controls, and compliance with federal data protection requirements.
- DevOps & CI/CD Support: Maintain source control and CI/CD pipelines for Databricks and data engineering workflows, supporting automated promotion across environments.
- Technical Collaboration: Work closely with data architects, solution architects, business analysts, and reporting teams to implement approved data solutions.
- Operational Support & Troubleshooting: Provide ongoing support for Databricks workflows, resolve pipeline failures, and troubleshoot complex data processing issues.
- Mentorship & Knowledge Sharing: Provide guidance to junior data engineers and contribute to documentation and team enablement.
- Works under minimal supervision with minor guidance from senior personnel.
Skills & Work Experience:
- Professional Experience: 7+ years of experience in data engineering, ETL development, or large-scale data integration environments.
- Strong experience designing and developing ETL pipelines and data transformations in Azure Databricks environments.
- Strong proficiency in SQL and Python, with hands-on experience using PySpark for distributed data processing.
- Experience working with cloud-based data platforms, data lakes, and lakehouse environments, preferably on Microsoft Azure.
- Experience implementing layered lakehouse data architectures (bronze, silver, gold) for enterprise analytics.
- Familiarity with Spark-based big data processing frameworks.
- Experience supporting data migration from legacy databases and ETL tools to Databricks-based platforms.
- Experience integrating Databricks platforms with business intelligence and reporting tools such as Power BI.
- Familiarity with data governance, metadata management, and data security best practices.
- Experience with source control and CI/CD pipelines for data engineering and Databricks workflows.
- Working knowledge of SDLC and Agile delivery methodologies.
- Excellent organizational, communication, and collaboration skills.
Preferred:
- Hands-on experience with Azure Databricks workflows, Delta tables, and Databricks job orchestration.
- Experience with Azure Data Lake, Azure Data Factory, or similar Azure data services.
- Experience supporting federal IT modernization or large-scale enterprise data transformation initiatives.
- Familiarity with healthcare, insurance, or benefits administration data environments.
- Experience implementing data governance or data catalog platforms.
Education:
Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related technical discipline. Equivalent education or professional experience will be considered in lieu of a degree.
Clearance:
Must be a U.S. citizen and be able to obtain a Public Trust clearance.
If you are looking for a fun and challenging environment with talented, motivated people to work with, CTEC is the right place for you. In addition to employee salary, we offer an array of employee benefits including:
-
Paid vacation & Sick leave
-
Health insurance coverage
-
Career training
-
Performance bonus programs
-
401K contribution & Employer Match
- 11 Federal Holidays
Similar jobs
Who we are DigiCert is a global leader in intelligent trust. We protect the digital world by ensuring the security, privacy, and authenticity of every interaction. Our AI-powered DigiCert ONE platform unifies PKI, DNS, a…
Est. 313,500 USD
FEQ327R276 Databricks is seeking a Field Chief Technology Officer (Field CTO) for the Public Sector business to serve as a senior, customer-facing technology and mission transformation leader for strategic government and…
Est. 182,125 USD
About Databricks At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakt…
Est. 154,575 USD
About Databricks At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakt…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Est. 60,000 USD
Who We Are Konrad is a next generation digital consultancy. We are dedicated to solving complex business problems for our global clients with creative and forward-thinking solutions. Our employees enjoy a culture built o…
Est. 214,325 USD
P-1604 About Databricks At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical…
Est. 120,000 USD
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Est. 251,550 USD
PLEASE NOTE: Due to federal contract requirements and client site access obligations, an active U.S. government security clearance is required. The position is based in the Washington, D.C., Maryland, or Virginia metropo…
Est. 251,550 USD
CSQ227R53 Databricks is redefining what organisations can achieve with data and AI. As the unified platform powering the world's most ambitious data-driven enterprises, we sit at the intersection of cloud migrations, AI…
Est. 185,150 USD
P-1366 About Databricks At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical…
Est. 296,600 USD
FEQ426R758 Databricks is seeking a Field Chief Technology Officer (Field CTO) for the Americas Industries Business Unit to be a senior, customer-facing technology and business transformation thought leader for our most s…
Est. 120,000 USD
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Est. 133,525 USD
84.51° Overview: 84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experienc…
Est. 175,000 USD
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Est. 140,000 USD
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Est. 120,000 GBP
REQ ID: FEQ127R254 Location: Hybrid – London As a Senior Forward Deployed Engineering - Architect you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks p…
Est. 225,625 USD
P-1652 At Databricks, we’re passionate about enabling data teams to solve the world’s toughest problems — from advancing the future of transportation to accelerating medical breakthroughs. We do this by building and oper…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Est. 216,104 USD
CSQ327R221 About Databricks At Databricks, we are passionate about enabling data teams to solve the world's toughest problems, from making the next mode of transportation a reality to accelerating the development of medi…
Est. 120,000 EUR
(REQ ID: CSQ427R209)Databricks is redefining what organisations can achieve with data and AI. As the unified platform powering the world's most ambitious data-driven enterprises, we sit at the intersection of cloud migra…
Est. 181,528 USD
CSQ327R219 PLEASE NOTE:Due to federal contract requirements and client site access obligations, U.S. citizenship and eligibility for a U.S. government secret clearance are required to access classified information. Candi…
Est. 180,875 USD
FEQ327R1 While candidates in the listed locations are encouraged for this role, candidates in other locations will be considered. Sr. Solution Engineers at Databricks lead the growth of the Databricks Unified Analytics P…
Est. 216,104 USD
CSQ227R175 PLEASE NOTE:Due to federal contract requirements and client site access obligations, U.S. citizenship and eligibility for a U.S. government secret clearance are required to access classified information. The p…
Est. 134,000 USD
Senior Data Engineer – Data Architecture & Platform CPI Security, a national leader in residential and commercial security solutions, is seeking a Senior Data Engineer transitioning into Data Architecture to join us…
Est. 120,000 GBP
Requisition # CSQ327R269 As a Forward Deployed Engineer Architect you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own the archit…