Secret/TS Senior Data Engineer

Job Description

Responsibilities

• Lead the design, implementation, and maintenance of end-to-end data pipelines using Apache NiFi for ingestion, routing, and transformation of structured and unstructured data.
• Develop, optimize, and support ETL/ELT processes into Microsoft SQL Server databases, data marts, and operational data stores.
• Design and maintain logical and physical data models, including indexing and partitioning strategies to support performance, scalability, and availability in SQL Server.
• Design and develop advanced SQL (procedures, functions, views, and tables) to support application and analytic requirements.
• Deploy and support data solutions in Azure Cloud, integrating with Azure networking, storage, identity, and security services in accordance with customer policies and best practices.
• Integrate data services and back-end data sources with applications hosted on Microsoft IIS and WildFly, partnering with application teams to define and implement APIs and data access patterns.
• Implement data quality, validation, and monitoring within NiFi flows and SQL processes; proactively identify, troubleshoot, and resolve data and pipeline issues.
• Apply and enforce security best practices across NiFi, SQL Server, and Azure (least-privilege access, encryption in transit/at rest, key management, auditing, and logging).
• Contribute to and help mature automation and DevSecOps practices (e.g., scripting, infrastructure as code, CI/CD) to streamline deployment, configuration management, and environment consistency.
• Produce and maintain technical documentation, including data flow diagrams, interface specifications, and operational runbooks.
• Provide mentoring and knowledge transfer to junior team members.
• Provide operational support for production environments, including troubleshooting, root-cause analysis, performance tuning, and participation in after-hours support as required.
• Partner with leadership to inform and refine the data modernization roadmap, proposing patterns, standards, and sequencing based on technical insight and mission needs.

Skills and Requirements

Required Qualifications

• Active DoD Secret clearance (must be currently held and verifiable).

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field; or equivalent relevant experience.

• 5–8+ years of experience in data engineering, data integration, or database development, with increasing responsibility.

• Demonstrated hands-on experience designing and supporting data flows with Apache NiFi, including processors, controller services, parameter contexts, versioned flows, and secure configurations.

• Strong proficiency with Microsoft SQL Server, including:

• Advanced SQL (complex queries, stored procedures, functions, views)

• Performance tuning and optimization (indexes, execution plans, statistics)

• ETL/ELT development and relational/dimensional data modeling

• Experience deploying and supporting workloads in Azure Cloud, such as:

• Azure Virtual Machines, Virtual Networks, Storage, Key Vault, and related services

• Understanding of Azure identity and access control (Azure AD, RBAC)

• Working knowledge of Microsoft IIS and WildFly, and experience integrating web/application tiers with backend databases and data services.

• Experience with scripting or programming (e.g., PowerShell, Python) for automation, integration, and operational tooling.

• Strong analytical, troubleshooting, and communication skills, with proven ability to operate in a collaborative, mission-focused team and interact with both technical and non-technical stakeholders.

• Willingness and ability to support occasional on-site work in Alexandria, VA. 70-100H exact compensation may vary based on several factors, including skills, experience, and education. Employees in this role will enjoy a comprehensive benefits package starting on day one of employment, including options for medical, dental, and vision insurance. Eligibility to enroll in the 401(k) retirement plan begins after 90 days of employment. Additionally, employees in this role will have access to paid sick leave and other paid time off benefits as required under the applicable law of the worksite location. Preferred / Desired Qualifications

• Experience supporting DoD or Federal customers in enterprise, mission system, or secure cloud environments.

• Experience with additional Azure data and integration services, such as:

• Azure SQL Database or Managed Instance

• Azure Data Factory or Synapse Pipelines

• Azure Monitor or Log Analytics for observability and diagnostics

• Experience operating Apache NiFi in clustered, production environments (high availability, load balancing, site-to-site flows, certificates/SSL, secure protocols).

• Familiarity with RESTful APIs, microservices, and integration patterns between NiFi, IIS-hosted services, and Java applications on WildFly.

• Experience with enterprise ETL tools, especially IBM DataStage (designing, scheduling, and optimizing jobs for large-scale data integration).

• Experience with source control and CI/CD (e.g., Git, GitLab, Azure DevOps, GitHub) for managing NiFi flows, DataStage jobs, SQL scripts, and configuration changes.

• Knowledge of data governance and compliance practices (metadata management, lineage, retention, auditing) in government or regulated environments.

• Exposure to reporting and BI tools (e.g., Power BI, SSRS) consuming SQL Server datasets.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].