Senior Data Engineer

Senior Data Engineer / Elliott Management Corporation:Design, build, and operate scalable and secure data platforms and data pipelines that support analytics, reporting, AI/ML, and self-service data across the firm. Duties include: 1. Develop and maintain reliable batch and real-time data pipelines and ETL/ELT workflows for ingesting, transforming, and delivering internal and external datasets to downstream users and systems; 2. Architect and implement end-to-end data acquisition and integrations for securities, market, and reference data from internal systems and external vendors (e.g., APIs, SFTP, data feeds, and cloud data marketplaces), including schema and change management; 3. Integrate internal and external financial datasets, and implement data quality and governance frameworks; 4. Deliver reliable, well-modeled data for decision making in partnership with engineering, data science, and business teams; 5. Implement and maintain data quality, metadata, data lineage, and role- or policy-based access control frameworks to ensure data integrity, consistency, and compliance with firm standards; 6. Design and deliver curated, well-modeled datasets and APIs in collaboration with software engineers, data scientists, and business stakeholders; 7. Provide production support, monitoring, performance optimization, and incident resolution for data platforms and pipelines.May telecommute part of the week from commuting distance to New York, NY in accordance with the companys flexible working policy.Position Requirements:A Bachelors degree or foreign equivalent in Computer Science, Computer Engineering, or a related field followed by 5 years of post-baccalaureate experience in a software engineering or data engineering-related occupation. Experience must include the following, which may have been gained concurrently: * 5 years of experience building and operating scalable data platforms and data pipelines for analytics and AI/ML workloads in a production environment; * 5 years of experience programming with Python, Scala, or Java; * 5 years of experience using SQL with relational databases, including MS SQL Server, PostgreSQL, MariaDB, or similar; * 4 years of experience designing and implementing ETL/ELT processes, including data modeling, schema management, partitioning, and query optimization, in cloud data warehouse or data lake/lakehouse environments; * 4 years of experience working with big-data or distributed compute frameworks, including Apache Spark, Hadoop, or Hive, to process large-scale datasets; * 3 years of experience integrating and monitoring financial market datasets, including market data, reference data, transactional data, and derived datasets (including curves and volatility surfaces); * 3 years of experience implementing data governance and data quality frameworks, including metadata management, data lineage, and role- or policy-based access controls; * 3 years of experience delivering reliable production data systems using CI/CD pipelines, automated testing, monitoring and alerting, and version control; * 3 years of experience providing production support for data platforms and pipelines.Job site: 280 Park Avenue, New York, NY 10017. Full-time. Salary: $175,000 to $225,000.JOB OPPORTUNITY QUALIFIES FOR EMPLOYEE INCENTIVE REFERRAL PROGRAM.To apply, email cover letter and resume, referencing Req. #066226-003, to [email protected].