Data Administrator

Job Title: Data AdministratorGrade: 30Salary: $122,938-$146,330The Research Foundation for Mental Hygiene, Inc is looking for a qualified candidate to fill the position Data Administrator Data Flow Automation (Healthcare IT) within the New York State Psychiatric Institute (NYSPI), an institution which provides top-notch, world-wide clinical, educational, and psychiatric research services. Affiliated with both the Columbia University Medical Center and New York State Office of Mental Health and located adjacent to the Columbia University Medical Center and New York Presbyterian Hospital in upper Manhattan, NYSPI programs seek to continue to lead in neurological and psychiatric discovery and care.Reporting to the NYSPI Director of Shared Services, the Data Administrator Data Flow Automation (Healthcare IT) will design, build, optimize and manage our automated data integration infrastructure. In this role, you will maintain seamless, automated data pipelines across our organization and eliminate manual data handling by ensuring data moves accurately and securely from various internal and external sources into our data warehouse.Duties and Responsibilities: Data Flow Automation: Design, implement, and maintain scalable, automated ETL/ELT pipelines for daily batch processing across enterprise data systems. Multi-Platform Administration: Support, tune, and optimize database connectivity and data movement between MSSQL, Oracle, and MySQL environments. Pipeline Monitoring & Alerts: Build proactive monitoring systems and automated error-handling routines (e.g., email alerts, automated fail-overs) to identify and remediate batch job failures immediately. Performance Tuning: Troubleshoot and optimize complex SQL queries, stored procedures, and batch scheduling to minimize processing windows and ensure high availability. Data Reliability & Quality: Implement data profiling and automated validation checks within the pipelines to preserve data lineage and guarantee data accuracy. Documentation: Create and maintain comprehensive documentation regarding data architecture, workflow dependencies, orchestration schedules, and disaster recovery procedures. Project planning and communication: Develop operational project tasks and schedules to support communications with business teams, technical teams and other project participants. Minimum Qualifications: Bachelor's Degree or higher in Computer Science or related software development field with at least four years related experience in a Relational Database Management System (RDBMS) environment. Healthcare IT Experience: At least 2 full-time years professional experience in healthcare IT systems, with a strong understanding of health data workflows, clinical data storage, healthcare data privacy and security requirements and healthcare operations. BI and Visualization: Proficiency with Power BI, including data modeling, connecting to disparate data sources, and optimizing gateway connections for automated refreshes, including at least 12 months experience developing customer-facing BI solutions. Database Expertise: Comprehensive, production-level experience administering and querying MSSQL (SQL Server), Oracle Database, and MySQL without depending on general database administrator accesses. Automation & Orchestration: At least 3 years leading design and operation of enterprise job schedulers, ETL tools, or workflow management platforms (e.g., SQL Server Agent, Cron, Apache Airflow, or similar automation tools). Scripting Skills: At least 5 years experience writing advanced script automation using T-SQL, PL/SQL, Python, PowerShell, and/or Bash to handle data ingestion, structural validation, and file manipulation. Data Integration Patterns: At least 2 years experience managing batch processing mechanics, change data capture (CDC), delta loads, and managing connectivity across disparate database platforms (via linked servers, DB links, or AP