<p>Data Engineer</p> <p>Location: New York, NY | Hybrid</p> <p>Job Description</p> <p>M Science is a data-driven research and analytics firm, uncovering new insights for leading financial institutions and corporations. We come to work every day to create actionable insights from alternative data. M Science is revolutionizing research, discovering new data sets and pioneering methodologies to provide actionable intelligence. Our research teams have decades of experience working with massive amounts of unstructured data in near real-time to discern critical insights that help clients make smarter, more informed decisions. We combine the best of finance, data and technology to create a truly unique value proposition for both financial services firms and major corporations.</p> <p>The Role</p> <p>We're looking for a Data Engineer who is passionate about building robust, scalable data infrastructure and pipelines. You'll work with petabytes of data daily using cutting-edge technologies including Databricks, SQL, Python, Airflow, and modern AI development tools. This role requires someone who can architect solutions, mentor junior engineers, and drive technical excellence across our data platform.</p> <p>Key Responsibilities</p> <p>Data Pipeline Architecture & Development:</p> <ul> <li>Design, build, and maintain scalable ETL/ELT pipelines processing petabytes of data </li><li>Architect data solutions using modern cloud technologies (AWS, Databricks, Snowflake) </li><li>Implement real-time and batch processing workflows using Apache Airflow </li><li>Optimize data storage and retrieval patterns for analytical workloads </li></ul> <p>Data Quality & Governance:</p> <ul> <li>Implement comprehensive data quality frameworks and monitoring systems </li><li>Establish data governance standards and best practices </li><li>Build automated testing and validation for data pipelines </li><li>Develop data lineage and metadata management solutions </li></ul> <p>Technical Leadership:</p> <ul> <li>Lead technical design reviews and architecture decisions </li><li>Mentor junior data engineers and promote best practices </li><li>Drive adoption of modern development practices including CI/CD for data pipelines </li></ul> <p>AI-Enhanced Development:</p> <ul> <li>Leverage AI coding assistants (Cursor, Claude, GitHub Copilot) to accelerate development </li><li>Implement AI-driven data quality checks and anomaly detection </li><li>Stay current with emerging AI tools and their applications in data engineering </li></ul> <p>Required Skills & Experience</p> <p>Technical Requirements:</p> <ul> <li>2-5 years of data engineering experience </li><li>Python - Object-oriented programming, async/await, data processing libraries </li><li>Databricks - Spark optimization, Delta Lake, Unity Catalog governance </li><li>Cloud Platforms - AWS (S3, EMR, Lambda, Glue) or equivalent </li><li>Data Modeling - Dimensional modeling, data vault, modern data stack patterns </li><li>SQL - Complex queries, performance optimization, window functions </li></ul> <p>Leadership & Soft Skills:</p> <ul> <li>Experience mentoring junior engineers and leading technical initiatives </li><li>Strong communication skills for cross-functional collaboration </li><li>Experience with Agile methodologies and project management </li><li>Ability to translate business requirements into technical solutions </li></ul> <p>Preferred Qualifications</p> <ul> <li>Experience in financial services, fintech, or data intelligence companies </li><li>Background in consumer retail, digital media, or technology verticals </li><li>Advanced degree in Computer Science, Statistics, Mathematics, or related field </li><li>Apache Airflow - DAG development, custom operators, workflow orchestration </li></ul> <p>Salary Range: $90,000-$130,000 USD/Annual</p> <p>The salary offered will take into consideration an individual's experience level and qualifications. In addition to salary, M Science offers, for eligible employees, an annual discretionary incentive bonus, competitive employee benefits, including: medical, dental & vision coverage; 401(k); life, accident, disability insurance; and wellness programs. M Science also offers paid time off packages that include planned time off (vacation), unplanned time off (sick leave), paid holidays and paid parental leave.</p>