<p>Kforce has a client that is seeking a Senior Databricks Engineer in Armonk, NY.</p> <p>Summary: We are seeking a Senior Databricks Engineer to join our team and lead the architecture, setup, and optimization of Databricks environments for enterprise-scale data initiatives. This role will be critical in establishing secure and scalable Databricks platforms, integrating with diverse data sources, and enabling advanced analytics and AI/ML workloads.</p> <p>Responsibilities:</p> <ul> <li>Architect, deploy, and configure Databricks workspaces in Azure environments </li><li>Establish secure and optimized connections to data sources (on-premise, cloud storage, relational and NoSQL databases, APIs, etc.) </li><li>Design and implement data pipelines using Databricks Delta Live Tables (DLT), Spark, and related technologies </li><li>Collaborate with security teams to ensure compliance with enterprise governance, authentication (IAM), and network policies (VPC, Private Link, etc.) </li><li>Optimize cluster configurations for cost, performance, and scalability based on workload patterns </li><li>Provide technical leadership and best practices guidance to data engineers and analysts on leveraging Databricks for data ingestion, transformation, and ML workflows </li><li>Troubleshoot and resolve performance, connectivity, and configuration issues within the Databricks platform </li><li>Develop automation scripts for provisioning and managing Databricks resources (Terraform, CI/CD pipelines, etc.)* 5+ years of hands-on experience with Databricks platform setup and administration </li><li>Experience integrating Databricks with Snowflake </li><li>Deep expertise in Databricks architecture, workspace administration, and cloud integrations (Azure) with a proven ability to partner with data engineering, platform, and business teams to drive outcomes </li></ul> <p>Preferred:</p> <ul> <li>Prior experience in Utility/electric/gas industries (Healthcare, Financial Services, etc.) ensuring compliance and data governance </li></ul>