<p>JobID: 210638724</p> <p>Category: Software Engineering</p> <p>JobSchedule: Full time</p> <p>Posted Date: 2025-07-07T14:13:31+00:00</p> <p>JobShift:</p> <p>:</p> <p>We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.</p> <p>As a Lead Software Engineer - Java/AWS/Spark at JPMorgan Chase within the Commercial & Investment Bank Regulatory Reporting and Compliance space, you will be part of an agile team dedicated to enhancing, designing, and delivering software components for the firm's cutting-edge technology products. Your role will focus on ensuring these products are secure, stable, and scalable in the cloud environment.</p> <p>Job Description: We are seeking a Lead Software Engineer with industry experience and expertise in Java, Kafka, Spark, Structured Streaming, and AWS. The ideal candidate will have a strong background in real-time data streaming and cloud-based architectures, with a passion for optimizing data workflows and delivering actionable insights.</p> <p>Job Responsibilities:</p> <ul> <li>Design and implement scalable data processing pipelines using Apache Kafka, Apache Spark, and Structured Streaming. </li><li>Develop and maintain Java applications for data ingestion, transformation, and storage. </li><li>Integrate data processing solutions with AWS services such as Apache Kafka/Amazon MSK, Amazon S3, AWS Lambda, and Amazon EMR. </li><li>Implement real-time data processing solutions to handle large volumes of data efficiently. </li><li>Develop solutions for data enrichment and transformation to create meaningful insights. </li><li>Optimize data processing pipelines for performance and scalability. </li><li>Monitor and troubleshoot performance issues in Kafka and Spark applications. </li><li>Collaborate with cross-functional teams to understand data requirements and deliver solutions. </li><li>Ensure data processing solutions adhere to security and compliance standards. </li><li>Document data processing workflows, architecture, and best practices. </li></ul> <p>Required Qualifications, Capabilities, and Skills:</p> <ul> <li>Formal training or certification on software engineering concepts and 5+ years applied experience </li><li>Proven expertise in Java, Kafka, Spark, Structured Streaming, and Spark SQL. </li><li>Strong experience with AWS services and cloud-based architectures (Lambdas, EC2, S3, Glue, EKS etc.) </li><li>Hands-on practical experience in system design, application development, testing, and operational stability. </li><li>Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages. </li><li>Proficiency in designing and implementing real-time data processing solutions. </li><li>Experience with data enrichment, transformation, and optimization techniques. </li><li>Excellent problem-solving skills and attention to detail. </li><li>Able to mentor the junior developers of the team. </li><li>Strong communication and collaboration skills. </li><li>Ability to work independently and as part of a team. </li></ul> <p>Preferred Qualifications, Capabilities, and Skills:</p> <ul> <li>Experience with Python/shell scripting and working in a Linux environment. </li><li>Experience building distributed systems at Internet scale. </li></ul>