<p>Title: Software Engineer</p> <p>Location: Charlotte, NC</p> <p>Duration: 12 months</p> <p>Work Engagement: W2</p> <p>Benefits on offer for this contract position: Health Insurance, Life insurance, 401K and Voluntary Benefits</p> <p>Overview</p> <p>This role supports the Model Risk Management platform used to run statistical risk models and large-scale data workloads. The engineer will help maintain and enhance a cloud-native platform used by statisticians and data scientists working with millions of customer accounts. The platform runs on Google Cloud Platform and supports distributed data processing using Apache Spark.</p> <p>Experience with large-scale datasets, GCP services, Spark, and containerized microservices is essential. Experience in financial services is preferred but not required.</p> <p>Key Responsibilities</p> <p>Platform Engineering</p> <p>Deploy, configure, and maintain OpenShift clusters or GCP projects for Spark workloads</p> <p>Support platform capabilities for statistical model execution</p> <p>Distributed Data Processing</p> <p>Design and implement large-scale data processing workflows using Apache Spark</p> <p>Tune Spark jobs using Kubernetes orchestration and auto-scaling</p> <p>Application & Tooling</p> <p>Build Python/Django services and microservices supporting platform users</p> <p>Configure tooling and internal applications for data processing and model execution</p> <p>Automation & CI/CD</p> <p>Build and maintain CI/CD pipelines using GitHub Actions, Sonar, Harness, Helm</p> <p>Monitoring & Troubleshooting</p> <p>Monitor Spark jobs and cluster health using Prometheus, Grafana, and GCP tools</p> <p>Debug distributed systems and optimize resource utilization</p> <p>Security & Compliance</p> <p>Implement RBAC and encryption for data in transit and at rest</p> <p>Collaboration</p> <p>Work closely with cross-functional teams to define requirements and support deployments</p> <p>Qualifications</p> <ul> <li>Applicants must be authorized to work for ANY employer in the U.S. This position is not eligible for visa sponsorship. </li><li>Strong experience working on Apache Spark for big data processing. </li><li>Hands on Django development experience. </li><li>Proficiency in creating and maintaining conda environments. </li><li>Experience with managing containerized environments with OpenShift or Kubernetes </li><li>Proficiency in Spark frameworks(Python/PySpark, Scala, or Java) </li><li>Hands-on experience with OpenShift administration (e.g., cluster setup, networking, storage) </li><li>Proficiency in creating and maintaining conda environments and dependencies </li><li>Familiarity with Docker and Kubernetes concerts(e.g., pods, deployments, services and images) </li><li>Knowledge of distributed systems, cloud platforms(AWS, GCP, Azure), and data storage solutions (e.g., S3, HDFS) </li><li>Programing: Strong coding skills in Python, Scala, or Java; experience with shell scripting is a plus. </li><li>Tools: Experience with Git Actions, Helm, Harness, and CI/CD tools. </li><li>Problem-Solving: Ability to debug complex issues across distributed systems and optimize resource usage. </li><li>Education: Bachelor's degree in Computer Science, Engineering or related filed. </li></ul> <p>Education</p> <p>Bachelor's degree in Computer Science, Engineering, or related field</p>