<p>Skill: PySpark Developer</p> <p>Technical writer who has worked on Confluence tool and documentation experience.</p> <p>Desired Skills:</p> <ul> <li>Excellent Communication & very good Client Coordination skills. </li><li>Good in requirement gathering. </li></ul> <p>Technical Skills:</p> <ul> <li>Having good experience in Python, Apache Spark engine. </li><li>Having good experience in Bigdata, Hadoop. </li><li>Solid experience in SQL, NoSQL, databases. </li><li>Good experience in cloud platforms. (AWS, Azure). </li><li>Proficient in Python Programming and data manipulation. </li><li>Strong knowledge in ETL tools, DataLakes, Data Warehouse. </li><li>Having experience Migration projects. </li><li>Having experience Airflow, Oozie, Yarn. </li><li>Experience in Scripting languages (Shell). </li><li>Having good understanding on DevOps concepts. </li><li>Understanding of distributed architectures and scalability principles. </li><li>Understanding of SDLC and agile methodologies in particular. </li><li>Strong logical, analytical, and design skills. </li><li>Excellent written and verbal communication skills. </li><li>Self-Starter and Independent. </li></ul> <p>Responsibilities:</p> <ul> <li>Good working experience in working Python, PySpark and understanding Apache Spark framework. </li><li>Proficient in PySpark for big data processing. </li><li>Experience with data storage technologies such as Hadoop, HDFS, and cloud based technologies 9AWS, Azure). </li><li>Familiarity with SQL and data warehousing concepts. </li><li>Strong knowledge in data modeling and ETL concepts. </li><li>Experience in version control system using git and agile development methodologies. </li><li>Experience in CI/CD pipeline concepts. </li><li>Automate tasks using bash, Python. </li><li>Good hands on experience in automation and development. </li><li>Good communication and interpersonal skills. </li></ul> <p>Salary Range - $80,000-$120,000 a year</p> <p>#LI-NR3</p>