Responsibilities:

Manage incident response and root cause analysis to ensure high system availability and reliability. Provide comprehensive support for big data tools and platforms, including Hadoop, Spark, Hive, PySpark, Snowflake, and AWS EMR. Maintain and enhance Python Flask APIs, Scala applications, and Airflow workflows. Optimize SQL/HQL queries and manage shell/bash scripts for seamless data operations. Develop robust monitoring and reporting systems, ensuring transparency and performance metrics.

Skills & Qualifications:

Minimum of 3+ years of experience in production support or data engineering roles, including team leadership responsibilities. Expertise in: Big data technologies: Hadoop, Spark, Hive, PySpark. Programming languages: Python, Scala, with strong knowledge of Python Flask APIs. SQL/HQL and optimization techniques. Proficiency in Unix/Linux systems, shell/bash scripting, Snowflake, and AWS EMR. Hands-on experience with workflow orchestration tools like Airflow and incident management protocols. Strong problem-solving skills and excellent communication abilities for effective collaboration.