Lead II - Data Engineering
UST · ust.com
ThiruvananthapuramLead / Manager5+ yrs
Straight from the company’s own careers site.
The job in short
Real-time data pipeline engineering on Kafka and AWS.
PythonJavaSQLKafkaAWSWarehouseCompliance
Details
- Found
- 8 d ago · posted 2026-10-22
- Location
- Trivandrum, Pune
Full description
Responsibilities * Develop and maintain real-time data pipelines using Apache Kafka (MSK or Confluent) and AWS services. * Configure and manage Kafka connectors, ensuring seamless data flow and integration across systems. * Demonstrate a strong understanding of the Kafka ecosystem, including producers, consumers, brokers, topics, and schema registry. * Design and implement scalable ETL/ELT workflows to process large volumes of data efficiently. * Optimize data lake and data warehouse solutions using AWS services such as Lambda, S3, and Glue. * Implement robust monitoring, testing, and observability practices to ensure data platform reliability and performance. * Uphold data security, governance, and compliance standards across all data operations. Requirements * Minimum of 5 years of experience in data engineering or related roles. * Proven expertise with Apache Kafka and the AWS data stack (MSK, Glue, Lambda, S3, etc.). * Proficient in coding with Python, SQL, and Java (Java strongly preferred). Person needs to flexible to write code in Python/Java * Experience with infrastructure-as-code tools (e.g. CloudFormation) and CI/CD pipelines. * Excellent problem-solving skills and strong communication and collaboration abilities.
Data Engineer jobs in Thiruvananthapuram · Data Engineer jobs in India · All UST jobs · Senior Data Engineer jobs in Thiruvananthapuram · Senior Data Engineer jobs in India · Senior and manager-level jobs in Thiruvananthapuram