Databricks, PySpark, Python - Data Engineer
Infosys · infosys.com
ThiruvananthapuramSenior7–9 yrs
The job in short
Databricks PySpark data engineering.
PythonSQLSparkDatabricksData science
Details
- Found
- 13 d ago · posted 2026-09-30
- Location as listed
- Trivandrum, India
- Role
- Data Engineer
- Source
- The company’s own careers site
Full description
About the role
We are seeking a highly skilled Team Lead - Data Engineering with 7-9 years of experience in designing and developing scalable data solutions using Databricks, PySpark, and Python. The candidate will be responsible for leading a small team, driving technical delivery, and building high-performance data pipelines for enterprise analytics platforms.
Responsibilities
Lead the design, development, and deployment of data engineering solutions using Databricks and PySpark.
Develop scalable ETL/ELT pipelines and data transformation frameworks.
Write efficient Python and SQL code for data processing and analytics.
Work closely with stakeholders to understand business requirements and translate them into technical solutions.
Optimize Spark jobs for performance, scalability, and cost efficiency.
Ensure data quality, governance, and security standards are followed.
Review code, mentor team members, and provide technical guidance.
Support production deployments, incident troubleshooting, and root cause analysis.
Participate in Agile ceremonies and drive sprint deliverables.
Technical requirements
7-9 years of overall IT experience.
Strong hands-on expertise in Databricks and PySpark.
Proficiency in Python programming and SQL.
Experience building enterprise-scale data pipelines and data lake solutions.
Strong understanding of distributed computing concepts and Spark architecture.
Experience in performance tuning and optimization.
Excellent stakeholder management and team coordination skills.
Preferred skills
Technology->Cloud Data Platforms->Databricks,Technology->AI-Data science->PYTHON - AI-Data Science,Technology->Data Engineering->PySpark
Education
MBA,MCA,ME,MSc,MTech,Bachelor of Engineering,BCA,BSc,BTech
Data Engineer jobs in Thiruvananthapuram · Data Engineer jobs in India · All Infosys jobs