Lead Data Engineer
K2 Partnering Solutions · k2partnering.com
United StatesLead / Manager
The job in short
Lead data engineering.
PythonScalaSQLKafkaSparkAirflowDatabricksAWSAzureGCPTerraform
Details
- Found
- 5 d ago · posted 2026-06-11
- Location as listed
- United States of America
- Role
- Data Engineer
- Source
- The company’s own careers site
Full description
101444 Lead Data Engineer
USA
Upper-Intermediate Strong (B2+)
Position Requirements
We are looking for a Lead Big Data Engineer with strong expertise in streaming and modern data platforms to join our team and collaborate with our client, Deloitte.
In this role, you will lead the design and delivery of real-time data solutions, scalable data platforms, and event-driven architectures, working closely with engineering teams, architects, and business stakeholders.
You Are
An experienced Lead Data Engineer / Lead Data Platform Engineer
Strong in:
Streaming data architecture
Event-driven systems
Designing real-time and batch data pipelines
Hands-on with:
Apache Kafka and Confluent Platform / Confluent Cloud
Databricks and lakehouse architectures
Change Data Capture (CDC) patterns
Proficient in:
Python, SQL (Scala is a plus)
Experienced in building solutions using:
Spark (PySpark/Scala), Delta Lake
Knowledgeable in:
Kafka topics, partitions, schema design
Schema Registry, Kafka Connect, ksqlDB
Experienced in:
Cloud platforms (Azure / AWS / GCP)
Data modeling and performance optimization
Skilled in collaboration with:
Architects
Product Owners
Cross-functional engineering teams
A strong leader with ownership mindset and excellent communication skills
You Will
Define and drive data platform architecture and engineering standards
Lead a team of data engineers and support technical decision-making
Design and implement:
End-to-end data ingestion frameworks
Streaming and batch data pipelines
Build and optimize:
Real-time data processing solutions
Event-driven systems based on Kafka ecosystem
Develop and maintain data platforms on Databricks
Implement CDC pipelines to replicate transactional data into analytics platforms
Drive cloud migration and data platform modernization initiatives
Ensure solutions meet requirements for:
Scalability
Reliability
Security and governance
Collaborate with stakeholders to align technical solutions with business needs
Support continuous improvement and data-driven decision-making
Selling Points
Nice to Have
Hands-on experience with:
Debezium
Kafka Connect ecosystem
GoldenGate or SQL-based CDC tools
Experience with:
Airflow or Databricks Workflows
Infrastructure as Code (Terraform)
CI/CD pipelines for data platforms
Exposure to:
Advanced monitoring and observability tools
Multi-cloud data platform strategies
Together We Offer
Opportunity to work with Deloitte, a globally recognized client
Participation in enterprise-scale data engineering and transformation programs
Access to modern streaming, cloud, and data platform technologies
A collaborative and innovation-driven engineering environment
Opportunities for leadership growth and certifications
Flexible work arrangements across the United States