Data Platform Engineer

Job Description

Data Engineer / Lakehouse Engineer Opportunity

This role focuses on building scalable enterprise data platforms using modern cloud-native and distributed data engineering technologies.

Core Technical Skills Required
Programming & Distributed Processing

Strong hands-on expertise in:

Scala
Apache Spark
Apache Kafka

Expected capabilities:

Writing maintainable and scalable production-grade code
Working with batch and near real-time pipelines
Handling structured and unstructured datasets at scale
Cloud & Data Platform Skills

Experience with:

Amazon Web Services
Databricks

Focus areas include:

End-to-end lakehouse implementation
Distributed data architecture
Data integration across enterprise systems
DevOps & Monitoring

Required exposure to:

Jenkins
GitHub Actions
Prometheus
Grafana
Key Responsibilities
Build scalable data pipelines on AWS + Databricks
Design robust and observable data systems
Implement monitoring, logging, and alerting frameworks
Process high-volume structured and unstructured data
Ensure compliance and governance alignment
Collaborate with:
Product engineering teams
Regulatory stakeholders
Legal/compliance teams
Additional Expectations
Understanding of metadata-driven processing frameworks
Experience with distributed systems architecture
Ability to design maintainable and fault-tolerant pipelines
Strong focus on scalability and operational excellence
Application Contact
Rolly Martin
Email: rolly.martin@thompsonshr.com