Databricks along with Python

Job Description

Job Description – Azure Databricks Developer (Python / PySpark)

Company Name: Tata Consultancy Services (TCS)
Job Title: Databricks Developer – Python / PySpark
Job Locations: Bangalore / Hyderabad
Experience Required: 5–8 Years
Industry: IT Services / Data Engineering / Cloud Technologies
Interview Date (Original Announcement): 11 September 2025
Salary: Not Disclosed
Employment Type: Not Specified

Job Summary

Tata Consultancy Services (TCS) is looking for experienced Azure Databricks Developers with strong Python and PySpark expertise for opportunities in Bangalore and Hyderabad.

The ideal candidate should have 5–8 years of professional experience, with strong hands-on knowledge of Azure Data Factory, Azure Databricks, Delta Lake, Azure data storage, SQL Server, and Data Warehousing.

The selected candidate will be responsible for designing, developing, and implementing scalable data pipelines, data integration processes, and cloud-based data warehousing solutions.

Key Responsibilities

1. Azure Databricks Development

Design, develop, and maintain data engineering solutions using Azure Databricks.

Develop scalable data processing workflows using Python and PySpark.

Implement and optimize Databricks-based data transformation processes.

Work with Delta Lake for efficient data processing and management.

Troubleshoot and optimize data processing performance.

2. Azure Data Factory and ETL Development

Design and implement data loading and integration processes using Azure Data Factory.

Develop and maintain ETL/ELT pipelines for enterprise data platforms.

Integrate data from multiple sources into cloud-based storage and analytical environments.

Ensure reliable data movement, transformation, and processing.

Monitor and troubleshoot data pipeline issues.

3. Data Warehousing and Database Development

Design, develop, and maintain databases, Data Warehouses, and Data Marts.

Apply Data Warehousing principles and dimensional modeling concepts.

Work extensively with Microsoft SQL Server.

Develop and optimize complex SQL queries and data transformation logic.

Ensure data accuracy, integrity, and performance.

4. Azure Cloud Data Engineering

Develop solutions within Azure Cloud data environments.

Work with Azure data lake storage technologies.

Support cloud-based data architecture and integration.

Implement efficient data storage and retrieval processes.

Contribute to scalable enterprise data engineering solutions.

5. Data Formats and Integration

Work with standard data formats such as JSON and XML.

Use XSLT where required for data transformation.

Support integration between enterprise applications and data platforms.

Ensure consistency and quality of integrated data.

6. Collaboration and Technical Problem-Solving

Collaborate with development teams, architects, and business stakeholders.

Participate in technical discussions and solution design.

Identify and resolve data engineering challenges.

Maintain high standards of development quality and documentation.

Communicate technical requirements and solutions effectively.

Required Technical Skills

Mandatory Skills:

Azure Databricks

Python

PySpark

Azure Data Factory (ADF)

Delta Lake

Azure Data Lake Storage

Microsoft SQL Server

Data Warehousing

Data Mart Development

Database Development

ETL / ELT Development

Data Pipeline Development

JSON

XML

XSLT

Azure Cloud Data Engineering

SQL Query Development and Optimization

Good to Have Skills:

OData Services

Apache Kafka

Terraform

Databricks Unity Catalog

MongoDB

Azure Cosmos DB

MySQL

Oracle Database

Candidate Requirements

5–8 years of relevant IT experience.

Strong hands-on experience with Databricks and Python.

Expertise in developing data pipelines using PySpark.

Extensive knowledge of Azure Data Factory and Delta Lake.

Experience designing and implementing enterprise data loading processes.

Strong experience in database, Data Warehouse, and Data Mart development.

Advanced knowledge of Microsoft SQL Server.

Understanding of Data Warehousing principles and design.

Proficiency in JSON, XML, and XSLT.

Good exposure to Azure Cloud data environments.

Familiarity with Kafka, Terraform, and Unity Catalog will be an advantage.

Excellent verbal communication skills.

Strong analytical and problem-solving abilities.

High attention to detail.

Willingness to work in or relocate to Bangalore or Hyderabad.

Job Locations

Bangalore, Karnataka

Hyderabad, Telangana

How to Apply

Interested and eligible candidates can share their updated resumes with the TCS recruitment team.

Recruiter Email: saranya.devi3@tcs.com

Candidate Information Required

Please include the following details when submitting your application:

Full Name:

Preferred Location (Bangalore / Hyderabad):

Contact Number:

Email ID:

Highest Qualification:

University / Institute Name:

Current Organization:

Willing to Relocate to Bangalore / Hyderabad (Yes / No):

Total Experience:

Relevant Experience in Databricks with Python:

Current CTC:

Expected CTC:

Notice Period:

Career Gap Duration (if any):

Career Gap Details (if any):

Interview Availability:

Preferred Interview Timings:

Previous TCS Interview Details (if any):

TCS iBegin Portal EP ID (if already registered):