Job Title: - Databricks with Pyspark
Location: - AIA Kolkata
Minimum 6 to 13 years of experience

Responsibilities

• Develop and maintain scalable data pipelines using Spark in Scala to process large datasets efficiently.
• Implement Delta Sharing and Databricks Unity Catalog Admin to ensure secure and seamless data sharing across platforms.
• Utilize Databricks CLI and Delta Live Pipelines to automate data workflows and enhance operational efficiency.
• Design and execute Structured Streaming applications to process real-time data streams with precision.
• Collaborate with cross-functional teams to integrate risk management solutions into data processing frameworks.
• Leverage Apache Airflow to orchestrate complex data workflows and ensure timely data delivery.
• Manage data storage and retrieval using Amazon S3 and Amazon Redshift to optimize performance and cost.
• Apply Python programming skills to develop robust data processing scripts and applications.
• Utilize Databricks SQL to perform advanced data analysis and generate actionable insights.
• Implement Databricks Delta Lake to ensure data reliability and consistency across the data lifecycle.
• Configure and manage Databricks Workflows to streamline data operations and improve productivity.
• Develop PySpark applications to process and analyze large-scale datasets with high efficiency.
• Contribute to the companys data strategy by delivering innovative solutions that drive business growth and societal impact.

Qualifications

• Possess a strong understanding of Spark in Scala and its application in data processing.
• Demonstrate expertise in Delta Sharing and Databricks Unity Catalog Admin for secure data management.
• Have experience with Databricks CLI and Delta Live Pipelines for workflow automation.
• Be proficient in Structured Streaming for real-time data processing.
• Show capability in risk management integration within data frameworks.
• Have hands-on experience with Apache Airflow for workflow orchestration.
• Be skilled in using Amazon S3 and Amazon Redshift for data storage solutions.
• Exhibit proficiency in Python for data processing and scripting.
• Be adept at using Databricks SQL for data analysis.
• Understand the principles of Databricks Delta Lake for data consistency.
• Have experience managing Databricks Workflows for operational efficiency.
• Be skilled in developing PySpark applications for large-scale data processing.

The Cognizant community:
We are a high caliber team who appreciate and support one another. Our people uphold an energetic, collaborative and inclusive workplace where everyone can thrive.

• Cognizant is a global community with more than 300,000 associates around the world.
• We don’t just dream of a better way – we make it happen.
• We take care of our people, clients, company, communities and climate by doing what’s right.
• We foster an innovative environment where you can build the career path that’s right for you.

About us:
Cognizant is one of the world's leading professional services companies, transforming clients' business, operating, and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build, and run more innovative and efficient businesses. Headquartered in the U.S., Cognizant (a member of the NASDAQ-100 and one of Forbes World’s Best Employers 2025) is consistently listed among the most admired companies in the world. Learn how Cognizant helps clients lead with digital at www.cognizant.com

Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.

Disclaimer: 
Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.