Skill: AWS Glue + PySpark

Experience: 6 to 13 Years

Location : AIA - Pune

Key Responsibilities:

• Design, develop, and optimize AWS Glue ETL jobs using PySpark.
• Integrate data from multiple sources (S3, RDS, Redshift, DynamoDB, etc.) into a centralized data lake or warehouse.
• Implement data transformations, cleansing, and enrichment logic in PySpark.
• Configure and manage AWS Glue Crawlers for schema inference and Data Catalog updates.
• Optimize job performance by tuning Spark configurations and partitioning strategies.
• Implement error handling, logging, and monitoring for Glue jobs.
• Collaborate with data engineers and analysts to define data requirements and transformation rules.
• Ensure data quality, security, and compliance with organizational and regulatory standards.
• Automate ETL workflows using AWS Glue Workflows, Triggers, and Step Functions.
• Troubleshoot and resolve issues in production ETL pipelines.

Required Skills & Qualifications:

• 3+ years of experience in data engineering or ETL development.
• Strong proficiency in PySpark and distributed data processing.
• Hands-on experience with AWS Glue, AWS S3, AWS Lambda, AWS Athena, and AWS Redshift.
• Solid understanding of Spark performance tuning and partitioning strategies.
• Experience with AWS Glue Data Catalog and schema management.
• Proficiency in SQL for querying and transforming data.
• Familiarity with IAM roles, policies, and AWS security best practices.
• Strong problem-solving skills and ability to work in an agile environment.

The Cognizant community:
We are a high caliber team who appreciate and support one another. Our people uphold an energetic, collaborative and inclusive workplace where everyone can thrive.

• Cognizant is a global community with more than 300,000 associates around the world.
• We don’t just dream of a better way – we make it happen.
• We take care of our people, clients, company, communities and climate by doing what’s right.
• We foster an innovative environment where you can build the career path that’s right for you.

About us:
Cognizant is one of the world's leading professional services companies, transforming clients' business, operating, and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build, and run more innovative and efficient businesses. Headquartered in the U.S., Cognizant (a member of the NASDAQ-100 and one of Forbes World’s Best Employers 2025) is consistently listed among the most admired companies in the world. Learn how Cognizant helps clients lead with digital at www.cognizant.com

Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.

Disclaimer: 
Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.