New

Data Engineer

Cognizant North America
United States, California, Pleasanton
Apr 02, 2025
Job Summary We are seeking an experienced Architect with 12 to 14 years of experience to join our team. The ideal candidate will have expertise in Azure Data Lake Store Azure DevOps Python Databricks SQL Databricks Workflows and PySpark. Additionally experience in Store Operations and Merchandising is required. This is a hybrid work model with day shifts and no travel required. Responsibilities Lead the design and implementation of data solutions using Azure Data Lake Store and related technologies. Oversee the development and deployment of applications using Azure DevOps. Provide expertise in Python programming to develop and maintain data processing scripts. Utilize Databricks SQL to create and manage data queries and reports. Implement and manage Databricks Workflows for efficient data processing. Develop and optimize data pipelines using PySpark. Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. Ensure data solutions are scalable reliable and secure. Conduct code reviews and provide feedback to ensure best practices are followed. Monitor and troubleshoot data solutions to ensure optimal performance. Stay updated with the latest industry trends and technologies to continuously improve data solutions. Provide technical guidance and mentorship to junior team members. Contribute to the overall success of the company by delivering high-quality data solutions that enhance store operations and merchandising processes. Qualifications Must have strong experience with Azure Data Lake Store and related technologies. Must have expertise in Azure DevOps for application development and deployment. Must be proficient in Python programming for data processing. Must have experience with Databricks SQL for data querying and reporting. Must be skilled in implementing Databricks Workflows. Must have experience with PySpark for developing and optimizing data pipelines. Must have domain experience in Store Operations and Merchandising. Nice to have experience with other cloud platforms and data technologies. Nice to have experience with data visualization tools. Nice to have experience with machine learning and AI technologies. Must have excellent problem-solving and analytical skills. Must have strong communication and collaboration skills. Must be able to work effectively in a hybrid work model. Certifications Required Azure Data Engineer Associate Databricks Certified Data Engineer Associate