Senior Data Engineer

Minimum Education

• Bachelor's Degree A Bachelor's degree in a quantitative or business field (e.g., Statistics, Mathematics, Engineering, Computer Science). (Required)

Minimum Work Experience

• 6+ years of related experience or equivalent experience acquired through accomplishments of applicable knowledge, duties, scope and skill reflective of the level of this position. (Required)

Required Skills/Knowledge

• Experience with big data; data processing and cloud technologies.
• Strong experience diagnosing system issues, engaging in data validation, and providing quality assurance testing.
• Experience with data manipulation; Data mining.
• Experience working in production cloud infrastructure.
• Experience with C# (programming language); Java (programming language); Programming concepts; Programming tools; Python (Programming Language); SQL (programming language).
• Knowledge of Microsoft Azure; Databricks or equivalent.
• Seeks to acquire knowledge in area of specialty.
• Ability to identify basic problems and procedural irregularities, collect data, establish facts, and draw valid conclusions.
• Ability to work independently.
• Demonstrated analytical skills.
• Demonstrated project management skills.
• Demonstrates a high level of accuracy, even under pressure.
• Demonstrates excellent judgment and decision-making skills.
• Great verbal and written communication skills, communicate complex findings in a clear and understandable manner
• Great facilitation ability to host sessions and elicit ideas from others, understanding their issues and encourage group participation
• Attention to detail.
• Communicate complex findings in a clear and understandable manner
• Collaborate effectively with cross-functional teams
• Adapt to changing priorities and thrive in a dynamic environment

Functional Accountabilities

• Helps guide the design and implementation of complex data management procedures around data staging, data ingestion, data preparation, data provisioning, data destruction, (scripts, programs automation, assisted by automation etc.)
• Provides guidance to data engineering in the design, development, implementation, testing, documentation, and preparation of large scale, high volume, high performance data structures for business intelligence analysts.
• Designs, develops and maintains real time processing applications and real time data pipelines.
• Ensure quality of technical solutions as data moves across environments.
• Provides senior level knowledge and insight into the changing cloud data environment, data processing, data storage, and utilization requirements for the company and drives the team toward viable solutions.
• Develops, constructs, tests, and maintains architectures using advanced programming languages and tools.
• Drives ways to improve data reliability, efficiency, and quality and deploys a solution; use data to discover tasks that can be automated.
• Performs other duties as assigned.
• Complies with all policies and standards.