Job Description:
We are seeking a highly skilled Lead ETL Tester with expertise in Python, SQL, AWS, Big Data, and ETL Testing. The ideal candidate will have a strong background in data testing, automation frameworks, and Big Data technologies, with hands-on experience in tools like GenRocket, Cucumber, and Autosys. The Lead ETL Tester will play a crucial role in ensuring the accuracy and integrity of our data pipelines and data warehousing solutions.
Key Responsibilities:
- Lead and manage ETL testing efforts, ensuring the delivery of high-quality data solutions.
- Design, develop, and execute test cases for ETL processes using Python, SQL, and Big Data tools.
- Validate data transformations, data integrity, and data quality across various platforms, including AWS and Unix environments.
- Collaborate with cross-functional teams to define testing strategies and best practices for Big Data and ETL processes.
- Implement automated testing frameworks using tools like GenRocket, Cucumber, and Ruby.
- Conduct performance testing and optimization for ETL pipelines and Big Data solutions.
- Validate dimensional models, fact tables, surrogate keys, and joins in data warehousing.
- Manage job scheduling and monitoring using Autosys.
- Provide guidance and mentorship to junior testers, ensuring the continuous improvement of testing processes.
Required Skills and Qualifications:
- Proficiency in Python, SQL (advanced), and Big Data technologies.
- Experience with AWS services, ETL tools, and data warehousing concepts.
- Strong knowledge of ETL Testing, Big Data Testing, and data validation techniques.
- Familiarity with automation tools like GenRocket, Cucumber, and Ruby.
- Understanding of Java for test automation purposes.
- Experience with job scheduling tools like Autosys and operating systems such as Unix.
- Knowledge of dimensional models, fact loads, surrogate keys, and database joins.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
Preferred Qualifications:
- Experience in leading ETL testing teams.
- Familiarity with Agile/Scrum methodologies.
- Certifications in AWS or related technologies.
