Data Engineer Loc: Toronto, Ontario, Canada
100,000 - 200,000
Job Description:
- Maintain and enhance existing ETL process in place with SSMS on client data loading process
- Troubleshoot data elements that have changed or are incorrect in the ETL pipeline
- Provide feedback to the client services team for follow up with clients data load process
- Assist with developing/enhancing an automated SQL-based QA process for client data loads
- Understand data elements and business metric definitions to ensure a high quality analytical data model
- Follow SDLC release process to promote DB to production per internal guidelines
- Migrate ETL pipeline from RDMS to a Hadoop/Spark big data platform
Desired Skills and Experience:
- Bachelors degree or higher, preferably in a technical or engineering field
- 3-5 years experience working with SSMS and ETL processes
- Familiar with Agile Scrum methodology
- Strong knowledge of SQL
- Previous DevOps experience is an added plus
- Experience with Hadoop/Spark SQL ecosystem and building ETL processes in big data
- Good analytical thinking ability, ease with quantitative analysis, and excellent problem solving skills
- Self driven and willingness to learn
- Excellent verbal and written communication skills