Role: Sr. Data Engineer Location: Pennington/ Jersey City, NJ - ( Hybrid) Hire Mode: Full Time only
Job Description: • Design and develop scalable data pipelines using modern data stack technologies for Pershing X’s Cloud data platform. • Write ETL processes, design data applications and develop data pipelines for Operational Business Intelligence Mart • Role involves analyzing technical metadata, Data Pipeline logs and data lineage for data platform, and providing insights to support data platform operational decisions. • Collaborate with cross-functional teams to understand and Elucidate Observability requirements for the data platform considering SLA, operational needs, DQ and proactive monitoring. • Work with other engineers on the team to elevate technology and consistently apply best practices.
Required Skill and Experience: • A minimum of five (5) years of IT experience in data engineering or data management field • 4 - 5 years of experience in application development using SQL, PLSQL • Strong working knowledge and min of 2 years’ experience in DBT, Snowflake • Recent experience as a Senior Data Engineer in any public cloud, preferably on Azure as well as on a cloud warehouse like Snowflake is required • 2+ years of experience in building data pipelines using various ETL and ELT tools • Hands-on experience with Airflow is highly preferred • Experience in building cloud native solutions, preferably on Azure including the use of DevOps CI / CD tools and containers. • Proven experience as a Data Analyst or in a similar role. • Strong proficiency in Data Modelling, process metadata, observability, and monitoring data platforms. • Familiarity with data modelling tools / techniques is a plus • Azure or Snowflake training / certification is a plus • Strong analytical, problem solving, communication, collaborative and organizational skills • Self-driven, self-directed, passionate analytical and focused on delivering the right results
