Java Spark Developer

plano, TX (On-Site)

Java Spark Developer

Location : Plano, Tx and Wilmington, DE (Hybrid)

Locals Preferred

Face to face client discussion required or this role.

Job Description

Must Have skill : Java Spark and AWS

Snowflake – Preferably Good knowledge/ Experience.

• Design, develop, and maintain scalable data pipelines using Apache Spark and Java.

• Implement data processing workflows and ETL processes to ingest, transform, and store large volumes of data.

• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.

• Optimize and tune data processing jobs for performance and cost-efficiency.

• Ensure data quality, integrity, and security across all data pipelines and storage solutions.

• Develop and maintain data models, schemas, and documentation.

• Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability.

• Hands-on experience with AWS services, including S3, EMR, Lambda, and Glue. Snowflake

• Experience with SQL and NoSQL databases.

• CICd/ Jules /Spinnaker

Key Skills: