Big Data Developer
Parsippany, NJ
Job Description:
nderstandingof core AWS services, uses, and basic AWS architecture best practices. We are creating an AWS based cloud offering whichwill be the primary focus of this position. The candidate will bedelivering applications through its full life cycle from concept to completionincluding responsibilities for architecting and developing scalable, highlyavailable application solutions that leverage AWS services. They need to workcollaboratively with other teams within IT and across the business teams,vendors and strategic partners to achieve project and solution
Abilities/KeyCompetencies/Skills
· Understandingof core AWS services, uses, and basic AWS architecture best practices(including security and scalability)
· Proficiencyin developing, deploying, and debugging cloud-based applications using AWSAdvanced knowledge of data analysis, profiling, and conceptual modeling
· Extensiveexperience in developing AWS data services (EC2, S3, Athena, EMR, AWS Glue, AWSCLI, Glacier, Redshift and Lambda)
· Hands onexperience in building Data Lakes using AWS services. Monitoring and optimizingthe data lake environment
· Experiencein building data ingesting services using Kinesis or other AWS services
· Hands onexperience in Data cataloging using AWS Glue,node.js, Pyspark, Scala and cloudformation
· Experiencewith in-place querying using Amazon Athena or Redshift
· Demonstratedunderstanding of Apache projects such as Spark, Hadoop, Airflow
· Advancedknowledge of SQL and scripting tools for automation such as R, Python, etc.
· Advancedknowledge technical and functional designs for databases, ETL, datawarehousing, and reporting
· Stronghands-on experience in development in the AWS cloud environment
· Abilityto work collaboratively and influence the project team to achieve the goals
· Abilityto manage time and pressures to work on multiple initiatives at the same time
· Abilityto work with the team to put together estimations, presentations, risks, andsolutions
· Abilityto work well in a matrix organization leading employees and consultants
· Teamplayer who can mentor and guide developers and strategic partners on strategicand tactical application designs
· Goodanalytical, problem solving and technical writing skills
· Goodverbal and written communication skills
· Communicationskills to clearly articulate and represent engineering team in project and/orsolution meetings
Key Skills:
- AWS data services (EC2, S3, Athena, EMR, AWS Glue, AWS CLI, Glacier, Redshift and Lambda)