Hadoop Developer

Dearborn, MI

Job Description:

Job Description :

 

1. Design and development of data ingestion pipelines.

 

 2. Perform datamigration and conversion activities.

 

3. Develop and integrate software applications usingsuitable development methodologies and standards, applying standardarchitectural patterns, taking into account critical performancecharacteristics and security measures.

 

 4. Collaboratewith Business Analysts, Architects and Senior Developers to establish thephysical application framework (e.g. libraries, modules, executionenvironments).

 

 5. Perform end toend automation of ETL process for various datasets that are being ingested intothe big data platform.

 

Required: 1. Java 2. J2EE, Web Applications, Tomcat (orany equivalent App server) , Restful Services, JSON 3. Spring, Spring Boot,Struts, Design Patterns 4. Hadoop (preferably Cloudera (CDH)) , HDFS, Hive,Impala, Spark, Oozie, HBase

 

5. SCALA 6. SQL 7. Linux

 

Good to Have: 8. Google Analytics, Adobe Analytics 9.Python, Perl 10. Flume, Solr 11. Strong Database Design Skills 12. ETL Tools13. NoSQL databases (Mongo, Couchbase, Cassandra) 14. JavaScript UI frameworks(Angular, NodeJS, Bootstrap)

 

 

 

Minimum Qualifications and Job Requirements:

 

 Must have aBachelor’s degree in Computer Science or related IT discipline:

 

• Must have at least 9+ years of IT developmentexperience.

 

• Must have strong, hands-on J2EE development

 

• Must have indepth knowledge of SCALA – Sparkprogramming

 

• Must have 6+ years relevant professional experienceworking with Hadoop (HBase, Hive, MapReduce, Sqoop, Flume) Java, JavaScript,.Net, SQL, PERL, Python or equivalent scripting language

 

• Must have experience with ETL tools

 

• Must have experience integrating web services

 

• Knowledge of standard software developmentmethodologies such as Agile and Waterfall

 

• Strong communication skills.

 

• Must be willing to flex work hours accordingly to supportapplication launches and manage production outages if necessary

 

Specific Knowledge, Skills and Abilities:

 

• Ability to multitask with numerous projects andresponsibilities

 

• Experience working with JIRA and WIKI

 

• Must have experience working in a fast-paced dynamicenvironment.

 

• Must have strong analytical and problem solving skills.

 

• Must have excellent verbal and written communicationskills

 

• Must be able and willing to participate as individualcontributor as needed.

 

• Must have ability to work the time projects and/or meetdeadlines.


Key Skills:

  • J2EE SCALA Java, JavaScript, .Net, SQL, PERL, Python

Share Profile