Sr Hadoop Developer
Costa Mesa, CA
12 month contract
Responsibilities
• Design a generic framework for high throughput and streaming data ingestion, curation and linkage for the Experian Data Fabric – a Data as a Service platform intended to be configured/extended for deployments across the globe
• Develop high throughput and streaming data pipelines using Experian Lambda Architecture; Internal bulk sources to include server logs, file uploads, database logs, relational sources and CDC; streaming sources to include web sockets, HTTP client callbacks, and kafka events
• Develop rules-driven, data transformation layer that can be rapidly configured / deployed at business units and geographies globally
• Build components for standardization, data curation, identity resolution and end-to-end traceability at dataset and record levels
• Develop data provisioning components to deliver data for operational analytics as well as research purposes
• Develop ultra-low latency micro services to serve data from the State Container within 10 milliseconds
Qualifications
• 5+ years hands-on experience as Software Developer/Engineer
• 4+ years Java/Scala development background
• 1+ year experience working with native MapReduce and/or spark
• Desired - 2+ years data engineering/ETL development experience working with data at scale
• Desired - 2+ experience with Heroku or Docker
• 1+ year experience across one or more of the following Hadoop, MapReduce, HDFS, Cassandra, HBase, Hive, Flume, Sqoop, Spark, Kafka, etc.
• Bachelor's degree in Computer Science, Engineering or quantitative discipline
· Designs, develops, tests, and evaluates software and systems that enable computers to perform their applications, applying principles and techniques of computer science, engineering, and mathematical analysis.
· Excludes paraprofessional positions and requires a degree in software engineering design and development.
· Researches, designs, and develops computer software systems, in conjunction with hardware product development, applying principles and techniques of computer science, engineering, and mathematical analysis.
· Analyzes software requirements to determine feasibility of design within time and cost constraints.
· Consults with hardware engineers and other engineering staff to evaluate interface between hardware and software, and operational and performance requirements of overall system. Formulates and designs software system, using scientific analysis and mathematical models to predict and measure outcome and consequences of design.
· Develops and directs software system testing procedures, programming, and documentation.
· Consults with customer concerning maintenance of software system.
· May coordinate installation of software system.
· 12+ years of experience required.
Key Skills:
Project Manager Location:D...
Location
Utility Person (Non CDL Driver...
Location
Technical Writer (1332554) L...
Location
Senior Quality Assurance Engin...
Location
Consultant -5 years of experie...
Location
Program Manager
Location
Cyber Security Manager L...
Location
Technical Writer Hybrid Co...
Location
Systems Administrator (Contrac...
Location
Google File Migration Analyst
Location
Operational Risk Analyst VA - ...
Location
Marketing Manager, Location:...
Location
Data Engineer Locatio...
Location
Senior Engineer, Java Applicat...
Location
Oracle CC&B Technical Lead Loc...
Location
Send your resume at support@kloudhire.com
Sr Cloud ERP Programmer Analyst Location:Omaha, N...
Location
SRE Engineer
Location
Sr. SAP SCM & AMS (Application Management Support)...
Location
Sr. QA with IAM/Active Directory Remote contract L...
Location
SR SAP Supply Chain Solutions (Program)Management ...
Location
Sr. Cybersecurity DevOps Engineer Kansas City, MO ...
Location
Sr. Techno-Functional Oracle Analyst, Location:...
Location
Sr. IT Business Systems Analyst - SAP Material Man...
Location
Sr. Salesforce Specialist, Houston (On-site)
Location
Sr Programmer Analyst-JAVA (Remote or Hybrid posit...
Location
Sr. Network Engineer REMOTE
Location
Sr SAP FICO Analyst Location:Irving, TX, USA
Location
Sr. Analyst (Oracle ERP - Finance), Location:Wi...
Location
Sr Manager, Enterprise Application Management Serv...
Location
Sr Manager - Field Tools & Adv Analytics
Location
Sr. Finance (Oracle ERP), Location:Irvine, CA, Lo...
Location
Sr. QA with IAM/Active Directory Remote contract :...
Location
Sr. Business Analyst 12 Month Contract Locati...
Location
Sr. IT Business Systems Analyst - Sales & Distribu...
Location
SR FUNCTIONAL ANALYST, SAP-FI/CO Location: Fort Mi...
Location
Sr Manager, Cybersecurity Risk Assessor Location...
Location
SR Corporate financial Systems Analyst
Location
Sr Dir, Business Development
Location
Sr. Network Administrator - Deerfield, IL Hybrid
Location
Sr. ServiceNow Consultant / Principal Analyst ...
Location
PLADS Sr Salesforce Developer - Remote - US only
Location
Sr Business System Developer Location:Cleveland, ...
Location
Sr IT Business Analyst, SAP Supply Chain Systems ...
Location
Sr. IT Business Systems Analyst - Sales & Distribu...
Location
Sr JDE Techno-Functional Analyst
Location
Sr. IT Business Systems Analyst - SAP Material Man...
Location
Sr. ABAP Developer - IL Lisle Location:Lisle, IL,...
Location
Sr Benefits Analyst – Health & WelfareLocation:M...
Location
Sr Systems Mainframe Administrator - Omaha, NE
Location
Sr IT Business Analyst, SAP Supply Chain Systems ...
Location
IT Sr. Project Manager - CC&B
Location
Sr. Java Developer Cary, NC
Location
Sr Test Engineer, San Jose, CA
Location
Sr. SAP Supply Chain, Location:West Hollywood, C...
Location
Sr. Cyber Security Consultant, Houston, TX
Location