Technical Lead - Big Data Location: New York ,NY,
Job Description:
The Data Analytics Technical Lead will provide architectural and technical leadership to a growing team focused on delivering cutting edge data intensive analytical platforms &solutions.
A Data Analytics Technical Lead will be responsible for delivery and will take a hands on approach in the design and build phases. The team utilise the latest in Big Data, Cloud, Open source & Data Science tools & techniques.
Major Duties/Responsibilities:
Working with business domain experts to identify detailed data needs, sources, and structure to support solution development. Determining technical approaches to be used, and defining the appropriate methodologies
Providing overall solution architectural leadership including the ability to influence other technical experts and drive teams to align on technical solution options quickly
Must be capable of working in a collaborative, multi-site environment to support rapid development and delivery of results and capabilities (i.e. AGILE SDLC)
Effectively communicating technical analyses, recommendations, status, and results to IT and business management and executives in business terms
Excellent leadership skills: Ability to build effective partnerships with leaders in the businessMinimum.
Required Skills and Education:
Bachelors (IT/Computer Science Preferred); Masterâ??s Degree preferred (IT/Computer Science Preferred) or equivalent experience.
8-10 years of industry experience in analyzing source system data and data flows, working with structured and unstructured data, and delivering data and solution architecture designs.
Experience with clustered/distributed computing systems, such as Hadoop/MapReduce, Spark/SparkR, Lucene/ElasticSearch, Storm, Cassandra, etc.
Experience building new data pipelines from various structured and unstructured sources into Hadoop.
5+ years of experience as a data engineer/solution architect designing and delivering large scale distributed software systems.preferably in large scale global business- preferably using open source tools and big data technologies such as Hadoop, Hive, Prestodb, Impala, HBase, Spark, Storm, Redis, Drill etc.
Strong hands-on experience of programming with Java, Python, Scalaetc.
Experience with SQL, NoSQL, relational database design, and methods for efficiently retrieving data.
Knowledge of Data Warehousing best practices; modeling techniques and processes and complex data integration pipelines.
Experience gathering and processing raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)
Excellent technical skills .
able to effectively lead a technical team of business intelligence and big data developers as well as data analysts.
Optional Skills:
Experience in Machine Learning, Deep Learning, Data Science
Experience with Cloud architecture &service like AWS, Azure
Experience with Graph, Sematic Web, RDF Technologies
Experience with Text Analytics using SOLR or ElasticSearch
A Data Analytics Technical Lead will be responsible for delivery and will take a hands on approach in the design and build phases. The team utilise the latest in Big Data, Cloud, Open source & Data Science tools & techniques.
Major Duties/Responsibilities:
Working with business domain experts to identify detailed data needs, sources, and structure to support solution development. Determining technical approaches to be used, and defining the appropriate methodologies
Providing overall solution architectural leadership including the ability to influence other technical experts and drive teams to align on technical solution options quickly
Must be capable of working in a collaborative, multi-site environment to support rapid development and delivery of results and capabilities (i.e. AGILE SDLC)
Effectively communicating technical analyses, recommendations, status, and results to IT and business management and executives in business terms
Excellent leadership skills: Ability to build effective partnerships with leaders in the businessMinimum.
Required Skills and Education:
Bachelors (IT/Computer Science Preferred); Masterâ??s Degree preferred (IT/Computer Science Preferred) or equivalent experience.
8-10 years of industry experience in analyzing source system data and data flows, working with structured and unstructured data, and delivering data and solution architecture designs.
Experience with clustered/distributed computing systems, such as Hadoop/MapReduce, Spark/SparkR, Lucene/ElasticSearch, Storm, Cassandra, etc.
Experience building new data pipelines from various structured and unstructured sources into Hadoop.
5+ years of experience as a data engineer/solution architect designing and delivering large scale distributed software systems.preferably in large scale global business- preferably using open source tools and big data technologies such as Hadoop, Hive, Prestodb, Impala, HBase, Spark, Storm, Redis, Drill etc.
Strong hands-on experience of programming with Java, Python, Scalaetc.
Experience with SQL, NoSQL, relational database design, and methods for efficiently retrieving data.
Knowledge of Data Warehousing best practices; modeling techniques and processes and complex data integration pipelines.
Experience gathering and processing raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)
Excellent technical skills .
able to effectively lead a technical team of business intelligence and big data developers as well as data analysts.
Optional Skills:
Experience in Machine Learning, Deep Learning, Data Science
Experience with Cloud architecture &service like AWS, Azure
Experience with Graph, Sematic Web, RDF Technologies
Experience with Text Analytics using SOLR or ElasticSearch