Job Openings

Big Data Lead

Twitter Facebook
Location
New York City, NY
Salary
$150,000 - $170,000
Job Type
Direct Hire
Degree
Bachelor of Science
Date
Jun 01, 2017
Job ID
2482050
Essential Functions:

 
  • As the Big Data Platform Lead, you will define, architect and implement platform wide strategy that meets the needs of customer-facing applications, Data Engineering and Data Science teams.
  • You will define, implement and manage performance, scalability, high availability data pipelines and build scalable and performant dataplatforms.  
  • Lead and define data platform architectures for strategic data platforms including Hadoop, noSQL and document stores.
  • Facilitate multi-tenant ETL Flows to process raw data at scale (including scripting, interfacing with and providing APIs, write SQL queries, etc.).
  • Enhance Data Lake Implementation and work out algorithms to process insight realization with significantly large data payloads
  • Implement massively parallel, distributed computing and resilient architecture 
 Requirements:
•   8 + years of hands-on experience with designing and implementing large-scale, highly available, and extensible software solutions in Big  Data and  Business Intelligence space.
•   Proven track record of leading enterprise and solution architecture implementation and adoption
•   Extensive experience in data in motion and data at rest integration technologies and architecture patterns
•    Hands-on proficiency with OLTP, Data warehousing, data lake platform architecture and engineering
•  Credible experience in data architecture and design, including relational databases, No- Sql , analytics and big data
•   Thorough knowledge of infrastructure architecture design, including cloud-based infrastructure
•    Multiple years of prior experience in application and/or database programming in multiple programming languages and technologies like Hadoop, Scala, Kafka, Pig, Hive, SQL, etc.
•   Fluent knowledge of architecture modeling, including and beyond UML and BPMN, and related tools
•   Advanced knowledge of multi-threading concepts.
•   Experience with agile development methodologies (Scrum or similar) is a plus.
•   Experience with Apache Spark, Kafka. 
Qualifications
•   Demonstrated Technical leadership experience in Software Engineering with enterprise architecture and Product Development
•  BS, MS or  PhD  in Computer Science or related field
•  At least 4+ years of experience in dealing with Big Data ecosystems.
Essential Functions:

 
  • As the Big Data Platform Lead, you will define, architect and implement platform wide strategy that meets the needs of customer-facing applications, Data Engineering and Data Science teams.
  • You will define, implement and manage performance, scalability, high availability data pipelines and build scalable and performant dataplatforms.  
  • Lead and define data platform architectures for strategic data platforms including Hadoop, noSQL and document stores.
  • Facilitate multi-tenant ETL Flows to process raw data at scale (including scripting, interfacing with and providing APIs, write SQL queries, etc.).
  • Enhance Data Lake Implementation and work out algorithms to process insight realization with significantly large data payloads
  • Implement massively parallel, distributed computing and resilient architecture 
 Requirements:
•   8 + years of hands-on experience with designing and implementing large-scale, highly available, and extensible software solutions in Big  Data and  Business Intelligence space.
•   Proven track record of leading enterprise and solution architecture implementation and adoption
•   Extensive experience in data in motion and data at rest integration technologies and architecture patterns
•    Hands-on proficiency with OLTP, Data warehousing, data lake platform architecture and engineering
•  Credible experience in data architecture and design, including relational databases, No- Sql , analytics and big data
•   Thorough knowledge of infrastructure architecture design, including cloud-based infrastructure
•    Multiple years of prior experience in application and/or database programming in multiple programming languages and technologies like Hadoop, Scala, Kafka, Pig, Hive, SQL, etc.
•   Fluent knowledge of architecture modeling, including and beyond UML and BPMN, and related tools
•   Advanced knowledge of multi-threading concepts.
•   Experience with agile development methodologies (Scrum or similar) is a plus.
•   Experience with Apache Spark, Kafka. 
Qualifications
•   Demonstrated Technical leadership experience in Software Engineering with enterprise architecture and Product Development
•  BS, MS or  PhD  in Computer Science or related field
•  At least 4+ years of experience in dealing with Big Data ecosystems.