Technical Lead - Data Engineering
8-12 yearsNoidaGraduation/Post Graduation

Responsibilities

  • Define client needs and oversee project milestones to ensure expectations, timelines, and budgets are met
  • Define data platform architecture, design, and review code and make required changes
  • Will be responsible for the overall quality of project deliverables and the successful implementation of defined solution for the customer
  • Building long-term and superior client relationships, proactively managing client expectations and ensuring that change control is used when scope boundaries are exceeded
  • Communicate a compelling and inspired vision to all customer levels, from CTOs/CIOs to engineering managers and programmers.
  • Maintain a strong network and promote the organization at various meetings, forums, panels, publications, and conferences to establish thought leadership in the industry
  • Responsible for POCs on any tech stacks introduced, or possible version upgrades.

Requirements

  • Leverage extensive knowledge of distributed systems, process flows, and procedures to aid analyses and recommendations for solution offerings
  • Hands­-on and technical experience in 4 or more areas:
    • Hadoop, HDFS, MR
    • Spark Streaming, Spark SQL, Spark ML
    • Kafka/Flume.
    • Apache NiFi, Apache Airflow
    • Hive / Pig / Sqoop
    • NoSQL Databases ­ HBase/Cassandra/Neo4j/MongoDB
    • Performance Optimization
    • Good to have knowledge of Elastic Search
    • Good to have an understanding of Google Analytics data streaming.
    • Data security (Kerberos/Open LDAP/Knox/Ranger)
  • Should have  a good overview of the current landscape and the ability to visualize technology and industry trends
  • Working knowledge of Big Data Integration with Third-party / in-house built Metadata Management, Data Quality, Master Data Management Solutions, Structured/Unstructured data
  • Have been active in the community in terms of articles/blogs/speaking engagements at conferences
Technical Lead - Data Engineering
Upload CV*
Only .doc, .docx or .pdf file accepted
CAPTCHA
Please verify that you are not a robot.