Technical Lead - Data Engineering
8-10 yearsNoidaGraduation/Post Graduation

 

Responsibilities:  
  • Define client needs, oversee project milestones to ensure expectations, budgets are met
  • Define data platform architecture & design; Review code & make changes  
  • Leverage knowledge of distributed systems, process flows & procedures to aid analyses & recommendations for solution offerings  
  • Responsible for the overall quality of project deliverables & successful implementation of defined solution  
  • Build superior client relationships & proactively manage client expectations, ensure that change control is used when scope boundaries are exceeded  
  • Communicate a compelling & inspired vision to all customer levels, from CTOs/CIOs, to engineering managers and programmers   
  • Maintain strong network & promote us at various meetings, forums, panels, publications, conferences to establish thought leadership in industry  
  • Responsible for POCs on any tech stacks introduced, or possible version upgrades  


Requirements

  • 8+ years experience in design & development using various database technologies with recent 4+ years associated with Hadoop technology stack & programming languages 
  • Hands­-on/Technical lead experience in 2 or more areas:  
  1. Hadoop, HDFS, MR  
  2. High Availability architecture and DR setup  
  3. Spark Streaming, Spark SQL, Spark ML  
  4. Kafka/Flume  
  5. Apache NiFi  
  6. Worked with Hortonworks Data Platform as Architect CDH (Cloudera Distribution for Hadoop) as developer/administrator  
  7. Hive/Pig/Sqoop  
  8. NoSQL Databases HBase/Cassandra/Neo4j/MongoDB  
  9. Visualisation & Reporting frameworks like D3.js, Zeppelin, Grafana, Kibana Tableau, Pentaho  
  10. Scrapy for crawling websites  
  11. Good to have knowledge of Elastic Search  
  12. Good to have understanding on Google Analytics data streaming  
  13. Data security (Kerberos/OpenLDAP/Knox/Ranger)  
  • Knowledge of Big Data Integration with Third party/in house built Metadata Management, Data Quality, Master Data Management Solutions, Structured/Unstructured data  
  • Been active in terms of speaking engagements at conferences   


Technical Lead - Data Engineering
Only .doc, .docx or .pdf file accepted
CAPTCHA
Please verify that you are not a robot.