Associate Data Engineering Lead
6-8 yearsNoidaGraduation/Post Graduation

Responsibilities

  • Review and understand business requirements ensuring that development tasks are completed within the timeline provided and that issues are fully tested with minimal defects
  • Partner with software development team to implement best practices and optimize performance of Data applications
  • Collaborate across the company and interact with our customers to define, design and showcase new concepts and solutions
  • Research on new Big Data technologies, assessing maturity and alignment of technology to business and technology strategy
  • Collaborate with other developers to ensure that client needs are met at all times
  • Work in a rapid and agile development process to enable increased speed to market against a backdrop of appropriate controls
  • Implement good development and testing standards to ensure quality of deliverables
  • Rapidly understand and translate clients’ business challenges and concerns into a solution oriented discussion

Requirements

Must Have:
  • At least 6+ years of total IT experience
  • At least 4+ years of experience in design and development using Hadoop technology stack and programming language
  • Hands­-on experience in 2 or more areas:
  • Hadoop, HDFS, MR
  • Spark Streaming, Spark SQL, Spark ML
  • Kafka/Flume.
  • Apache NiFi
  • Worked with Hortonworks Data Platform 
  • Hive / Pig / Sqoop
  • NoSQL Databases ­ HBase/Cassandra/Neo4j/MongoDB
  • Visualisation & Reporting frameworks like D3.js, Zeppellin, Grafana, Kibana Tableau, Pentaho
  • Scrapy for crawling websites
  • Good to have knowledge of Elastic Search
  • Good to have understanding of Google Analytics data streaming.
  • Data security (Kerberos/Open LDAP/Knox/Ranger)
    • Should have a very good overview of the current landscape and ability to visualise technology and industry trends
    • Working knowledge of Big Data Integration with Third party/in-house built Metadata Management, Data Quality, Master Data Management Solutions,Structured/Unstructured data
    • Have been active in the community in terms of articles/blogs/speaking engagements at conferences
    Associate Data Engineering Lead
    Upload CV*
    Only .doc, .docx or .pdf file accepted
    CAPTCHA
    Please verify that you are not a robot.