Responsibilities

• Review & understand business requirements ensuring that development tasks are completed within the timeline & that issues are fully tested with minimal defects
• Partner with software development team to implement best practices & optimize performance of Data applications
• Collaborate across the company and interact with customers to define, design & showcase new concepts & solutions
• Research on new Big Data technologies, assessing maturity & alignment of technology to business & technology strategy  
• Collaborate with developers to ensure that client needs are met
• Work in a rapid and agile development process to enable increased speed to market against a backdrop of appropriate controls  
• Implement good development and testing standards to ensure quality of deliverables
• Understand, translate clients' business challenges and concerns into a solution oriented discussion

Requirements

• At least 2+ years of experience in design and development using Hadoop technology stack and programming languages
• Hands­-on experience in 2 or more areas:
  • Hadoop, HDFS, MR
  • Spark Streaming, Spark SQL, Spark ML
  • Kafka/Flume
  • Apache NiFi
  • Worked with Hortonworks Data Platform
  • Hive / Pig / Sqoop
  • NoSQL Databases ­ HBase/Cassandra/Neo4j/MongoDB
  • Visualisation & Reporting frameworks like D3.js, Zeppellin, Grafana, Kibana Tableau, Pentaho
  • Scrapy for crawling websites
  • Good to have knowledge of Elastic Search

• Ability to visualise technology/industry trends
• Working knowledge of Big Data Integration with Third party/in house built Metadata Management, Data Quality, Master Data Management Solutions, Structured/Unstructured data
• Have been active in the community in terms of articles/blogs/speaking engagements at conference