Senior Software Engineer - Data Engineering
4-6 yearsNoidaGraduation/Post Graduation

Responsibilities


  • Review & understand business requirements ensuring that development tasks are completed within the timeline & that issues are fully tested with minimal defects
  • Partner with software development team to implement best practices & optimize performance of Data applications
  • Collaborate across the company and interact with customers to define, design & showcase new concepts & solutions
  • Research on new Big Data technologies, assessing maturity & alignment of technology to business & technology strategy  
  • Collaborate with developers to ensure that client needs are met
  • Work in a rapid and agile development process to enable increased speed to market against a backdrop of appropriate controls  
  • Implement good development and testing standards to ensure quality of deliverables
  • Understand, translate clients' business challenges and concerns into a solution oriented discussion  



Requirements


  • At least 4+ years of experience in design and development using Hadoop technology stack and programming languages
  • Hands­-on experience in 2 or more areas:
  1. Hadoop, HDFS, MR
  2. Spark Streaming, Spark SQL, Spark ML
  3. Kafka/Flume.
  4. Apache NiFi
  5. Worked with Hortonworks Data Platform 
  6. Hive / Pig / Sqoop
  7. NoSQL Databases ­ HBase/Cassandra/Neo4j/MongoDB
  8. Visualisation & Reporting frameworks like D3.js, Zeppellin, Grafana, Kibana Tableau, Pentaho
  9. Scrapy for crawling websites
  10. Good to have knowledge of Elastic Search
  11. Good to have understanding of Google Analytics data streaming
  12. Data security (Kerberos/Open LDAP/Knox/Ranger)
  • Ability to visualise technology/industry trends
  • Working knowledge of Big Data Integration with Third party/in house built Metadata Management, Data Quality, Master Data Management Solutions,Structured/Unstructured data
  • Have been active in the community in terms of articles/blogs/speaking engagements at conferences


Senior Software Engineer - Data Engineering
Only .doc, .docx or .pdf file accepted
CAPTCHA
Please verify that you are not a robot.