We are looking for talented and engaged Big-Data Engineer to join our growing R&D team. Our infrastructure supports
hundreds of big data applications across dozens of products. Engineers are our customers along with their fellow
MeritB2B’ers, and our job is to work closely with them to support building efficient applications.
DUTIES AND RESPONSIBILITIES:
• Write code in Python, Scala and Cpp.
• Be responsible for developing & managing our Spark/Big Data environments.
• Be responsible for integrating big data solutions into SAAS platforms via API/Webhooks etc
• Responsible for writing high-performance, reliable and maintainable code
• Maintain security and data privacy
• Schedule and monitor data pipelines using Airflow
• Design and develop process’s automation tools such as Jenkins
• Closely work with and iterate on feedback from your customers — other developers. You err on
the side of shipping fast and iterating
• End to End integrations with internal and partner platforms
SKILLS & REQUIREMENTS:
• Bachelor’s or master’s degree in Software Engineering, Computer Science or a related field
• Communication skills: strong writing and data presentation skills, including data visualization.
• Self-starter: ability to take the initiative and work independently
• 2+ years advance, continuous, current experience developing in Big-Data engineering
• Solid work experience using AWS technologies (ECS, lambda, S3, EMR, PrestoDB )
• 2+ years of experience with NoSQL implementation, including stream processing
• You keep up to date with cutting edge big data frameworks; you enjoy digging into the tradeoffs
of Spark vs Flink vs MapReduce for a new project
• Strong teamwork orientation, good interpersonal skills
• Experience owning a project from concept to production, including proposal, discussion, and execution
• You get excited by when you make an application more efficient – but you get even more excited when you help
others be more efficient
• Enthusiasm for, and commitment to, development work.
Data Engineer- Bangalore- 3 to 8 years- Upto 22 Lakhs- Python, Scala, Airflow and Spark Mandatory