Position Description

• Bachelor's Degree or Master’s Degree with 3+ years of experience in Computer Science or related field.
• Experience in ETL and Expertise in SQL.
• Expertise in Big Data Ecosystem with experience in Hadoop, Hive, Spark.
• Knowledge of NoSQL DB’s.
• Expertise in MPP architecture and knowledge of MPP engine (Spark, Impala etc).
• Experience in building scalable/highly available distributed systems in production.
• Understanding of stream processing with knowledge on Kafka.
• Knowledge of Software Engineering best practices with experience on implementing CI/CD, Log aggregation/Monitoring/alerting for production system.
• Good level of Expertise in production support related activities (issue identification, resolution

Position Responsibility

• Solve business and data engineering problems using data-centric programming and scripting skills to create data models and pipelines.
• Lead all phases of architecture, conceptualization, design, development, testing, and production support of BI solutions.
• Architect, design, and build best-of-class production processes that ensure security, efficiency, and availability of analytic tools and data.
• Collaborate with data scientists and analyst to further understand business problems.
• Program and manage APIs for data exchange.
• Lead and conduct unit and system testing to ensure design is still relevant and implementation is producing a useful, maintainable, reliable product.
• Mentor and train other team members by introducing them to new technologies, methods and learning resources.
• Act as a resource to technical community as well as business partners.