BigData Lead

Manage one or more Applications to accomplish established goals as well as conduct personnel duties for team like hiring and training.
Design and develop real time and batch data transformation processes using wide range of technologies using Hadoop, Spark Stream, Spark SQL, Hive etc.
Design and Develop programs to build functionalities, in the next generation Big-data platform which is also authorize data redistributor.
Ability to translate architecture and low-level requirements to design and code using Big-data tools and processes.
Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
Review and analyze proposed technical solutions for projects
Impact the Applications Development area through monitoring delivery of end results, participate in budget management, and handling day-to-day staff management issues, including resource management and allocation of work within the team/project
Ensure essential procedures are followed and contribute to defining standards negotiating with external parties when necessary
Qualifications:
Must have - Sr. development resource with experience in Java/J2EE, Hadoop, Scala, Hive, Impala, Kafka and Elastic to resolve data concerns and implement data remediation requirements.
Must have - Hands-On Experience in managing application development using Spark (Scala, Python or Java), SQL, Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.)
Understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop.
Good knowledge of design patterns and providing solutions to complex design issues, identification and resolution of code issues.
Proficiency in enterprise level messaging infrastructure like Solace, Kafka, Tibco EMS.
Relational SQL and NoSQL database integration and data distribution principles experience
Align to Engineering Excellence Development principles and standards.