Share this Job

Specialist - Data Engineering

Apply now »

Date: Aug 6, 2022

Location: Edison, NJ, US

Company: Larsen & Toubro Infotech Ltd

Mandatory Certification (Any one) : Kafka- Confluent Certified Administrator for Apache Kafka Kafka- Confluent Certified Developer for Apache Kafka Talend- Talend Data Integration v6 Certified Developer Apache Spark- Cloudera - CCA Spark and Hadoop Developer (CCA175) Apache Spark- Databricks Certified Developer: Apache Spark 2.X Apache Spark- Hortonworks - HDP Certified Apache Spark Developer Senior Kafka Streaming Specialist (Hands-on) – VP: Job Description Seeking a Senior Specialist with strong hands-on experience in Kafka, event streaming and adoption of Apache Kafka within the organization for mission critical applications. The role is not limited and extends to other messaging products such as RabbitMQ. The engineer will be responsible for the safe deployment and maintenance of Apache Kafka messaging services and other messaging products. They will ensure that monitoring is in place for the early detection of issues, and that systems are resilient and have capacity to deal with changing demands. We have a growing number of messaging products and this role will require setting standards for proper usage of products like Confluent Cloud, Amazon MSK as well as other cloud native messaging technologies. The work will include strategic state-of-the-art solutions using new stack development in the areas of middleware, messaging, highly reliable and available solutions, 24x7 and elastic scaling. Responsibilities: • The Kafka Messaging Engineer will design and engineer automated solutions for installation, patch/configuration management for Streaming products • Understand & update existing automation programs and develop new programs for deploying and managing core & emerging messaging software (Confluent Kafka, IBM Streams etc.) • Work closely with Application Development/Support teams to understand the usage of messaging protocols within application software. • Analyze IT security standards and policies for multiple projects of high complexity. • Communicate continually with the client and project teams – Clarify client’s needs, present tech team ideas and explains progress on the development efforts. • Contributes to continual improvement by suggesting improvements to software architecture, software development process and new technologies etc. • Help define operating standards and processes • Act as technical advisor or coach to junior members in the team. Technology Skills: • Proficient in Kafka/Confluent and Streaming Design Patterns and use-cases • Proven Experience developing and supporting Kafka integrations, including topics, producers, consumers and streaming (KStream and KTable) applications • Preferred experience with Confluent connect, confluent KSQL, and confluent Schema registry • Proven experience debugging and fixing streaming jobs by looking at debug logs and configuration tuning • Experience with design patterns for cloud services such as data storage and retrieval, data security management • Advanced Proficiency in Java/J2EE and Web Services development • Broadbased experience in one or more languages like Ruby, JavaScript, Scala, and Node.js • Preferred experience in Microservices Architectures best practices • Preferred experience with JMS, REST API, SOAP, JSON, XML, message queues, and Integration Pattern / frameworks, Kubernetes, Apache camel • Should have working knowledge and understanding of Containerization like Docker, Openshift • Experience with load balancing, horizontal scalability and high availability • Good exposure to Agile software development and DevOps practices, Continuous Integration and automated deployment, with working knowledge of BitBucket, Teamcity, uDeploy, SonarQube • Preferred Experience with cloud based relational and NoSQL databases architecture, and data • Nice to have: Experience as AWS Solutions Architect, Cloud Security Certification (other clouds-related certification), Swowflake • Nice to have: Experience with banking, especially high volume trans


Nearest Major Market: New Jersey

Job Segment: Cloud, Developer, Solution Architect, Java, Middleware, Technology