Please scroll down, To apply
Contract job opportunity--Kafka Admin - remote
E-Solutions, Inc.
2021-12-03 08:58:50
Carlisle, Massachusetts, United States
Job type: fulltime
Job industry: Administration
Job description
Position- Kafka Admin (With Linux Experience)
Location: Fully Remote
Job-Type- Contract
Job Description-
Client is a leading provider of platforms, digital innovation, artificial Intelligence and end-to-end IT & Business services and solutions for Global 1000 companies. We are transforming corporations through deep domain expertise, knowledge-based ML platforms, as well as profound anthropological efforts to understand the end customer and design products and interactions that create delight. We are deeply committed to developing a comprehensive understanding of our clients' problems and to develop platforms to address them.
Responsibilities:
- Manage large scale multi-nodes Kafka cluster environments residing on Linux.
- Experience with Linux environments/administration
- Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring.
- Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka Cluster.
- Creation of key performance metrics, measuring the utilization, performance and overall health of the cluster.
- Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure.
- Research and recommend innovative, and where possible, automated approaches for system administration tasks.
- Ability to closely calibrate with product managers and lead engineers.
- Provide guidance in the creation and modification of standards and procedures
- Create topics, setup redundancy cluster, deploy monitoring tools, alerts
- Proactively monitor and setup alerting mechanism for Kafka Cluster and supporting hardware to ensure system health and maximum availability
- Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka cluster
- Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring.
- Manage large scale multi-nodes cluster environments residing on AWS
- Provide technical expertise and guidance to production support staff.
- Partner with business units in order to improve the effectiveness of business decision
Qualifications:
- 5+ years of solid Kafka Admin experience
- Design, build, assemble, and configure application or technical architecture components using business requirements.
- Hands-on experience with Kafka clusters hosted on Amazon cloud is a plus.
- Experience in Kafka build pipelines using Ansible, Cloud formation templates, shells etc.
- Experience in Jenkins, GitHub
- Experience in implementing security & authorization (permission based) on Kafka cluster.
- Experience in open source Kafka, zookeepers, Kafka connect, schema registry Avro schemas.
- High availability cluster setup, maintenance and ongoing support
- Has good knowledge of best practices
- Hands on experience in standing up and administrating Kafka platform which includes creating a backup & mirroring of Kafka Cluster brokers, broker sizing, topic sizing, h/w sizing, performance monitoring, broker security, topic security, consumer/producer access management(ACL)
- Knowledge of Kafka API (development experience is a plus)
- Knowledge of best practices related to security, performance, and disaster recovery.
- Comfortable performing in a fast paced, dynamic and ambiguous business environment.
- Ability to concentrate on a wide range of loosely defined complex situations, which require creativity and originality, where guidance and counsel may be unavailable.
- Demonstrate a product mindset with an ability to set forward thinking and direction.
- Excellent listening and communication skills.
- Must be able to communicate technical information clearly, able to 'translate' between diverse groups of technical and non-technical individuals.
- Ability to synthesize large amounts of complex data into meaningful conclusions and present recommendations to a vast array of individuals.
- Ability to structure documents to effectively communicate with senior leadership and drive alignment and decision making.
- Strong problem solving skills with the ability to offer why one technical solutions is more preferable than another.
- Ability to analyze and interpret complex concepts.
- Ability to work in a team environment in a collaborative manner.
- Proven track record of sound, effective decision making.
Education-
Bachelor's Degree required
- provided by Dice