Application Developer
We are looking for a Lead Confluent/Kafka Engineer for a contract-to-hire opportunity that is full-time and fully remote.
What You’ll Do
- Architect and design scalable, fault-tolerant, and high-performance Kafka-based data streaming solutions
- Lead technical design sessions and provide architectural guidance to junior engineers
- Develop and maintain Confluent Platform components, including Kafka Connect, Kafka Streams, Flink, TableFlow and ksqlDB
- Implement and manage monitoring and alerting systems for the Kafka cluster
- Lead troubleshooting and resolution of complex issues within the data streaming platform
- Perform root cause analysis and implement corrective actions to prevent future occurrences
- Mentor and guide junior engineers
- Collaborate with other engineering teams to integrate data streams into their applications
- Develop and maintain comprehensive documentation for the data streaming platform
- Provide technical leadership and guidance on best practices
- Participate in code reviews and ensure adherence to coding standards and best practices
- Proactively identify and address potential performance bottlenecks and scalability issues
- Contribute to continuous improvement initiatives
- Stay up to date on the latest Confluent Platform and Kafka technologies
What You’ll Need
Required:
- Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred.
- 5+ years of experience with Confluent Platform and Kafka, including experience in designing and implementing large-scale data streaming solutions
- Experience as a developer/operator of the Kafka technology (NOT interested in candidates who set up clusters for others to use)
- Must have real-world experience setting up after Kafka real-time data streaming
- Proficient in Java or other JVM languages (e.g., Scala, Kotlin)
- Experience with Kafka Connect, Kafka Streams, and ksqlDB. Strong understanding of Kafka architecture and concepts (topics, partitions, consumers, producers)
- Experience with message queuing systems
- Familiarity with cloud-based environments (AWS, Azure, GCP)
- Excellent problem-solving and debugging skills
- Experience with CI/CD
- Experience leading and mentoring engineering teams
- Strong architectural skills
- Experience with performance tuning and optimization
- Experience with schema registries (e.g., Avro)
- Ability to work independently and as part of a team
- Excellent communication and collaboration skills
Preferred:
- Confluent Certified Engineer
- Experience with other streaming technologies (e.g., Spark Streaming, Flink)
- Experience with containerization technologies (e.g., Docker, Kubernetes)
- Experience with data visualization and analytics tools
Physical Demands
- Ability to safely and successfully perform the essential job functions consistent with the ADA and other federal, state, and local standards
- Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc.
- Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor