Hello everyone,
I am working on a project where we need to integrate multiple data sources into our Apache Kafka ecosystem; We have chosen Lenses io for monitoring & managing our Kafka infrastructure but I want some guidance on best practices, especially when using Kafka Connect to stream data from various sources like databases, REST APIs & other Kafka clusters.
How to optimize Kafka Connect configurations for high throughput data streams.
suggestion for handling schema evolution in Lenses io while using Kafka Connect.
Effective ways to monitor and troubleshoot connector performance within Lenses io.
Any potential pitfalls to avoid when integrating multiple connectors into a single Kafka cluster.
Also i have read this resorse/artical; https://ask.lenses.io/t/how-to-parallelize-sinking-data-from-kafka-to-s3-using-the-lenses-s3-connectoraws-devops but have not found any solution still need your advice. If you have any advice please share with me.
Thank you… 