Hey everyone,
I have started working with Kafka Connect & I am trying to get a better grasp on how these connectors handle retries & failures. I am using a JDBC Sink Connector to push data into a Postgres DB & sometimes when the DB is under load or there’s a schema issue, I am not entirely sure what happens behind the scenes.
Does Kafka just keep retrying endlessly until the issue is resolved? Or is there a config I should be tweaking to handle backoffs and retries more gracefully?
Also, is there a common way you guys monitor or log these failures effectively? The logs feel a bit too verbose at times & I do not want to miss important stuff.
I have been learning this stuff hands-on, though I did skim some Kafka sections in an AWS Developer Course but it did not dive too deep into connectors.
Also i have check this I can’t create or see a Kafka Connect Connector with my user in Lenses still want clarity Any tips, best practices or I learned this the hard way stories would be super helpful.
Thanks 