Is it possible to configure the S3 source connector to delete S3 objects after they’ve been read and written to the Kafka topic?
Hi fekiwack,
This feature is not supported at the moment. We welcome contributions - the code is open source.
Regards,
Stefan
1 Like
@fejiwack - can you explain your specific use case a little bit and why this is important.
Sure thing. I’m looking to stream analytics data in AWS which lands in S3. Once this data is retrieved by the connector and sent to the Kafka topic it is no longer needed. In the meantime I can just write a lambda that clears it out periodically.