Lenses GCP Sink connector writing to temp but but not to actual location

General
1

Hi Everyone,

We are experiencing the issue with GCP Sink connector where connector is writing data to tmp folder and data is missing from actual location.

We use following libs:

  • StreamReactor GCP Sink connector 11.1

  • Kafka Version: 4.1.0

  • Java 21

  • Confluent-Connect-Transforms-2.0

In the logs we can see following error message

"event_log": "Unable to resume processOperations: Unexpected end of file from server",

Do you know what might be the issue?

Thanks!

2

Hi @superbrain_bug

Thank you for you question and apologise for slight delay.

We needed to take some time to complete our internal investigation and believe we’ve identified the root cause of the tmp file buildup.

When the GCS upload fails with “Unexpected end of file from server” (a transient network error), the connector retries the operation as expected. However, we believe there is a bug where the local staging file from the failed attempt is not properly cleaned up — each retry creates a new staging file while the previous one remains on disk. With a high number of tasks and continuous upload failures, these orphaned files accumulate and eventually exhaust ephemeral storage.

Our team worked to patch this behaviour and therefore we released Stream Reactor 11.6.1, which should help resolve this issue.

Release Notes: https://docs.lenses.io/latest/connectors/release-notes/stream-reactor#id-11.6.1
Release Artifacts: https://github.com/lensesio/stream-reactor/releases/tag/11.6.1

Best regards,

Ivan