Skip to content

Move the pulsar-io.yaml file in kafka-connect-adaptor-nar to correct location - #10072

Merged
merlimat merged 1 commit into
apache:masterfrom
lhotari:lh-fix-kafka-connect-adaptor-pulsar-io-yaml
Mar 30, 2021
Merged

Move the pulsar-io.yaml file in kafka-connect-adaptor-nar to correct location#10072
merlimat merged 1 commit into
apache:masterfrom
lhotari:lh-fix-kafka-connect-adaptor-pulsar-io-yaml

Conversation

@lhotari

@lhotari lhotari commented Mar 29, 2021

Copy link
Copy Markdown
Member

Motivation

This exception shows up in Functions Worker start up:

12:49:48.865 [main] WARN  org.apache.pulsar.functions.utils.io.ConnectorUtils - Failed to load connector from /pulsar/./c
onnectors/pulsar-io-kafka-connect-adaptor-nar-2.8.0-SNAPSHOT.nar
java.nio.file.NoSuchFileException: /tmp/pulsar-nar/pulsar-io-kafka-connect-adaptor-nar-2.8.0-SNAPSHOT.nar-unpacked/META-I
NF/services/pulsar-io.yaml
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86) ~[?:1.8.0_282]
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:1.8.0_282]
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:1.8.0_282]
        at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214) ~[?:1.8.0_282]
        at java.nio.file.Files.newByteChannel(Files.java:361) ~[?:1.8.0_282]
        at java.nio.file.Files.newByteChannel(Files.java:407) ~[?:1.8.0_282]
        at java.nio.file.Files.readAllBytes(Files.java:3152) ~[?:1.8.0_282]
        at org.apache.pulsar.common.nar.NarClassLoader.getServiceDefinition(NarClassLoader.java:219) ~[org.apache.pulsar-
pulsar-common-2.8.0-SNAPSHOT.jar:2.8.0-SNAPSHOT]
        at org.apache.pulsar.functions.utils.io.ConnectorUtils.getConnectorDefinition(ConnectorUtils.java:102) ~[org.apac
he.pulsar-pulsar-functions-utils-2.8.0-SNAPSHOT.jar:2.8.0-SNAPSHOT]
        at org.apache.pulsar.functions.utils.io.ConnectorUtils.searchForConnectors(ConnectorUtils.java:154) [org.apache.p
ulsar-pulsar-functions-utils-2.8.0-SNAPSHOT.jar:2.8.0-SNAPSHOT]
        at org.apache.pulsar.functions.worker.ConnectorsManager.<init>(ConnectorsManager.java:41) [org.apache.pulsar-puls
ar-functions-runtime-2.8.0-SNAPSHOT.jar:2.8.0-SNAPSHOT]
        at org.apache.pulsar.functions.worker.PulsarWorkerService.start(PulsarWorkerService.java:447) [org.apache.pulsar-
pulsar-functions-worker-2.8.0-SNAPSHOT.jar:2.8.0-SNAPSHOT]
        at org.apache.pulsar.functions.worker.Worker.start(Worker.java:67) [org.apache.pulsar-pulsar-functions-worker-2.8
.0-SNAPSHOT.jar:2.8.0-SNAPSHOT]
        at org.apache.pulsar.functions.worker.FunctionWorkerStarter.main(FunctionWorkerStarter.java:67) [org.apache.pulsa
r-pulsar-functions-worker-2.8.0-SNAPSHOT.jar:2.8.0-SNAPSHOT]

It turns out that the location for pulsar-io.yaml in pulsar-io-kafka-connect-adaptor-nar-2.8.0-SNAPSHOT.nar isn't correct. This change happened in PR #9808 .

Modifications

move pulsar-io.yaml from src/main/resources/services to src/main/resources/META-INF/services directory.

@lhotari lhotari changed the title Move pulsar-io.yaml file to correct location Move the pulsar-io.yaml file in kafka-connect-adaptor-nar to correct location Mar 29, 2021
@lhotari

lhotari commented Mar 29, 2021

Copy link
Copy Markdown
Member Author

/pulsarbot run-failure-checks

@merlimat merlimat added this to the 2.8.0 milestone Mar 30, 2021
@merlimat
merlimat merged commit 323207c into apache:master Mar 30, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants