Search before asking
What happened
When the task fails due to issues like 'no such file' or 'file is empty', the sftp connection didn't release.
Task mode is yarn-session.

What you expected to happen
Connection is released.
How to reproduce
- Create a task which source is 'sftp'.
- The file that need to be synced is empty or not exist.
{
"job": {
"content": [
{
"reader": {
"parameter": {
"path": "/root/tiezhu/test_two.csv",
"protocol": "SFTP",
"password": "Abc!@#135",
"port": 22,
"isFirstLineHeader": true,
"host": "172.16.85.171",
"column": [
{
"name": "id",
"type": "int"
},
{
"name": "name",
"type": "string"
}
],
"fieldDelimiter": ",",
"encoding": "utf-8",
"fileType": "CSV",
"username": "root"
},
"name": "ftpreader"
},
"writer": {
"parameter": {
"print": true
},
"name": "streamwriter"
}
}
]
}
}
Anything else
NONE
Version
master
Are you willing to submit PR?
Code of Conduct
Search before asking
What happened
When the task fails due to issues like 'no such file' or 'file is empty', the sftp connection didn't release.
Task mode is yarn-session.
What you expected to happen
Connection is released.
How to reproduce
{ "job": { "content": [ { "reader": { "parameter": { "path": "/root/tiezhu/test_two.csv", "protocol": "SFTP", "password": "Abc!@#135", "port": 22, "isFirstLineHeader": true, "host": "172.16.85.171", "column": [ { "name": "id", "type": "int" }, { "name": "name", "type": "string" } ], "fieldDelimiter": ",", "encoding": "utf-8", "fileType": "CSV", "username": "root" }, "name": "ftpreader" }, "writer": { "parameter": { "print": true }, "name": "streamwriter" } } ] } }Anything else
NONE
Version
master
Are you willing to submit PR?
Code of Conduct