listpeers connected:false, can't find route, can't reconnect

[stumpy-de]

I've been following this guide and got to the point of funding transactions. There are 6 confirms, but all my peers say they aren't connected.

lightning-cli getinfo
{ "id" : "02e40b82365cd2a3908a481b712ba09858a5dee4cac997351db6cbaa175129907b", "port" : 9735, "address" :
	[  ], "version" : "v0.5.2-2016-11-21-1646-g73c3175", "blockheight" : 505921, "network" : "bitcoin" }

 lightning-cli listfunds
{ "outputs" :
	[
		{ "txid" : "98b96a4ad21327e7a6b05b07205facba8b7bf14e2112e9e3741ca68ed18af55e", "output" : 1, "value" : 183828 },
		{ "txid" : "f559a73ebe8c650e5e0abbe885608327b39e49c291a87d23c091234852e02181", "output" : 0, "value" : 88059 },
		{ "txid" : "9c9b4926556c14882f020480a2bd8f89d831c2d88da78269628c410dc7c86106", "output" : 1, "value" : 353851 },
		{ "txid" : "1862dddc659edfca057e524670c66ec2a15893e6baa623cb40235b7d5fc4f3e3", "output" : 0, "value" : 292398 } ] }

lightning-cli listpeers
{ "peers" :
	[
		{ "id" : "0371190acfb2e92bd1faa6ce4d12ff248798515a92ac903ac14d31b5172d9b2917", "connected" : false, "channels" :
			[
				{ "state" : "ONCHAIND_THEIR_UNILATERAL", "owner" : "lightning_onchaind", "short_channel_id" : "505883:564:0", "funding_txid" : "9c9b4926556c14882f020480a2bd8f89d831c2d88da78269628c410dc7c86106", "msatoshi_to_us" : 300000000, "msatoshi_total" : 300000000, "dust_limit_satoshis" : 546, "max_htlc_value_in_flight_msat" : 18446744073709551615, "channel_reserve_satoshis" : 0, "htlc_minimum_msat" : 0, "to_self_delay" : 144, "max_accepted_htlcs" : 483 } ] },
		{ "id" : "022d065a059294ff8796cf0b9df467ba76420c62eda92771a4063d15e7170020e0", "connected" : false, "channels" :
			[
				{ "state" : "ONCHAIND_THEIR_UNILATERAL", "short_channel_id" : "505730:2010:0", "funding_txid" : "326d8c97c7ccd707328d0634cec19f983179f74b33f3eb6ee83f9950e7afdbc3", "msatoshi_to_us" : 300000000, "msatoshi_total" : 300000000, "dust_limit_satoshis" : 546, "max_htlc_value_in_flight_msat" : 18446744073709551615, "channel_reserve_satoshis" : 0, "htlc_minimum_msat" : 0, "to_self_delay" : 144, "max_accepted_htlcs" : 483 } ] },
		{ "id" : "022d065a059294ff8796cf0b9df467ba76420c62eda92771a4063d15e7170020e0", "connected" : false, "channels" :
			[
				{ "state" : "OPENINGD", "dust_limit_satoshis" : 0, "max_htlc_value_in_flight_msat" : 0, "channel_reserve_satoshis" : 0, "htlc_minimum_msat" : 0, "to_self_delay" : 0, "max_accepted_htlcs" : 0 } ] },
		{ "id" : "022d065a059294ff8796cf0b9df467ba76420c62eda92771a4063d15e7170020e0", "connected" : false, "channels" :
			[
				{ "state" : "OPENINGD", "dust_limit_satoshis" : 0, "max_htlc_value_in_flight_msat" : 0, "channel_reserve_satoshis" : 0, "htlc_minimum_msat" : 0, "to_self_delay" : 0, "max_accepted_htlcs" : 0 } ] } ] }

When I run connect, one of the channels works and one does not, even though they are both online. The one that fails, lightning-cli connect 0371190acfb2e92bd1faa6ce4d12ff248798515a92ac903ac14d31b5172d9b2917 176.9.113.240 9735, returns "channel ALL: Funding transaction spent".

I'm not able to route payments to the Blockchain store.

Additionally, when I run bitcoin-cli getwalletinfo, I have a balance of 0, even though I sent .01 to the lightning wallet. Not sure if that's normal.

root@lightning-node:~# bitcoin-cli getwalletinfo
{
  "walletname": "wallet.dat",
  "walletversion": 139900,
  "balance": 0.00000000,
  "unconfirmed_balance": 0.00000000,
  "immature_balance": 0.00000000,
  "txcount": 0,
  "keypoololdest": 1516633691,
  "keypoolsize": 1000,
  "keypoolsize_hd_internal": 1000,
  "paytxfee": 0.00500000, ...

lightning-cli listpayments
{ "payments" :
	[
		{ "id" : 1, "payment_hash" : "d35449ef3357f00ba92398d6d418782fb2b20839902e633c9f907d60e9d621f2", "destination" : "02f6725f9c1c40333b67faea92fd211c183050f28df32cac3f9d69685fe9665432", "msatoshi" : 93767318, "timestamp" : 1516721481, "created_at" : 1516721481, "status" : "failed" } ] }

Thanks in advance for your help!

[BTCxZelko]

Having same issue with connected:false

Any help would be great

[fenix2222]

Same here

[cdecker]

"connected": false indicates that the TCP connection underlying the channel has been lost or closed, by one of the two endpoints. This can happen for a variety of reasons and should be ok to recover from. Some nodes decided to further close the channel if the other endpoint was disconnected long enough, hence the ONCHAIND_THEIR_UNILATERAL state for some of the channels.

If the channel was closed, any new connection will attempt to reestablish the channel, but it'll fail since we are now in the settlement phase. Since we can't reestablish the channel we also disconnect again. This is the connect failure you are getting.

Once the channel has been irrevocably settled, which depends on the state of the channel at closure, both endpoints should forget about the channel and a new channel can be established. Notice that this can take up to a day.

As for bitcoind not knowing about the funds, that's correct, since lightningd implements its own wallet and tracks its own outputs.

[cdecker]

As for the route finding issue, that should be fixed by #756

[fenix2222]

The problem is that I just can't get it to "connected: true" state once the channel is funder. It is always false for 2 differrent channels I tried with different nodes. Once channel is funded it goes to that disconnected state and I am left with a channel that is useless and have to now wait (I am guessing) 144 blocks ~ 24 hours for it to close.

[stumpy-de]

@cdecker thank you for the reply!

I connected to 2 new nodes:

lightning-cli listpeers
{ "peers" :
	[
		{ "id" : "022d065a059294ff8796cf0b9df467ba76420c62eda92771a4063d15e7170020e0", "connected" : false, "channels" :
			[
				{ "state" : "ONCHAIND_THEIR_UNILATERAL", "short_channel_id" : "505730:2010:0", "funding_txid" : "326d8c97c7ccd707328d0634cec19f983179f74b33f3eb6ee83f9950e7afdbc3", "msatoshi_to_us" : 300000000, "msatoshi_total" : 300000000, "dust_limit_satoshis" : 546, "max_htlc_value_in_flight_msat" : 18446744073709551615, "channel_reserve_satoshis" : 0, "htlc_minimum_msat" : 0, "to_self_delay" : 144, "max_accepted_htlcs" : 483 } ] },
		{ "id" : "022d065a059294ff8796cf0b9df467ba76420c62eda92771a4063d15e7170020e0", "connected" : false, "channels" :
			[
				{ "state" : "OPENINGD", "dust_limit_satoshis" : 0, "max_htlc_value_in_flight_msat" : 0, "channel_reserve_satoshis" : 0, "htlc_minimum_msat" : 0, "to_self_delay" : 0, "max_accepted_htlcs" : 0 } ] },
		{ "id" : "022d065a059294ff8796cf0b9df467ba76420c62eda92771a4063d15e7170020e0", "connected" : false, "channels" :
			[
				{ "state" : "OPENINGD", "dust_limit_satoshis" : 0, "max_htlc_value_in_flight_msat" : 0, "channel_reserve_satoshis" : 0, "htlc_minimum_msat" : 0, "to_self_delay" : 0, "max_accepted_htlcs" : 0 } ] },
		{ "id" : "0387e3780a4325eb38421fb83000a6f6c0ffa4a69ea0c81db3f00e8e5015c9e8a1", "connected" : true, "netaddr" :
			[ "148.251.82.174:9735" ], "channels" :
			[
				{ "state" : "CHANNELD_NORMAL", "owner" : "lightning_channeld", "short_channel_id" : "506052:1274:0", "funding_txid" : "9b297e30796a27e0e6e420d8b76498ee9a706cd7e7ff690928502bb5a53c6be6", "msatoshi_to_us" : 300000000, "msatoshi_total" : 300000000, "dust_limit_satoshis" : 546, "max_htlc_value_in_flight_msat" : 18446744073709551615, "channel_reserve_satoshis" : 0, "htlc_minimum_msat" : 0, "to_self_delay" : 144, "max_accepted_htlcs" : 483 } ] },
		{ "id" : "03ace925c1109558feb4beb1c45be993e37299517e9a28b0b7d0c1ff3adaefa9da", "connected" : true, "netaddr" :
			[ "81.2.244.244:9735" ], "channels" :
			[
				{ "state" : "CHANNELD_NORMAL", "owner" : "lightning_channeld", "short_channel_id" : "506052:1276:0", "funding_txid" : "04522f1f8532cab30112bc7d43e0fb809586f2b93af12e08f199ffb9e96ad7fd", "msatoshi_to_us" : 290000000, "msatoshi_total" : 290000000, "dust_limit_satoshis" : 546, "max_htlc_value_in_flight_msat" : 18446744073709551615, "channel_reserve_satoshis" : 0, "htlc_minimum_msat" : 0, "to_self_delay" : 144, "max_accepted_htlcs" : 483 } ] } ] }

Both transactions have 6 confirmations:

https://blockchain.info/tx/9b297e30796a27e0e6e420d8b76498ee9a706cd7e7ff690928502bb5a53c6be6

https://blockchain.info/tx/04522f1f8532cab30112bc7d43e0fb809586f2b93af12e08f199ffb9e96ad7fd

I am able to find a route:

lightning-cli getroute 02f6725f9c1c40333b67faea92fd211c183050f28df32cac3f9d69685fe9665432 20000000 0
{ "route" :
	[
		{ "id" : "0387e3780a4325eb38421fb83000a6f6c0ffa4a69ea0c81db3f00e8e5015c9e8a1", "channel" : "506052:1274:0", "msatoshi" : 20002220, "delay" : 167 },
		{ "id" : "0201c0130bff6c44f7467cfc4d1343741521489177c24fd9e6fb346a16026ee978", "channel" : "505964:264:0", "msatoshi" : 20001020, "delay" : 153 },
		{ "id" : "02f6725f9c1c40333b67faea92fd211c183050f28df32cac3f9d69685fe9665432", "channel" : "505842:1223:0", "msatoshi" : 20000000, "delay" : 9 } ] }

lightning-cli listchannels | grep 02e40b82365cd2a3908a481b712ba09858a5dee4cac997351db6cbaa175129907b

		{ "source" : "02e40b82365cd2a3908a481b712ba09858a5dee4cac997351db6cbaa175129907b", "destination" : "0387e3780a4325eb38421fb83000a6f6c0ffa4a69ea0c81db3f00e8e5015c9e8a1", "short_channel_id" : "506052:1274:0", "flags" : 0, "active" : true, "public" : true, "last_update" : 1516889294, "base_fee_millisatoshi" : 1000, "fee_per_millionth" : 10, "delay" : 14 },
		{ "source" : "02e40b82365cd2a3908a481b712ba09858a5dee4cac997351db6cbaa175129907b", "destination" : "03ace925c1109558feb4beb1c45be993e37299517e9a28b0b7d0c1ff3adaefa9da", "short_channel_id" : "506052:1276:0", "flags" : 0, "active" : true, "public" : true, "last_update" : 1516889295, "base_fee_millisatoshi" : 1000, "fee_per_millionth" : 10, "delay" : 14 },
		{ "source" : "0387e3780a4325eb38421fb83000a6f6c0ffa4a69ea0c81db3f00e8e5015c9e8a1", "destination" : "02e40b82365cd2a3908a481b712ba09858a5dee4cac997351db6cbaa175129907b", "short_channel_id" : "506052:1274:0", "flags" : 1, "active" : true, "public" : true, "last_update" : 1516889294, "base_fee_millisatoshi" : 1000, "fee_per_millionth" : 10, "delay" : 14 },
		{ "source" : "03ace925c1109558feb4beb1c45be993e37299517e9a28b0b7d0c1ff3adaefa9da", "destination" : "02e40b82365cd2a3908a481b712ba09858a5dee4cac997351db6cbaa175129907b", "short_channel_id" : "506052:1276:0", "flags" : 1, "active" : true, "public" : true, "last_update" : 1516889294, "base_fee_millisatoshi" : 1000, "fee_per_millionth" : 10, "delay" : 14 },

Logs for getRoute to SLEEPYARK

lightning_gossipd(13): TRACE: Failed connected out for 039a8f88dca257f4f67a2c65bfcc6ab1d398488334d3b3a78d514c8e3f6638a903, will try again
lightningd(1): Connected json input
lightning_gossipd(13): TRACE: req: type WIRE_GOSSIP_GETROUTE_REQUEST len 78
lightning_gossipd(13): TRACE: Trying to find a route from 02e40b82365cd2a3908a481b712ba09858a5dee4cac997351db6cbaa175129907b to 02f6725f9c1c40333b67faea92fd211c183050f28df32cac3f9d69685fe9665432 for 20000000 msatoshi
lightning_gossipd(13): TRACE: find_route: via 0387e3780a4325eb38421fb83000a6f6c0ffa4a69ea0c81db3f00e8e5015c9e8a1
lightning_gossipd(13): TRACE:  0201c0130bff6c44f7467cfc4d1343741521489177c24fd9e6fb346a16026ee978 (1000+10=1200)
lightning_gossipd(13): TRACE:  02f6725f9c1c40333b67faea92fd211c183050f28df32cac3f9d69685fe9665432 (1000+1=1020)
lightning_gossipd(13): TRACE:  =4611686018427387903(+2220)
lightning_gossipd(13): REPLY WIRE_GOSSIP_GETROUTE_REPLY with 0 fds
lightningd(1):jcon fd 15: Success
lightningd(1):jcon fd 15: Closing (Bad file descriptor)
lightning_gossipd(13): TRACE: Received node_announcement for node 03388e868e91fadd6a671281dd9cf5852fcfdd7eefcd7acad069d49e627ed85867
lightning_gossipd(13): TRACE: Ignoring node announcement, it's outdated.
lightning_gossipd(13): TRACE: Received channel_update for channel 505533:690:0(0)
lightning_gossipd(13): TRACE: Ignoring update for unknown channel 505533:690:0

However, when I go to pay, I get "failed: WIRE_PERMANENT_NODE_FAILURE (reply from remote)". Any ideas?

[stumpy-de]

After pulling latest from master and restarting, this issue is resolved. Thanks for your hard work!