Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bug]: rfq quote rejected even though peer is connected and channel is active #1267

Open
vanditshah99 opened this issue Dec 27, 2024 · 5 comments
Labels
bug Something isn't working needs triage P0
Milestone

Comments

@vanditshah99
Copy link

vanditshah99 commented Dec 27, 2024

Background

Sending a taproot payment via Rest Call gives an error peer 036280ce2a8346991c39fd616d2c8693017f073709f38f3c5eaa39891e40cb2ab9 rejected the quote, code: 0, error message: unknown reject error stating unknown reject error

Your environment

litcli getinfo

1295c0e856fe:/src# litcli getinfo
{
    "version":  "0.14.0-alpha commit=v0.14.0-alpha"
}

tapcli getinfo

1295c0e856fe:/src# ./tapcli.sh getinfo
{
    "version": "0.5.0-alpha commit=v0.5.0",
    "lnd_version": "0.18.4-beta",
    "network": "mainnet",
    "lnd_identity_pubkey": "036280ce2a8346991c39fd616d2c8693017f073709f38f3c5eaa39891e40cb2ab9",
    "node_alias": "speed3",
    "block_height": 876561,
    "block_hash": "0000000000000000000080c54aeb522661f08a1bf92a710956156beccba12b38",
    "sync_to_chain": true
}

uname -mrsv

Linux 6.8.0-1017-aws #18~22.04.1-Ubuntu SMP Thu Oct  3 19:57:42 UTC 2024 x86_64

bitcoind --version || btcd --version

Bitcoin Core version v23.0.0

Steps to reproduce

Rest Call for Send Payment Taproot Wrapper API results, Can be replicated by shell using litcli ln payinvoice command as well. The payment goes through while retried multiple times.

Expected behavior

The payment should go through in the first attempt itself. Or a proper error message/retry mechanism to fetch the rates. Peer is connected, and channel is in active state with the peer.

Actual behavior

Rfq quote rejected, send payment fails.

Sender Logs at that time frame

2024-12-26 19:21:31.659 [DBG] GRPH: Received ChannelEdgePolicy for channel 935241292353634305
2024-12-26 19:21:32.370 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:32.370 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:32.370 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:32.370 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:32.370 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:32.370 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:32.370 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:32.370 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:32.371 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:32.371 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:32.371 [DBG] GRPH: Received ChannelEdgePolicy for channel 958516853839953920
2024-12-26 19:21:32.371 [DBG] GRPH: Received ChannelEdgePolicy for channel 961771408359489537
2024-12-26 19:21:32.371 [DBG] GRPH: Received ChannelEdgePolicy for channel 875734623357566978
2024-12-26 19:21:32.371 [DBG] GRPH: Received ChannelEdgePolicy for channel 934423255556816897
2024-12-26 19:21:32.371 [DBG] GRPH: Received ChannelEdgePolicy for channel 804191600662216705
2024-12-26 19:21:32.371 [DBG] GRPH: Received ChannelEdgePolicy for channel 878496596509065220
2024-12-26 19:21:32.371 [DBG] GRPH: Received ChannelEdgePolicy for channel 840063167632179201
2024-12-26 19:21:32.371 [DBG] GRPH: Received ChannelEdgePolicy for channel 838385312867155968
2024-12-26 19:21:33.418 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:33.418 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:33.418 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:33.418 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:33.418 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:33.419 [DBG] GRPH: Received ChannelEdgePolicy for channel 912903614028054540
2024-12-26 19:21:33.517 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:33.517 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:33.517 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:33.517 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:33.517 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:33.518 [DBG] GRPH: Received ChannelEdgePolicy for channel 949938464118210561
2024-12-26 19:21:34.629 [DBG] RPCS: [/lnrpc.Lightning/DecodePayReq] requested
2024-12-26 19:21:34.756 [INF] LITD: Handling REST request: /v1/taproot-assets/channels/send-payment
2024-12-26 19:21:34.757 [INF] LITD: Handling gRPC request: /tapchannelrpc.TaprootAssetChannels/SendPayment
2024-12-26 19:21:34.991 [DBG] RPCS: [/tapchannelrpc.TaprootAssetChannels/SendPayment] requested
2024-12-26 19:21:35.002 [DBG] RPCS: [/lnrpc.Lightning/ListChannels] requested
2024-12-26 19:21:35.003 [DBG] RPCS: [listchannels] fetched 3 channels from DB
2024-12-26 19:21:35.006 [DBG] RPCS: [/lnrpc.Lightning/ListChannels] requested
2024-12-26 19:21:35.007 [DBG] RPCS: [listchannels] fetched 3 channels from DB
2024-12-26 19:21:35.101 [DBG] RFQS: Manager handling outgoing message: SellRequest(peer=036280ce2a8346991c39fd616d2c8693017f073709f38f3c5eaa39891e40cb2ab9, id=7aa1a6ccd0f5fee0985ad53001be7b0991af63c1959aa41df58d2d46456ea429, asset=AssetSpecifier(id=9f0899c00250e51f6405a7f33d3169a4e8cb818b510baeea2cb80bbe8fceed65, group_pub_key=), payment_max_amt=4137000, asset_rate_hint=AssetRate(rate=95413000000, expiry=56957-08-09T03:04:57Z))
2024-12-26 19:21:35.101 [DBG] RFQS: Stream handling outgoing message: SellRequest(peer=036280ce2a8346991c39fd616d2c8693017f073709f38f3c5eaa39891e40cb2ab9, id=7aa1a6ccd0f5fee0985ad53001be7b0991af63c1959aa41df58d2d46456ea429, asset=AssetSpecifier(id=9f0899c00250e51f6405a7f33d3169a4e8cb818b510baeea2cb80bbe8fceed65, group_pub_key=), payment_max_amt=4137000, asset_rate_hint=AssetRate(rate=95413000000, expiry=56957-08-09T03:04:57Z))
2024-12-26 19:21:35.101 [DBG] RPCS: [/lnrpc.Lightning/SendCustomMessage] requested
2024-12-26 19:21:35.105 [DBG] TCHN: Failed to handle: *lnwire.Custom
2024-12-26 19:21:35.105 [DBG] SRVR: Custom message received: peer=036280ce2a8346991c39fd616d2c8693017f073709f38f3c5eaa39891e40cb2ab9, type=52886
2024-12-26 19:21:35.106 [DBG] RFQS: Stream handling incoming message: Reject(id=7aa1a6ccd0f5fee0985ad53001be7b0991af63c1959aa41df58d2d46456ea429, err_code=0, err_msg=unknown reject error)
2024-12-26 19:21:35.106 [DBG] RFQS: Manager handling incoming message: Reject(id=7aa1a6ccd0f5fee0985ad53001be7b0991af63c1959aa41df58d2d46456ea429, err_code=0, err_msg=unknown reject error)
2024-12-26 19:21:35.106 [ERR] RPCS: [/tapchannelrpc.TaprootAssetChannels/SendPayment]: peer 036280ce2a8346991c39fd616d2c8693017f073709f38f3c5eaa39891e40cb2ab9 rejected the quote, code: 0, error message: unknown reject error
2024-12-26 19:21:36.660 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:36.661 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:36.661 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:36.661 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:36.661 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:36.661 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:36.661 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:36.661 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:36.661 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:36.661 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:36.661 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:36.661 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:36.661 [DBG] GRPH: Received ChannelEdgePolicy for channel 963546019935617025
2024-12-26 19:21:36.661 [DBG] GRPH: Received ChannelEdgePolicy for channel 925884448236634113
2024-12-26 19:21:37.368 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:37.368 [DBG] GRPH: Received ChannelEdgePolicy for channel 861576212178272258
2024-12-26 19:21:37.369 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:37.369 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:37.369 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:37.369 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:37.369 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:37.369 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:37.369 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:37.369 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:37.369 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:37.370 [DBG] GRPH: Received ChannelEdgePolicy for channel 950128679611727873
2024-12-26 19:21:37.370 [DBG] GRPH: Received ChannelEdgePolicy for channel 951976958722965505
2024-12-26 19:21:37.370 [DBG] GRPH: Received ChannelEdgePolicy for channel 885810547894321153
2024-12-26 19:21:37.370 [DBG] GRPH: Received ChannelEdgePolicy for channel 766926952584052736
2024-12-26 19:21:37.370 [DBG] GRPH: Received ChannelEdgePolicy for channel 812337882402848768
2024-12-26 19:21:37.370 [DBG] GRPH: Received ChannelEdgePolicy for channel 954181479421837313
2024-12-26 19:21:37.370 [DBG] GRPH: Received ChannelEdgePolicy for channel 881336635142635520
2024-12-26 19:21:38.420 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:38.420 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:38.420 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:38.420 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:38.420 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:38.519 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:38.519 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:38.519 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:38.519 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:38.519 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:38.519 [DBG] GRPH: Received ChannelEdgePolicy for channel 950546494035525638
2024-12-26 19:21:40.957 [DBG] TCHN: Failed to handle: *lnwire.Ping
2024-12-26 19:21:40.957 [DBG] TCHN: Failed to handle: *lnwire.Pong
2024-12-26 19:21:41.454 [DBG] RPCS: [/lnrpc.Lightning/ListPeers] requested
2024-12-26 19:21:41.454 [DBG] RPCS: [listpeers] yielded [036280ce2a8346991c39fd616d2c8693017f073709f38f3c5eaa39891e40cb2ab9@3.208.164.212:8736 02fb492851224c90950e5b83badb14916bbf86dd56a0598daaf103db61f7d8c74d@84.46.251.107:9735 02a371038863605300d0b3fc9de0cf5ccb57728b7f8906535709a831b16e311187@34.65.186.40:9735 02eda5b857699d9cc438339c7572843a3af6ef9feaec4ce9f39aee50a712dfc0c3@85.208.69.17:4038] peers
2024-12-26 19:21:41.470 [DBG] RPCS: [/lnrpc.Lightning/ListChannels] requested
2024-12-26 19:21:41.471 [DBG] RPCS: [listchannels] fetched 3 channels from DB
2024-12-26 19:21:41.480 [DBG] RPCS: [/lnrpc.Lightning/GetInfo] requested
2024-12-26 19:21:41.488 [DBG] RPCS: [/lnrpc.Lightning/GetChanInfo] requested
2024-12-26 19:21:41.491 [DBG] RPCS: [/lnrpc.Lightning/GetChanInfo] requested
2024-12-26 19:21:41.494 [DBG] RPCS: [/lnrpc.Lightning/GetChanInfo] requested
2024-12-26 19:21:41.499 [DBG] RPCS: [/lnrpc.Lightning/ListInvoices] requested
2024-12-26 19:21:41.500 [DBG] RPCS: [/lnrpc.Lightning/GetInfo] requested
2024-12-26 19:21:41.508 [DBG] RPCS: [/lnrpc.Lightning/ListPayments] requested
2024-12-26 19:21:41.510 [DBG] RPCS: [/lnrpc.Lightning/ForwardingHistory] requested
2024-12-26 19:21:41.513 [DBG] RPCS: [/lnrpc.Lightning/GetTransactions] requested
2024-12-26 19:21:41.514 [DBG] RPCS: [/lnrpc.Lightning/ClosedChannels] requested
2024-12-26 19:21:41.662 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate

Peer Logs at that time frame

2024-12-26 19:21:30.343 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:30.344 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=19827076062 mSAT, theirBalance=144784850 mSAT, numHtlcs=1
2024-12-26 19:21:30.360 [DBG] HSWC: ChannelLink(c003291436c50383474afdb2fcb315e2071622ac0c392841674e322dd0286c24:1): settle-fail-filter: count=1, filter=[0]
2024-12-26 19:21:30.360 [DBG] HSWC: ChannelLink(c003291436c50383474afdb2fcb315e2071622ac0c392841674e322dd0286c24:1): Failed to send HTLC with ID=1485
2024-12-26 19:21:30.360 [DBG] HSWC: Closed completed FAIL circuit for 60fecaf562ca14ffaa39f4143906d40899d7f3c7ebd3b0431154f233be96dda9: (876018:302:1, 6587) <-> (875432:1132:1, 1485)
2024-12-26 19:21:30.360 [DBG] HSWC: ChannelLink(a09f808d5e8403044bbfcd5f6204577fcb9752f733b6a423bb475628b3c0db0b:1): queueing removal of FAIL closed circuit: (Chan ID=876018:302:1, HTLC ID=6587)->(Chan ID=875432:1132:1, HTLC ID=1485)
2024-12-26 19:21:30.361 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953972603 mSAT, theirBalance=8044067397 mSAT, numHtlcs=0
2024-12-26 19:21:30.361 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=0
2024-12-26 19:21:30.361 [DBG] TSVR: PackSigs called
2024-12-26 19:21:30.399 [DBG] HSWC: ChannelLink(a09f808d5e8403044bbfcd5f6204577fcb9752f733b6a423bb475628b3c0db0b:1): removing Fail/Settle packet (Chan ID=876018:302:1, HTLC ID=6587) from mailbox
2024-12-26 19:21:30.418 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:30.419 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953773603 mSAT, theirBalance=8018086284 mSAT, numHtlcs=1
2024-12-26 19:21:30.440 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:30.484 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953972603 mSAT, theirBalance=8044067397 mSAT, numHtlcs=0
2024-12-26 19:21:30.484 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:30.484 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:30.496 [DBG] TCHN: Failed to handle: *lnwire.UpdateFailHTLC
2024-12-26 19:21:30.631 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:30.632 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=19379220229 mSAT, theirBalance=5543805952 mSAT, numHtlcs=1
2024-12-26 19:21:30.632 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:30.633 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:30.649 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=19379220229 mSAT, theirBalance=5543805952 mSAT, numHtlcs=1
2024-12-26 19:21:30.649 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=1
2024-12-26 19:21:30.650 [DBG] TSVR: PackSigs called
2024-12-26 19:21:30.684 [DBG] GRPH: Received ChannelEdgePolicy for channel 955179836037595137
2024-12-26 19:21:30.684 [DBG] GRPH: Received ChannelEdgePolicy for channel 921509491376979969
2024-12-26 19:21:30.751 [DBG] GRPH: Received ChannelEdgePolicy for channel 885817144947310593
2024-12-26 19:21:30.751 [DBG] GRPH: Received ChannelEdgePolicy for channel 911808500398292993
2024-12-26 19:21:30.751 [DBG] GRPH: Received ChannelEdgePolicy for channel 933554641250877440
2024-12-26 19:21:30.751 [DBG] GRPH: Received ChannelEdgePolicy for channel 931308339067617283
2024-12-26 19:21:30.751 [DBG] GRPH: Received ChannelEdgePolicy for channel 922923463413399560
2024-12-26 19:21:30.751 [DBG] GRPH: Received ChannelEdgePolicy for channel 962122152505704449
2024-12-26 19:21:30.751 [DBG] GRPH: Received ChannelEdgePolicy for channel 949136920258084865
2024-12-26 19:21:30.751 [DBG] GRPH: Received ChannelEdgePolicy for channel 926934481797316608
2024-12-26 19:21:30.751 [DBG] GRPH: Received ChannelEdgePolicy for channel 963513034748133377
2024-12-26 19:21:30.751 [DBG] GRPH: Received ChannelEdgePolicy for channel 823247236811915265
2024-12-26 19:21:30.751 [DBG] GRPH: Received ChannelEdgePolicy for channel 895128908928057345
2024-12-26 19:21:30.751 [DBG] GRPH: Received ChannelEdgePolicy for channel 893537915591065600
2024-12-26 19:21:30.751 [DBG] GRPH: Received ChannelEdgePolicy for channel 911409377582186496
2024-12-26 19:21:30.751 [DBG] GRPH: Waiting for dependent on job=channeldb.LightningNode, pub=036cb1a035eb1c7f125c004ed046d329285bd57e4100f18b577af721659becd832
2024-12-26 19:21:30.751 [DBG] GRPH: Signal deny for job=channeldb.LightningNode, pub=036cb1a035eb1c7f125c004ed046d329285bd57e4100f18b577af721659becd832
2024-12-26 19:21:30.751 [DBG] GRPH: Received ChannelEdgePolicy for channel 927979017860022272
2024-12-26 19:21:30.751 [DBG] GRPH: Received ChannelEdgePolicy for channel 942377122596323329
2024-12-26 19:21:31.000 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:31.001 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=19302660925 mSAT, theirBalance=5543606952 mSAT, numHtlcs=2
2024-12-26 19:21:31.016 [DBG] HSWC: ChannelLink(441017108bcd9d8bc0edb8d02b29364f82af6c8fafab393babd97c31a1275dcb:1): settle-fail-filter: count=1, filter=[0]
2024-12-26 19:21:31.016 [DBG] HSWC: ChannelLink(441017108bcd9d8bc0edb8d02b29364f82af6c8fafab393babd97c31a1275dcb:1): Failed to send HTLC with ID=2342
2024-12-26 19:21:31.016 [DBG] HSWC: Closed completed FAIL circuit for e82392f711dd9c7f61c57dddb558bb3a1446ca67b46568af721ac2b0de07e945: (875429:539:1, 10414) <-> (855662:412:1, 2342)
2024-12-26 19:21:31.016 [DBG] HSWC: ChannelLink(a9d8a5eee655f422cb8c61c37bb12e6a359eeeaac95f694cff9e4065793627a3:1): queueing removal of FAIL closed circuit: (Chan ID=875429:539:1, HTLC ID=10414)->(Chan ID=855662:412:1, HTLC ID=2342)
2024-12-26 19:21:31.017 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=1296203959 mSAT, theirBalance=18626953222 mSAT, numHtlcs=1
2024-12-26 19:21:31.017 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=1
2024-12-26 19:21:31.018 [DBG] TSVR: PackSigs called
2024-12-26 19:21:31.048 [DBG] HSWC: ChannelLink(a9d8a5eee655f422cb8c61c37bb12e6a359eeeaac95f694cff9e4065793627a3:1): removing Fail/Settle packet (Chan ID=875429:539:1, HTLC ID=10414) from mailbox
2024-12-26 19:21:31.156 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:31.156 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=1296022959 mSAT, theirBalance=18550392918 mSAT, numHtlcs=2
2024-12-26 19:21:31.161 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:31.217 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=1296203959 mSAT, theirBalance=18626953222 mSAT, numHtlcs=1
2024-12-26 19:21:31.217 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:31.217 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:31.845 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:31.845 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:31.845 [DBG] GRPH: Checking stale node 303231336130303765626233383433313433636439386535373866653130356462636361646661353230323834306262643462383332643863646436336132393436 got Ignoring outdated announcement for 0213a007ebb3843143cd98e578fe105dbccadfa5202840bbd4b832d8cdd63a2946
2024-12-26 19:21:31.845 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:31.845 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:31.845 [DBG] GRPH: Checking stale node 303264303436313036343637343735393132623730346634613263626532393531666533613332363366363634373265656230663066636638326538353230383262 got Ignoring outdated announcement for 02d046106467475912b704f4a2cbe2951fe3a3263f66472eeb0f0fcf82e852082b
2024-12-26 19:21:31.845 [DBG] GRPH: Checking stale node 303238323638646362346336383331313631336464336262623031363466373638356236373130303232626661366463636536333961636434343639353034396132 got Ignoring outdated announcement for 028268dcb4c68311613dd3bbb0164f7685b6710022bfa6dcce639acd44695049a2
2024-12-26 19:21:31.845 [DBG] GRPH: Checking stale node 303263653761626235653632353939306637383938353230626361373231623761653331363136356565663831313333646366653430363866636662653337616336 got Ignoring outdated announcement for 02ce7abb5e625990f7898520bca721b7ae316165eef81133dcfe4068fcfbe37ac6
2024-12-26 19:21:31.904 [DBG] TCHN: Failed to handle: *lnwire.Ping
2024-12-26 19:21:31.904 [DBG] TCHN: Failed to handle: *lnwire.Pong
2024-12-26 19:21:31.940 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:31.940 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:31.940 [DBG] GRPH: Checking stale node 303338326437313062323130643339306263623661636437343832363264383739326432613435396566653338363138636236313061646164333137343138636562 got Ignoring outdated announcement for 0382d710b210d390bcb6acd748262d8792d2a459efe38618cb610adad317418ceb
2024-12-26 19:21:31.940 [DBG] GRPH: Checking stale node 303232396530653933333338366661373733663036356562616531636532356235383062356132636434353437653239313938393561356237363139643665303938 got Ignoring outdated announcement for 0229e0e933386fa773f065ebae1ce25b580b5a2cd4547e2919895a5b7619d6e098
2024-12-26 19:21:32.446 [DBG] HLCK: Health check: chain backend invoking success callback
2024-12-26 19:21:32.457 [DBG] NANN: HostAnnouncer checking for any IP changes...
2024-12-26 19:21:32.459 [DBG] NANN: No IP changes detected for hosts: [speed3.tryspeed.com:8736]
2024-12-26 19:21:32.476 [DBG] HSWC: Sent 0 satoshis and received 0 satoshis in the last 10 seconds (0.800000 tx/sec)
2024-12-26 19:21:32.713 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:32.713 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:32.713 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:32.713 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:32.713 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:33.172 [DBG] TCHN: Failed to handle: *lnwire.UpdateAddHTLC
2024-12-26 19:21:33.260 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:33.260 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953773603 mSAT, theirBalance=8021942639 mSAT, numHtlcs=1
2024-12-26 19:21:33.260 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:33.261 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:33.277 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953773603 mSAT, theirBalance=8021942639 mSAT, numHtlcs=1
2024-12-26 19:21:33.277 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=1
2024-12-26 19:21:33.277 [DBG] TSVR: PackSigs called
2024-12-26 19:21:33.359 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:33.360 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953972603 mSAT, theirBalance=8044067397 mSAT, numHtlcs=0
2024-12-26 19:21:33.431 [DBG] HSWC: ChannelLink(a09f808d5e8403044bbfcd5f6204577fcb9752f733b6a423bb475628b3c0db0b:1): forwarding 1 packets to switch: replay=false
2024-12-26 19:21:33.432 [DBG] RFQS: Handling incoming HTLC, incoming channel ID: 963191977160867841, outgoing channel ID: 962547663401385985 (incoming amount: 22124758 mSAT, outgoing amount: 22123736 mSAT)
2024-12-26 19:21:33.432 [DBG] RFQS: Failed to find a policy for the HTLC. Resuming.
2024-12-26 19:21:33.446 [DBG] TSVR: HandleTraffic called, cid=875432:1132:1, fundingBlob=(fn.Option[[]uint8]) {
isSome: (bool) false,
some: ([]uint8) <nil>
}
2024-12-26 19:21:33.446 [DBG] HSWC: ShortChannelID=875432:1132:1: aux traffic shaper is handling traffic: false
2024-12-26 19:21:33.446 [DBG] HSWC: ChannelLink(c003291436c50383474afdb2fcb315e2071622ac0c392841674e322dd0286c24:1): queueing keystone of ADD open circuit: (Chan ID=876018:302:1, HTLC ID=6588)->(Chan ID=875432:1132:1, HTLC ID=1486)
2024-12-26 19:21:33.511 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=19830932414 mSAT, theirBalance=144784850 mSAT, numHtlcs=1
2024-12-26 19:21:33.511 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=1
2024-12-26 19:21:33.511 [DBG] TSVR: PackSigs called
2024-12-26 19:21:33.526 [DBG] HSWC: ChannelLink(c003291436c50383474afdb2fcb315e2071622ac0c392841674e322dd0286c24:1): removing Add packet (Chan ID=876018:302:1, HTLC ID=6588) from mailbox
2024-12-26 19:21:33.733 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:33.734 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=19853255150 mSAT, theirBalance=144784850 mSAT, numHtlcs=0
2024-12-26 19:21:33.898 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:33.899 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=19830932414 mSAT, theirBalance=144784850 mSAT, numHtlcs=1
2024-12-26 19:21:33.899 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:33.900 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 024a6288961e1467d39dd70c9d93e57294cb0434dda3268ad0755dfc2763a7c8b8
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 034ea80f8b148c750463546bd999bf7321a0e6dfc60aaf84bd0400a2e8d376c0d5
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 03a93b87bf9f052b8e862d51ebbac4ce5e97b5f4137563cd5128548d7f5978dda9
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 038dbb70e3484da0bed806156f5270d39b480a659c82fb4b56ba3dcbe0edd74d55
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 03e121fa397cb7ec60935c140bfbfa7690c3158ba6df26b8bc636508d8a3735afd
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 02b21ca992bf95e3f324302265ad86cec24f36166fd7afca44efa0809aaa8b25c5
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 02abfbe63425b1ba4f245af72a0a85ba16cd13365704655b2abfc13e53ad338e02
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 020d1617e27ac022395352f2b3774969593d3d6ddff6fb117d820a9dda8da45217
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 02469778b54356db45ad00ef096e6565372bfa85648dde273be725382d08d54563
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 03b103b70920684e846a40526e926502f466715c38ca4654046daa14437eaffb83
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 0223dd7404e46eab4fd289f023d6ce338e1eb1cce66b20b10accfd11d5e028b6b5
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 0326e692c455dd554c709bbb470b0ca7e0bb04152f777d1445fd0bf3709a2833a3
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 033d8656219478701227199cbd6f670335c8d408a92ae88b962c49d4dc0e83e025
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 0328fe87a49dd9919cf3a6883af961c710182c5647f82e0d047051350ce615b67f
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 02512ee407dfe44f71251015244161c97a5e7630e71a95bffb7891eabdb830c55f
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 03c5528c628681aa17ab9e117aa3ee6f06c750dfb17df758ecabcd68f1567ad8c1
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 023631624e30ef7bcb2887e600da8e59608a093718bc40d35b7a57145a0f3db9af
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 0364913d18a19c671bb36dd04d6ad5be0fe8f2894314c36a9db3f03c2d414907e1
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 03423790614f023e3c0cdaa654a3578e919947e4c3a14bf5044e7c787ebd11af1a
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 031a8edd311cc42ba4a947bc82c23c73fdd18ffa21046a9eb00dc5cc9b133554e4
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 03cde60a6323f7122d5178255766e38114b4722ede08f7c9e0c5df9b912cc201d6
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 0322d0e43b3d92d30ed187f4e101a9a9605c3ee5fc9721e6dac3ce3d7732fbb13e
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 03905aed59919f322abcc107c3cb6767bc7d40ed175a9d143706fc211cad188157
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 030c36fe4aee023adab1e648926abbd9a8dd1b852c150437f69618553718fd8754
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 03d47edb65b98498ea6b33248233fcf9661dd2653b5c8b9b83c02d0bcccd58e421
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 0362fecabf5b8aa72608bb8bd911c8dcc5df47b4743305e18429c66e775c259b98
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 02cefec523d791a5b464a67320d858bd27eef5dca74f9b829eb5a29f7167a99273
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 031df8ea711416b52d33c2f4a9b2a41d82f1da3c7672ffef2c24b0751cbdb75404
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 0282ccffe2f7fd63b0d68528dab9cd6cff8f64733d2d730c3eb8fa81e011da930e
2024-12-26 19:21:35.015 [DBG] SRVR: Sending 0 messages to peer 03ac2abafea57755b9487247b01234ca7c8e7511fd424f012ce24bf6d8836dcc45
2024-12-26 19:21:35.103 [DBG] TCHN: Failed to handle: *lnwire.Custom
2024-12-26 19:21:35.103 [DBG] SRVR: Custom message received: peer=038dbb70e3484da0bed806156f5270d39b480a659c82fb4b56ba3dcbe0edd74d55, type=52884
2024-12-26 19:21:35.103 [DBG] RFQS: Stream handling incoming message: SellRequest(peer=038dbb70e3484da0bed806156f5270d39b480a659c82fb4b56ba3dcbe0edd74d55, id=7aa1a6ccd0f5fee0985ad53001be7b0991af63c1959aa41df58d2d46456ea429, asset=AssetSpecifier(id=9f0899c00250e51f6405a7f33d3169a4e8cb818b510baeea2cb80bbe8fceed65, group_pub_key=), payment_max_amt=4137000, asset_rate_hint=AssetRate(rate=95413000000, expiry=56957-08-09T03:04:57Z))
2024-12-26 19:21:35.103 [DBG] RFQS: Manager handling incoming message: SellRequest(peer=038dbb70e3484da0bed806156f5270d39b480a659c82fb4b56ba3dcbe0edd74d55, id=7aa1a6ccd0f5fee0985ad53001be7b0991af63c1959aa41df58d2d46456ea429, asset=AssetSpecifier(id=9f0899c00250e51f6405a7f33d3169a4e8cb818b510baeea2cb80bbe8fceed65, group_pub_key=), payment_max_amt=4137000, asset_rate_hint=AssetRate(rate=95413000000, expiry=56957-08-09T03:04:57Z))
2024-12-26 19:21:35.104 [DBG] RFQS: Manager handling outgoing message: Reject(id=7aa1a6ccd0f5fee0985ad53001be7b0991af63c1959aa41df58d2d46456ea429, err_code=0, err_msg=unknown reject error)
2024-12-26 19:21:35.104 [DBG] RFQS: Stream handling outgoing message: Reject(id=7aa1a6ccd0f5fee0985ad53001be7b0991af63c1959aa41df58d2d46456ea429, err_code=0, err_msg=unknown reject error)
2024-12-26 19:21:35.105 [DBG] RPCS: [/lnrpc.Lightning/SendCustomMessage] requested
2024-12-26 19:21:35.105 [ERR] RFQS: Error in RFQ manager: encountered RFQ subsystem error in main event loop: failed to query ask price from oracle: failed to query price oracle for bid: rpc error: code = Unavailable desc = error reading from server: read tcp 172.18.0.2:48264->172.66.42.208:443: read: connection reset by peer
2024-12-26 19:21:35.254 [DBG] TCHN: Failed to handle: *lnwire.UpdateAddHTLC
2024-12-26 19:21:35.339 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:35.340 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953574603 mSAT, theirBalance=8002160503 mSAT, numHtlcs=2
2024-12-26 19:21:35.340 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:35.341 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:35.357 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953574603 mSAT, theirBalance=8002160503 mSAT, numHtlcs=2
2024-12-26 19:21:35.357 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=2
2024-12-26 19:21:35.357 [DBG] TSVR: PackSigs called
2024-12-26 19:21:35.438 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:35.439 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953773603 mSAT, theirBalance=8021942639 mSAT, numHtlcs=1
2024-12-26 19:21:35.523 [DBG] HSWC: ChannelLink(a09f808d5e8403044bbfcd5f6204577fcb9752f733b6a423bb475628b3c0db0b:1): forwarding 1 packets to switch: replay=false
2024-12-26 19:21:35.523 [DBG] RFQS: Handling incoming HTLC, incoming channel ID: 963191977160867841, outgoing channel ID: 940739949766115329 (incoming amount: 19782136 mSAT, outgoing amount: 19781136 mSAT)
2024-12-26 19:21:35.523 [DBG] RFQS: Failed to find a policy for the HTLC. Resuming.
2024-12-26 19:21:35.536 [DBG] TSVR: HandleTraffic called, cid=855598:980:1, fundingBlob=(fn.Option[[]uint8]) {
isSome: (bool) false,
some: ([]uint8) <nil>
}
2024-12-26 19:21:35.536 [DBG] HSWC: ShortChannelID=855598:980:1: aux traffic shaper is handling traffic: false
2024-12-26 19:21:35.536 [DBG] HSWC: ChannelLink(5c78cda11b3a3d11c31a82244a8c5c2565ba89ab5580da1103c83118c45d5667:1): queueing keystone of ADD open circuit: (Chan ID=876018:302:1, HTLC ID=6589)->(Chan ID=855598:980:1, HTLC ID=2673)
2024-12-26 19:21:35.603 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=9744599538 mSAT, theirBalance=10233460326 mSAT, numHtlcs=1
2024-12-26 19:21:35.603 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=1
2024-12-26 19:21:35.604 [DBG] TSVR: PackSigs called
2024-12-26 19:21:35.614 [DBG] TCHN: Failed to handle: *lnwire.Ping
2024-12-26 19:21:35.616 [DBG] TCHN: Failed to handle: *lnwire.Pong
2024-12-26 19:21:35.617 [DBG] TCHN: Failed to handle: *lnwire.Ping
2024-12-26 19:21:35.618 [DBG] HSWC: ChannelLink(5c78cda11b3a3d11c31a82244a8c5c2565ba89ab5580da1103c83118c45d5667:1): removing Add packet (Chan ID=876018:302:1, HTLC ID=6589) from mailbox
2024-12-26 19:21:35.621 [DBG] TCHN: Failed to handle: *lnwire.Pong
2024-12-26 19:21:35.847 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:35.847 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=9764380674 mSAT, theirBalance=10233659326 mSAT, numHtlcs=0
2024-12-26 19:21:35.850 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:35.884 [DBG] TCHN: Failed to handle: *lnwire.Ping
2024-12-26 19:21:35.889 [DBG] TCHN: Failed to handle: *lnwire.Ping
2024-12-26 19:21:35.897 [DBG] TCHN: Failed to handle: *lnwire.Ping
2024-12-26 19:21:35.906 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=9744599538 mSAT, theirBalance=10233460326 mSAT, numHtlcs=1
2024-12-26 19:21:35.906 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:35.906 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:35.939 [DBG] TCHN: Failed to handle: *lnwire.Ping
2024-12-26 19:21:35.977 [DBG] TCHN: Failed to handle: *lnwire.Pong
2024-12-26 19:21:35.986 [DBG] TCHN: Failed to handle: *lnwire.Pong
2024-12-26 19:21:35.997 [DBG] TCHN: Failed to handle: *lnwire.Pong
2024-12-26 19:21:35.998 [DBG] TCHN: Failed to handle: *lnwire.Ping
2024-12-26 19:21:36.016 [DBG] TCHN: Failed to handle: *lnwire.Ping
2024-12-26 19:21:36.017 [DBG] TCHN: Failed to handle: *lnwire.Pong
2024-12-26 19:21:36.103 [DBG] TCHN: Failed to handle: *lnwire.Pong
2024-12-26 19:21:36.123 [DBG] TCHN: Failed to handle: *lnwire.Pong
2024-12-26 19:21:36.125 [DBG] TCHN: Failed to handle: *lnwire.Ping
2024-12-26 19:21:36.266 [DBG] TCHN: Failed to handle: *lnwire.Pong
2024-12-26 19:21:36.664 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:36.665 [DBG] GRPH: Checking stale node 303261316564353032393666633061363561363733643930366535613831626465323035356137323435333664633537653338336163613634336234383132656332 got Ignoring outdated announcement for 02a1ed50296fc0a65a673d906e5a81bde2055a724536dc57e383aca643b4812ec2
2024-12-26 19:21:36.694 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:36.694 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:36.695 [DBG] GRPH: Checking stale node 303333326334356361616639393235626533646264633862373439393666663934373064623237383663396332643631363638333633356533353736376164313765 got Ignoring outdated announcement for 0332c45caaf9925be3dbdc8b74996ff9470db2786c9c2d616683635e35767ad17e
2024-12-26 19:21:36.695 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:36.695 [DBG] GRPH: Checking stale node 303231376162316633373831663830366337303233343137313464363764646434366264323235333135306363356137613433353464323131303433396235393736 got Ignoring outdated announcement for 0217ab1f3781f806c702341714d67ddd46bd2253150cc5a7a4354d2110439b5976
2024-12-26 19:21:36.695 [DBG] GRPH: Checking stale node 303235376136613266313237366635316136663466623436613061306135633961633331323062326430356336383664653566623239316630343239366139383966 got Ignoring outdated announcement for 0257a6a2f1276f51a6f4fb46a0a0a5c9ac3120b2d05c686de5fb291f04296a989f
2024-12-26 19:21:36.760 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:36.760 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:36.760 [DBG] GRPH: Checking stale node 303233653039633433623231356264336462663438336263623430396461333332326561356561336230343666373436393862383965653965613738356464333061 got Ignoring outdated announcement for 023e09c43b215bd3dbf483bcb409da3322ea5ea3b046f74698b89ee9ea785dd30a
2024-12-26 19:21:36.760 [DBG] GRPH: Checking stale node 303363356266613563616237653532653763656263343566643162383665613330616435313836343836353133313435363334353262373862383232333333363630 got Ignoring outdated announcement for 03c5bfa5cab7e52e7cebc45fd1b86ea30ad518648651314563452b78b822333660
2024-12-26 19:21:37.647 [DBG] TCHN: Failed to handle: *lnwire.UpdateFailHTLC
2024-12-26 19:21:37.717 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:37.717 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:37.717 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:37.717 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:37.717 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:37.717 [DBG] GRPH: Checking stale node 303339306235643434393264633266353331386535323333616232636562663664343839313438383161333365663661396336626364626234333361643938366430 got Ignoring outdated announcement for 0390b5d4492dc2f5318e5233ab2cebf6d48914881a33ef6a9c6bcdbb433ad986d0
2024-12-26 19:21:37.718 [DBG] UNIV: Federation envoy handling new tick event
2024-12-26 19:21:37.725 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:37.726 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=19853255150 mSAT, theirBalance=144784850 mSAT, numHtlcs=0
2024-12-26 19:21:37.726 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:37.726 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:37.744 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=19853255150 mSAT, theirBalance=144784850 mSAT, numHtlcs=0
2024-12-26 19:21:37.744 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=0
2024-12-26 19:21:37.744 [DBG] TSVR: PackSigs called
2024-12-26 19:21:37.815 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:37.815 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:37.815 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:37.815 [DBG] GRPH: Checking stale node 303232313730353032323465353861633761326235316365366664626634656237363962396365363535353330363439653565653039393436313932623963376639 got Ignoring outdated announcement for 02217050224e58ac7a2b51ce6fdbf4eb769b9ce655530649e5ee09946192b9c7f9
2024-12-26 19:21:37.815 [DBG] GRPH: Checking stale node 303366366365616136376462326363313639666238663734623736323231316533636532303435396261633532616337663863383566333531363730613662363738 got Ignoring outdated announcement for 03f6ceaa67db2cc169fb8f74b762211e3ce20459bac52ac7f8c85f351670a6b678
2024-12-26 19:21:37.815 [DBG] GRPH: Checking stale node 303330346465313661613263353038393061643737653937643933363836336535356463633364653339613361653266643366623333623930386332656263366234 got Ignoring outdated announcement for 0304de16aa2c50890ad77e97d936863e55dcc3de39a3ae2fd3fb33b908c2ebc6b4
2024-12-26 19:21:37.918 [INF] UNIV: Synchronizing with 1 federation members
2024-12-26 19:21:37.918 [INF] UNIV: Syncing Universe state with server=(universe.ServerAddr) {
ID: (int64) 1,
addrStr: (string) (len=32) "universe.lightning.finance:10029",
addr: (net.Addr) <nil>
}
2024-12-26 19:21:37.918 [INF] UNIV: Attempting to sync universe: host=universe.lightning.finance:10029, sync_type=full, ids=([]universe.Identifier) <nil>
2024-12-26 19:21:37.948 [INF] UNIV: Fetching 0 roots
2024-12-26 19:21:37.948 [INF] UNIV: Obtained 0 roots from remote Universe server
2024-12-26 19:21:37.985 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:37.986 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=19830932414 mSAT, theirBalance=144784850 mSAT, numHtlcs=1
2024-12-26 19:21:37.999 [DBG] HSWC: ChannelLink(c003291436c50383474afdb2fcb315e2071622ac0c392841674e322dd0286c24:1): settle-fail-filter: count=1, filter=[0]
2024-12-26 19:21:37.999 [DBG] HSWC: ChannelLink(c003291436c50383474afdb2fcb315e2071622ac0c392841674e322dd0286c24:1): Failed to send HTLC with ID=1486
2024-12-26 19:21:37.999 [DBG] HSWC: Closed completed FAIL circuit for 60fecaf562ca14ffaa39f4143906d40899d7f3c7ebd3b0431154f233be96dda9: (876018:302:1, 6588) <-> (875432:1132:1, 1486)
2024-12-26 19:21:37.999 [DBG] HSWC: ChannelLink(a09f808d5e8403044bbfcd5f6204577fcb9752f733b6a423bb475628b3c0db0b:1): queueing removal of FAIL closed circuit: (Chan ID=876018:302:1, HTLC ID=6588)->(Chan ID=875432:1132:1, HTLC ID=1486)
2024-12-26 19:21:38.000 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953773603 mSAT, theirBalance=8024285261 mSAT, numHtlcs=1
2024-12-26 19:21:38.000 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=1
2024-12-26 19:21:38.000 [DBG] TSVR: PackSigs called
2024-12-26 19:21:38.031 [DBG] HSWC: ChannelLink(a09f808d5e8403044bbfcd5f6204577fcb9752f733b6a423bb475628b3c0db0b:1): removing Fail/Settle packet (Chan ID=876018:302:1, HTLC ID=6588) from mailbox
2024-12-26 19:21:38.052 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:38.053 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953574603 mSAT, theirBalance=8002160503 mSAT, numHtlcs=2
2024-12-26 19:21:38.075 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:38.111 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953773603 mSAT, theirBalance=8024285261 mSAT, numHtlcs=1
2024-12-26 19:21:38.111 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:38.112 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:38.406 [INF] GRPH: Processed channels=0 updates=125 nodes=43 in last 1m0.000241441s
2024-12-26 19:21:39.048 [DBG] TCHN: Failed to handle: *lnwire.Pong
2024-12-26 19:21:39.137 [DBG] TCHN: Failed to handle: *lnwire.Ping
2024-12-26 19:21:39.157 [DBG] TCHN: Failed to handle: *lnwire.UpdateAddHTLC
2024-12-26 19:21:39.245 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:39.246 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953574603 mSAT, theirBalance=7999784239 mSAT, numHtlcs=2
2024-12-26 19:21:39.246 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:39.246 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:39.261 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953574603 mSAT, theirBalance=7999784239 mSAT, numHtlcs=2
2024-12-26 19:21:39.261 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=2
2024-12-26 19:21:39.261 [DBG] TSVR: PackSigs called
2024-12-26 19:21:39.343 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:39.344 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953773603 mSAT, theirBalance=8024285261 mSAT, numHtlcs=1
2024-12-26 19:21:39.415 [DBG] HSWC: ChannelLink(a09f808d5e8403044bbfcd5f6204577fcb9752f733b6a423bb475628b3c0db0b:1): forwarding 1 packets to switch: replay=false
2024-12-26 19:21:39.415 [DBG] RFQS: Handling incoming HTLC, incoming channel ID: 963191977160867841, outgoing channel ID: 945378789300633602 (incoming amount: 24501022 mSAT, outgoing amount: 24500022 mSAT)
2024-12-26 19:21:39.415 [DBG] RFQS: Failed to find a policy for the HTLC. Resuming.
2024-12-26 19:21:39.440 [DBG] TSVR: HandleTraffic called, cid=859817:628:2, fundingBlob=(fn.Option[[]uint8]) {
isSome: (bool) false,
some: ([]uint8) <nil>
}
2024-12-26 19:21:39.440 [DBG] HSWC: ShortChannelID=859817:628:2: aux traffic shaper is handling traffic: false
2024-12-26 19:21:39.440 [WRN] HSWC: ChannelLink(6afa176280664db5be6c50e29fd0e7c2648ef5fd1b5f24afa6911fba4846e587:2): insufficient bandwidth to route htlc: 24500022 mSAT is larger than 18353951 mSAT
2024-12-26 19:21:39.440 [ERR] HSWC: insufficient bandwidth to route htlc
2024-12-26 19:21:39.440 [DBG] HSWC: ChannelLink(a09f808d5e8403044bbfcd5f6204577fcb9752f733b6a423bb475628b3c0db0b:1): queueing removal of FAIL closed circuit: (Chan ID=876018:302:1, HTLC ID=6590)->(Chan ID=859817:628:2, HTLC ID=0)
2024-12-26 19:21:39.440 [ERR] HSWC: Unhandled error while reforwarding htlc settle/fail over htlcswitch: insufficient bandwidth to route htlc
2024-12-26 19:21:39.441 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953773603 mSAT, theirBalance=8024285261 mSAT, numHtlcs=1
2024-12-26 19:21:39.441 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=1
2024-12-26 19:21:39.441 [DBG] TSVR: PackSigs called
2024-12-26 19:21:39.471 [DBG] HSWC: ChannelLink(a09f808d5e8403044bbfcd5f6204577fcb9752f733b6a423bb475628b3c0db0b:1): removing Fail/Settle packet (Chan ID=876018:302:1, HTLC ID=6590) from mailbox
2024-12-26 19:21:39.492 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:39.493 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953574603 mSAT, theirBalance=7999784239 mSAT, numHtlcs=2
2024-12-26 19:21:39.513 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:39.548 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953773603 mSAT, theirBalance=8024285261 mSAT, numHtlcs=1
2024-12-26 19:21:39.548 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:39.549 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:40.236 [DBG] TCHN: Failed to handle: *lnwire.UpdateAddHTLC
2024-12-26 19:21:40.323 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:40.323 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953574603 mSAT, theirBalance=7999637481 mSAT, numHtlcs=2
2024-12-26 19:21:40.323 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:40.324 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:40.340 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953574603 mSAT, theirBalance=7999637481 mSAT, numHtlcs=2
2024-12-26 19:21:40.340 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=2
2024-12-26 19:21:40.341 [DBG] TSVR: PackSigs called
2024-12-26 19:21:40.461 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:40.462 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953773603 mSAT, theirBalance=8024285261 mSAT, numHtlcs=1
2024-12-26 19:21:40.530 [DBG] HSWC: ChannelLink(a09f808d5e8403044bbfcd5f6204577fcb9752f733b6a423bb475628b3c0db0b:1): forwarding 1 packets to switch: replay=false
2024-12-26 19:21:40.530 [DBG] RFQS: Handling incoming HTLC, incoming channel ID: 963191977160867841, outgoing channel ID: 945378789300633602 (incoming amount: 24647780 mSAT, outgoing amount: 24646780 mSAT)
2024-12-26 19:21:40.530 [DBG] RFQS: Failed to find a policy for the HTLC. Resuming.
2024-12-26 19:21:40.543 [DBG] TSVR: HandleTraffic called, cid=859817:628:2, fundingBlob=(fn.Option[[]uint8]) {
isSome: (bool) false,
some: ([]uint8) <nil>
}
2024-12-26 19:21:40.543 [DBG] HSWC: ShortChannelID=859817:628:2: aux traffic shaper is handling traffic: false
2024-12-26 19:21:40.543 [WRN] HSWC: ChannelLink(6afa176280664db5be6c50e29fd0e7c2648ef5fd1b5f24afa6911fba4846e587:2): insufficient bandwidth to route htlc: 24646780 mSAT is larger than 18353951 mSAT
2024-12-26 19:21:40.543 [ERR] HSWC: insufficient bandwidth to route htlc
2024-12-26 19:21:40.544 [ERR] HSWC: Unhandled error while reforwarding htlc settle/fail over htlcswitch: insufficient bandwidth to route htlc
2024-12-26 19:21:40.544 [DBG] HSWC: ChannelLink(a09f808d5e8403044bbfcd5f6204577fcb9752f733b6a423bb475628b3c0db0b:1): queueing removal of FAIL closed circuit: (Chan ID=876018:302:1, HTLC ID=6591)->(Chan ID=859817:628:2, HTLC ID=0)
2024-12-26 19:21:40.544 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953773603 mSAT, theirBalance=8024285261 mSAT, numHtlcs=1
2024-12-26 19:21:40.544 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=1
2024-12-26 19:21:40.544 [DBG] TSVR: PackSigs called
2024-12-26 19:21:40.573 [DBG] HSWC: ChannelLink(a09f808d5e8403044bbfcd5f6204577fcb9752f733b6a423bb475628b3c0db0b:1): removing Fail/Settle packet (Chan ID=876018:302:1, HTLC ID=6591) from mailbox
2024-12-26 19:21:40.596 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:40.597 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953574603 mSAT, theirBalance=7999637481 mSAT, numHtlcs=2
2024-12-26 19:21:40.637 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:40.654 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953773603 mSAT, theirBalance=8024285261 mSAT, numHtlcs=1
2024-12-26 19:21:40.655 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:40.655 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:40.718 [DBG] TCHN: Failed to handle: *lnwire.Ping
2024-12-26 19:21:40.720 [DBG] TCHN: Failed to handle: *lnwire.Pong
2024-12-26 19:21:40.735 [DBG] TCHN: Failed to handle: *lnwire.ChannelUpdate
2024-12-26 19:21:40.735 [DBG] GRPH: Received ChannelEdgePolicy for channel 886592300790186001
2024-12-26 19:21:40.949 [DBG] TCHN: Failed to handle: *lnwire.UpdateAddHTLC
2024-12-26 19:21:40.956 [DBG] TCHN: Failed to handle: *lnwire.Ping
2024-12-26 19:21:40.958 [DBG] TCHN: Failed to handle: *lnwire.Pong
2024-12-26 19:21:40.969 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:40.970 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=1296022959 mSAT, theirBalance=18575442069 mSAT, numHtlcs=2
2024-12-26 19:21:40.970 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:40.970 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:40.988 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=1296022959 mSAT, theirBalance=18575442069 mSAT, numHtlcs=2
2024-12-26 19:21:40.988 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=2
2024-12-26 19:21:40.988 [DBG] TSVR: PackSigs called
2024-12-26 19:21:41.111 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:41.112 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=1296203959 mSAT, theirBalance=18626953222 mSAT, numHtlcs=1
2024-12-26 19:21:41.184 [DBG] HSWC: ChannelLink(a9d8a5eee655f422cb8c61c37bb12e6a359eeeaac95f694cff9e4065793627a3:1): forwarding 1 packets to switch: replay=false
2024-12-26 19:21:41.184 [DBG] RFQS: Handling incoming HTLC, incoming channel ID: 962544364827639809, outgoing channel ID: 940810318473068545 (incoming amount: 51511153 mSAT, outgoing amount: 51510153 mSAT)
2024-12-26 19:21:41.184 [DBG] RFQS: Failed to find a policy for the HTLC. Resuming.
2024-12-26 19:21:41.198 [DBG] TSVR: HandleTraffic called, cid=855662:412:1, fundingBlob=(fn.Option[[]uint8]) {
isSome: (bool) false,
some: ([]uint8) <nil>
}
2024-12-26 19:21:41.198 [DBG] HSWC: ShortChannelID=855662:412:1: aux traffic shaper is handling traffic: false
2024-12-26 19:21:41.198 [DBG] HSWC: ChannelLink(441017108bcd9d8bc0edb8d02b29364f82af6c8fafab393babd97c31a1275dcb:1): queueing keystone of ADD open circuit: (Chan ID=875429:539:1, HTLC ID=10415)->(Chan ID=855662:412:1, HTLC ID=2343)
2024-12-26 19:21:41.264 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=19327710076 mSAT, theirBalance=5543606952 mSAT, numHtlcs=2
2024-12-26 19:21:41.264 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=2
2024-12-26 19:21:41.264 [DBG] TSVR: PackSigs called
2024-12-26 19:21:41.279 [DBG] HSWC: ChannelLink(441017108bcd9d8bc0edb8d02b29364f82af6c8fafab393babd97c31a1275dcb:1): removing Add packet (Chan ID=875429:539:1, HTLC ID=10415) from mailbox
2024-12-26 19:21:41.319 [DBG] TCHN: Failed to handle: *lnwire.Ping
2024-12-26 19:21:41.347 [DBG] TCHN: Failed to handle: *lnwire.Pong
2024-12-26 19:21:41.451 [DBG] TCHN: Failed to handle: *lnwire.UpdateAddHTLC
2024-12-26 19:21:41.519 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:41.520 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=19379220229 mSAT, theirBalance=5543805952 mSAT, numHtlcs=1
2024-12-26 19:21:41.543 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:41.544 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953574603 mSAT, theirBalance=8002715389 mSAT, numHtlcs=2
2024-12-26 19:21:41.544 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:41.545 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:41.559 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953574603 mSAT, theirBalance=8002715389 mSAT, numHtlcs=2
2024-12-26 19:21:41.559 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=2
2024-12-26 19:21:41.559 [DBG] TSVR: PackSigs called
2024-12-26 19:21:41.614 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:41.615 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=19327710076 mSAT, theirBalance=5543606952 mSAT, numHtlcs=2
2024-12-26 19:21:41.615 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:41.615 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:41.662 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:41.663 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=11953773603 mSAT, theirBalance=8024285261 mSAT, numHtlcs=1
2024-12-26 19:21:41.667 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:41.667 [DBG] GRPH: Checking stale node 303339306235643434393264633266353331386535323333616232636562663664343839313438383161333365663661396336626364626234333361643938366430 got Ignoring outdated announcement for 0390b5d4492dc2f5318e5233ab2cebf6d48914881a33ef6a9c6bcdbb433ad986d0
2024-12-26 19:21:41.733 [DBG] HSWC: ChannelLink(a09f808d5e8403044bbfcd5f6204577fcb9752f733b6a423bb475628b3c0db0b:1): forwarding 1 packets to switch: replay=false
2024-12-26 19:21:41.733 [DBG] RFQS: Handling incoming HTLC, incoming channel ID: 963191977160867841, outgoing channel ID: 940739949766115329 (incoming amount: 21569872 mSAT, outgoing amount: 21568872 mSAT)
2024-12-26 19:21:41.733 [DBG] RFQS: Failed to find a policy for the HTLC. Resuming.
2024-12-26 19:21:41.748 [DBG] TSVR: HandleTraffic called, cid=855598:980:1, fundingBlob=(fn.Option[[]uint8]) {
isSome: (bool) false,
some: ([]uint8) <nil>
}
2024-12-26 19:21:41.748 [DBG] HSWC: ShortChannelID=855598:980:1: aux traffic shaper is handling traffic: false
2024-12-26 19:21:41.748 [DBG] HSWC: ChannelLink(5c78cda11b3a3d11c31a82244a8c5c2565ba89ab5580da1103c83118c45d5667:1): queueing keystone of ADD open circuit: (Chan ID=876018:302:1, HTLC ID=6592)->(Chan ID=855598:980:1, HTLC ID=2674)
2024-12-26 19:21:41.762 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:41.762 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:41.762 [DBG] GRPH: Checking stale node 303366366365616136376462326363313639666238663734623736323231316533636532303435396261633532616337663863383566333531363730613662363738 got Ignoring outdated announcement for 03f6ceaa67db2cc169fb8f74b762211e3ce20459bac52ac7f8c85f351670a6b678
2024-12-26 19:21:41.762 [DBG] GRPH: Checking stale node 303238656566653235333938376439356535653332336233363366303639333161636438303262646331643039326334343439626366333331373836343439386661 got Ignoring outdated announcement for 028eefe253987d95e5e323b363f06931acd802bdc1d092c4449bcf3317864498fa
2024-12-26 19:21:41.814 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=9723030666 mSAT, theirBalance=10233261326 mSAT, numHtlcs=2
2024-12-26 19:21:41.814 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=2
2024-12-26 19:21:41.814 [DBG] TSVR: PackSigs called
2024-12-26 19:21:41.833 [DBG] HSWC: ChannelLink(5c78cda11b3a3d11c31a82244a8c5c2565ba89ab5580da1103c83118c45d5667:1): removing Add packet (Chan ID=876018:302:1, HTLC ID=6592) from mailbox
2024-12-26 19:21:42.060 [DBG] TCHN: Failed to handle: *lnwire.RevokeAndAck
2024-12-26 19:21:42.060 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=9744599538 mSAT, theirBalance=10233460326 mSAT, numHtlcs=1
2024-12-26 19:21:42.064 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:42.118 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=9723030666 mSAT, theirBalance=10233261326 mSAT, numHtlcs=2
2024-12-26 19:21:42.119 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:42.119 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:42.477 [DBG] HSWC: Sent 0 satoshis and received 0 satoshis in the last 10 seconds (1.400000 tx/sec)
2024-12-26 19:21:42.696 [DBG] TCHN: Failed to handle: *lnwire.UpdateFailHTLC
2024-12-26 19:21:42.717 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:42.717 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:42.717 [DBG] GRPH: Checking stale node 303334303138376539356561363638326333396133306662663539366130646663663365333535386363326361393036363635383539653035346261663662653138 got Ignoring outdated announcement for 0340187e95ea6682c39a30fbf596a0dfcf3e3558cc2ca906665859e054baf6be18
2024-12-26 19:21:42.717 [DBG] GRPH: Checking stale node 303333616566353138663337303338326462316237643330346162626665393533613235363364306133383861623061643831373237373766316635643830646230 got Ignoring outdated announcement for 033aef518f370382db1b7d304abbfe953a2563d0a388ab0ad8172777f1f5d80db0
2024-12-26 19:21:42.717 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:42.717 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:42.717 [DBG] GRPH: Checking stale node 303265643037643435343334366336623966636132643931363362333365313436613966336331373430333165326163336131376130376535393361636131383339 got Ignoring outdated announcement for 02ed07d454346c6b9fca2d9163b33e146a9f3c174031e2ac3a17a07e593aca1839
2024-12-26 19:21:42.717 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:42.717 [DBG] GRPH: Checking stale node 303337663632376661343537333663356562323362386138396632333031656263366338353764663263643461326264386461646130356163613836323365313830 got Ignoring outdated announcement for 037f627fa45736c5eb23b8a89f2301ebc6c857df2cd4a2bd8dada05aca8623e180
2024-12-26 19:21:42.717 [DBG] GRPH: Checking stale node 303361363939393337643562656462663762663938623533313361313663313437313231346632383934666233386664303162323262336431316432623763383039 got Ignoring outdated announcement for 03a699937d5bedbf7bf98b5313a16c1471214f2894fb38fd01b22b3d11d2b7c809
2024-12-26 19:21:42.819 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:42.819 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:42.820 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:42.820 [DBG] GRPH: Checking stale node 303363326363386131663336336333643936633434653637396131393461616538656461653930383363313931346165396464353735323236316435313563303464 got Ignoring outdated announcement for 03c2cc8a1f363c3d96c44e679a194aae8edae9083c1914ae9dd5752261d515c04d
2024-12-26 19:21:42.820 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:42.820 [DBG] GRPH: Checking stale node 303237383331666464613232613366646239356163376634613633343834363737323062613037336564623631333137633762633936353331356339653562626531 got Ignoring outdated announcement for 027831fdda22a3fdb95ac7f4a6348467720ba073edb61317c7bc965315c9e5bbe1
2024-12-26 19:21:42.820 [DBG] TCHN: Failed to handle: *lnwire.NodeAnnouncement
2024-12-26 19:21:42.820 [DBG] GRPH: Checking stale node 303337643161616432623634626666386430626461396565366339623564653966356538343936316531656262366536383638343033653163336365313436623932 got Ignoring outdated announcement for 037d1aad2b64bff8d0bda9ee6c9b5de9f5e84961e1ebb6e6868403e1c3ce146b92
2024-12-26 19:21:42.820 [DBG] GRPH: Checking stale node 303262373635643031376633616337313439663163613262656163656430343135393533633535366562346165646531343538656266393931383135376362633461 got Ignoring outdated announcement for 02b765d017f3ac7149f1ca2beaced0415953c556eb4aede1458ebf9918157cbc4a
2024-12-26 19:21:42.831 [DBG] TCHN: Failed to handle: *lnwire.CommitSig
2024-12-26 19:21:42.832 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=19379220229 mSAT, theirBalance=5543805952 mSAT, numHtlcs=1
2024-12-26 19:21:42.832 [DBG] TSVR: UnpackSigs called
2024-12-26 19:21:42.832 [DBG] TSVR: VerifySecondLevelSigs called
2024-12-26 19:21:42.848 [DBG] TSVR: FetchLeavesFromCommit called, ourBalance=19379220229 mSAT, theirBalance=5543805952 mSAT, numHtlcs=1
2024-12-26 19:21:42.848 [DBG] TSVR: SubmitSecondLevelSigBatch called, numSigs=1
2024-12-26 19:21:42.848 [DBG] TSVR: PackSigs called

@vanditshah99 vanditshah99 added bug Something isn't working needs triage labels Dec 27, 2024
@vanditshah99 vanditshah99 changed the title [bug]: rfq qupte rejected peer even though peer is connected and channel is active [bug]: rfq quote rejected peer even though peer is connected and channel is active Dec 27, 2024
@vanditshah99 vanditshah99 changed the title [bug]: rfq quote rejected peer even though peer is connected and channel is active [bug]: rfq quote rejected even though peer is connected and channel is active Dec 27, 2024
@ffranr
Copy link
Contributor

ffranr commented Jan 2, 2025

The peer logs include this line:

2024-12-26 19:21:35.105 [ERR] RFQS: Error in RFQ manager: encountered RFQ subsystem error in main event loop: failed to query ask price from oracle: failed to query price oracle for bid: rpc error: code = Unavailable desc = error reading from server: read tcp 172.18.0.2:48264->172.66.42.208:443: read: connection reset by peer

Which indicates that the peer failed to connect correctly to their price oracle service.

It seems the sender successfully retrieved a price from their price oracle service.

Does this issue occur consistently? Have you been able to make a successful payment using this setup?

@vanditshah99
Copy link
Author

The payment does go through but after multiple retires, Determined the logs of the rfq-server and checked it was up and running.

@ffranr
Copy link
Contributor

ffranr commented Jan 6, 2025

The payment does go through but after multiple retires, Determined the logs of the rfq-server and checked it was up and running.

If it goes through after multiple tries does that mean that receiver peer just needed to retry connecting to the price oracle service?

Do the logs indicate that the attempt failed multiple times and then succeeded?

Do the price oracle service logs show anything interesting?

Maybe we need to have a more robust routine for querying the price oracle service.

@vanditshah99
Copy link
Author

Price Oracle doesn't show anything for logs as it is just a service that is being providing an exchange rate for the demanded asset, do we need to profile that service? What steps do we need to do, moving ahead?

@Roasbeef Roasbeef added this to the v0.6 milestone Jan 10, 2025
@Roasbeef Roasbeef added the P0 label Jan 10, 2025
@Roasbeef Roasbeef modified the milestones: v0.6, v0.5.1 Jan 23, 2025
@guggero
Copy link
Member

guggero commented Jan 23, 2025

@vanditshah99 can you give us more info on the price oracle service? Is it based on our example code and written in Golang? Did you write the code and is it available somewhere? Is it in the same network as your node?

As already mentioned above by @ffranr, the relevant part of the error is read tcp 172.18.0.2:48264->172.66.42.208:443: read: connection reset by peer which would indicate either a networking issue or the price oracle service just stopping to respond.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working needs triage P0
Projects
Status: 🆕 New
Development

No branches or pull requests

4 participants