[parachain] Second meetup in bootstrap.py --test fails due to 0 attestees

[clangenb]

We observe this only on the parachain, and there it is consistent.

The CLI does consistently say 0 attestees:

Reproduce with:

• This node: encointer/encointer-parachain@a68459b
  • and run: zombienet-linux-x64 spawn --provider native zombienet/rococo-local-with-encointer.toml
• And this client: 2ec55b4
  • ./bootstrap_demo_community.py --signer //Alice -w collective -b 7 --test

./bootstrap_demo_community.py --signer //Alice -w collective -b 7 --test                                                            ok | 09:56:04
IPFS environment not set up for using gateway
🔌 connecting to remote chain:  ws://127.0.0.1
👬 Registered community with cid: sqm1v79dF6b
Uploading assets to ipfs
Updating Community spec with ipfs cid: QmP2fzfikh7VqTu8pvzd2G2vAd4eK7EaazXTEgqGN6AWoD
{'type': 'FeatureCollection', 'community': {'meta': {'name': 'Mediterranea', 'symbol': 'MTA', 'assets': 'QmP2fzfikh7VqTu8pvzd2G2vAd4eK7EaazXTEgqGN6AWoD', 'announcementSigner': None, 'rules': 'loCo'}, 'bootstrappers': ['5GrwvaEF5zXb26Fz9rcQpDWS57CtERHpNehXCPcNoHGKutQY', '5FHneW46xGXgs5mUiveU4sbTyGBzmstUspZC92UhjJM694ty', '5FLSigC9HGRKVhB9FiEo4Y3koPsNmBmLJbpXg2mp1hXcS59Y', '5DAAnrj7VHTznn2AWBemMuyBwZWs6FNFjdyVXUeYum3PTXFy', '5HGjWAeFDfFCWPsjFQdVV2Msvz2XtMktvgocEZcCj68kUMaw', '5CiPPseXPECbkjWCa6MnjNokrgYjMqmKndv2rSnekmSK2DjL'], 'demurrage_halving_blocks': 7884000, 'ceremony_income': 1.0}, 'features': [{'type': 'Feature', 'properties': {}, 'geometry': {'type': 'Point', 'coordinates': [18.543548583984375, 35.48415637985317]}}, {'type': 'Feature', 'properties': {}, 'geometry': {'type': 'Point', 'coordinates': [18.40484619140625, 35.480801595828616]}}, {'type': 'Feature', 'properties': {}, 'geometry': {'type': 'Point', 'coordinates': [18.40621948242187, 35.357696204467516]}}, {'type': 'Feature', 'properties': {}, 'geometry': {'type': 'Point', 'coordinates': [18.544921875, 35.35993616287676]}}, {'type': 'Feature', 'properties': {}, 'geometry': {'type': 'Point', 'coordinates': [18.68087768554687, 35.48751102385376]}}, {'type': 'Feature', 'properties': {}, 'geometry': {'type': 'Point', 'coordinates': [18.689117431640625, 35.37001520672124]}}, {'type': 'Feature', 'properties': {}, 'geometry': {'type': 'Point', 'coordinates': [18.4075927734375, 35.232159412017154]}}, {'type': 'Feature', 'properties': {}, 'geometry': {'type': 'Point', 'coordinates': [18.551788330078125, 35.238889532322595]}}, {'type': 'Feature', 'properties': {}, 'geometry': {'type': 'Point', 'coordinates': [18.700103759765625, 35.24898366572645]}}]}
✨ native (Alice)Faucet is dripping...
we are the faucet
[2025-01-18T08:57:54Z ERROR encointer_client_notee::commands::encointer_core] couldn't decode event record list
Alice-Faucet drips 3891423333333 to 5FLSigC9HGRKVhB9FiEo4Y3koPsNmBmLJbpXg2mp1hXcS59Y (Alice's nonce=3)
Alice-Faucet drips 3891423333333 to 5Cetuo1NhgdDTfNvFEQ3HLZHW7RyLB41rxkpofZa9EHpq9H3 (Alice's nonce=4)

⌛  Waiting for 3 blocks, such that xt's are processed...
number of communities:  1
sqm1v79dF6b: Mediterranea, locations: 9, nominal income: 1 MTA, demurrage: 0.00000008791821281244/block, CommunityRules::LoCo
⏱ Advancing to phase: CeremonyPhase.Registering
⏱ Arrived at CeremonyPhase.Registering.
📝 Registering Participants for cid: sqm1v79dF6b
⌛ Waiting for 3 blocks, such that xt's are processed...
listing participants for cid sqm1v79dF6b and ceremony nr 1
Querying BootstrapperRegistry
number of participants assigned:  3
BootstrapperRegistry[1, 1] = 5GrwvaEF5zXb26Fz9rcQpDWS57CtERHpNehXCPcNoHGKutQY
BootstrapperRegistry[1, 2] = 5FHneW46xGXgs5mUiveU4sbTyGBzmstUspZC92UhjJM694ty
BootstrapperRegistry[1, 3] = 5FLSigC9HGRKVhB9FiEo4Y3koPsNmBmLJbpXg2mp1hXcS59Y
Querying ReputableRegistry
number of participants assigned:  0
Querying EndorseeRegistry
number of participants assigned:  0
Querying NewbieRegistry
number of participants assigned:  0
CSV: 1, sqm1v79dF6b, 3, 0, 0, 0
total: 3 guaranteed seats + 0 newbies = 3 total participants who would like to attend
Listing meetups
[['5FLSigC9HGRKVhB9FiEo4Y3koPsNmBmLJbpXg2mp1hXcS59Y', '5FHneW46xGXgs5mUiveU4sbTyGBzmstUspZC92UhjJM694ty', '5GrwvaEF5zXb26Fz9rcQpDWS57CtERHpNehXCPcNoHGKutQY']]
Performing meetups for cid sqm1v79dF6b
🫂 Starting meetup...
Attest other attendees...
⌛ Waiting for 3 blocks, such that xt's are processed...
[2025-01-18T08:58:54Z ERROR encointer_client_notee::commands::encointer_core] couldn't decode event record list
listing attestees for cid sqm1v79dF6b and ceremony nr 1
number of attestees:  3
listing participants for cid sqm1v79dF6b and ceremony nr 1
Querying BootstrapperRegistry
number of participants assigned:  3
Querying ReputableRegistry
number of participants assigned:  0
Querying EndorseeRegistry
number of participants assigned:  0
Querying NewbieRegistry
number of participants assigned:  0
AttestationState { community_ceremony: (sqm1v79dF6b, 1), meetup_index: 1, vote: 3, attestation_index: 1, attestor: d43593c715fdd31c61141abd04a99fd6822c8558854ccde39a5684e7a56da27d (5GrwvaEF...), attestees: [90b5ab205c6974c9ea841be688864633dc9ca8a357843eeacf2314649965fe22 (5FLSigC9...), 8eaf04151687736326c9fea17e25fc5287613693c912909cb226aa4794f26a48 (5FHneW46...)] }
AttestationState { community_ceremony: (sqm1v79dF6b, 1), meetup_index: 1, vote: 3, attestation_index: 2, attestor: 8eaf04151687736326c9fea17e25fc5287613693c912909cb226aa4794f26a48 (5FHneW46...), attestees: [90b5ab205c6974c9ea841be688864633dc9ca8a357843eeacf2314649965fe22 (5FLSigC9...), d43593c715fdd31c61141abd04a99fd6822c8558854ccde39a5684e7a56da27d (5GrwvaEF...)] }
AttestationState { community_ceremony: (sqm1v79dF6b, 1), meetup_index: 1, vote: 3, attestation_index: 3, attestor: 90b5ab205c6974c9ea841be688864633dc9ca8a357843eeacf2314649965fe22 (5FLSigC9...), attestees: [8eaf04151687736326c9fea17e25fc5287613693c912909cb226aa4794f26a48 (5FHneW46...), d43593c715fdd31c61141abd04a99fd6822c8558854ccde39a5684e7a56da27d (5GrwvaEF...)] }
CSVmeetupVotes: 1, sqm1v79dF6b, 1, 3, 3.000, "3;3;3"
cindex, cid, assignees, attestors, sum of mean votes
CSV: 1, sqm1v79dF6b, 3, 3, 3
Claiming early rewards
🏆 Claiming rewards
🕑 New phase is Registering. ceremony index is 2
[2025-01-18T08:59:36Z ERROR encointer_client_notee::commands::encointer_core] couldn't decode event record list
Balances for new community with cid: sqm1v79dF6b.
Account balance for //Alice is 0.9999996483272106.
Account balance for //Bob is 0.9999996483272106.
Account balance for //Charlie is 0.9999996483272106.
[('1', 'sqm1v79dF6b', 'VerifiedUnlinked')]
number of communities:  1
sqm1v79dF6b: Mediterranea, locations: 9, nominal income: 1 MTA, demurrage: 0.00000008791821281244/block, CommunityRules::LoCo
⏱ Advancing to phase: CeremonyPhase.Registering
⏱ Arrived at CeremonyPhase.Registering.
📝 Registering Participants for cid: sqm1v79dF6b
⌛ Waiting for 3 blocks, such that xt's are processed...
listing participants for cid sqm1v79dF6b and ceremony nr 2
Querying BootstrapperRegistry
number of participants assigned:  3
BootstrapperRegistry[2, 1] = 5GrwvaEF5zXb26Fz9rcQpDWS57CtERHpNehXCPcNoHGKutQY
BootstrapperRegistry[2, 2] = 5FHneW46xGXgs5mUiveU4sbTyGBzmstUspZC92UhjJM694ty
BootstrapperRegistry[2, 3] = 5FLSigC9HGRKVhB9FiEo4Y3koPsNmBmLJbpXg2mp1hXcS59Y
Querying ReputableRegistry
number of participants assigned:  0
Querying EndorseeRegistry
number of participants assigned:  0
Querying NewbieRegistry
number of participants assigned:  0
CSV: 2, sqm1v79dF6b, 3, 0, 0, 0
total: 3 guaranteed seats + 0 newbies = 3 total participants who would like to attend
Listing meetups
[['5FHneW46xGXgs5mUiveU4sbTyGBzmstUspZC92UhjJM694ty', '5GrwvaEF5zXb26Fz9rcQpDWS57CtERHpNehXCPcNoHGKutQY', '5FLSigC9HGRKVhB9FiEo4Y3koPsNmBmLJbpXg2mp1hXcS59Y']]
Performing meetups for cid sqm1v79dF6b
🫂 Starting meetup...
Attest other attendees...
⌛ Waiting for 3 blocks, such that xt's are processed...
[2025-01-18T09:00:06Z ERROR encointer_client_notee::commands::encointer_core] couldn't decode event record list
listing attestees for cid sqm1v79dF6b and ceremony nr 2
number of attestees:  0
listing participants for cid sqm1v79dF6b and ceremony nr 2
Querying BootstrapperRegistry
number of participants assigned:  3
Querying ReputableRegistry
number of participants assigned:  0
Querying EndorseeRegistry
number of participants assigned:  0
Querying NewbieRegistry
number of participants assigned:  0
CSVmeetupVotes: 2, sqm1v79dF6b, 1, 3, 0.000, ""
cindex, cid, assignees, attestors, sum of mean votes
CSV: 2, sqm1v79dF6b, 3, 0, 0
🕑 New phase is Registering. ceremony index is 3
[2025-01-18T09:00:30Z ERROR encointer_client_notee::commands::encointer_core] couldn't decode event record list
🏆 Claiming rewards
################ Testing the EncointerFaucet....
[2025-01-18T09:01:00Z ERROR encointer_client_notee::commands::encointer_core] couldn't decode event record list
1.1429114397294214e+18
1.1529214397294214e+18
1e+16
Faucet created
Charlie uses participation at cindex: 2 to drip faucet and pays fees in CC
[2025-01-18T09:01:42Z ERROR encointer_client_notee::commands::encointer_core] ExtrinsicFailed: Event::ExtrinsicFailed { dispatch_error: Module(ModuleError { index: 65, error: [1, 0, 0, 0], message: None }), dispatch_info: DispatchInfo { weight: Weight { ref_time: 671741000, proof_size: 12838 }, class: DispatchClass::Normal, pays_fee: Pays::Yes } }
Drip failed

[clangenb]

What is weird, I can see that the attestations are registered:

But in the above log, we see attestees is 0, and the meetup evaluation does still fail.

[clangenb]

Hmm, it could be that we just have a phase issue, this in this run we see that only one attestation makes it onchain and 2 are discarded due to wrong phase: https://github.com/encointer/encointer-parachain/actions/runs/12842890953/job/35814334830

[clangenb]

Is it maybe because waiting for inblock is not enough, and we need finalized to get a consistent result?

[clangenb]

In the zombienet integration test they simply allow invalid tx's, as they are the result of a tx already included in another block: https://github.com/paritytech/zombienet/blob/cf4d25153cfa50b516dc718003311dc56d6a3611/javascript/packages/orchestrator/src/jsapi-helpers/chainUpgrade.ts#L132.

Maybe, our problem is that the send attestations are in a block, which gets rejected, and in the meantime we include the next-phase tx. If our sent-attestations tx's are then included in a canonical block, we get the error that attestation phase is required.

Hence, the possible solution is to accept tx-status invalid and to wait longer to make sure that our tx's are in the canonical chain.