Rosetta-cli reconciliations

raynaudoe · August 5, 2020, 5:36pm

Hi!
while using rosetta-cli check:data --configuration-file ./rosetta-config --end 1000 , I’m getting the following message:

[STATS] Blocks: 1001 (Orphaned: 0) Transactions: 111487 Operations: 222974 Reconciliations: 0 (Inactive: 0)
Check succeeded, however, no reconciliations were performed!

I would like to get those reconciliation checks done, I currently have "reconciliation_disabled": false on my config file, is that correct ?

Thanks!

patrick.ogrady · August 5, 2020, 6:07pm

If you wish to reconcile balances before the rosetta-cli reaches tip (which I am assuming is the case), you must support historical_balance_lookup. Unfortunately, there is no way to reconcile (compare computed balance with the balance returned via the /account/balance endpoint) at early blocks if we can’t fetch the balance at those blocks (we can only get the balance at the current block).

If you wait until the rosetta-cli syncs to tip (when historical_balance_lookup=false), it will automatically begin performing reconciliations when it determines it is possible. If you are curious how it does this, take a look at the reconciler package!

github.com

coinbase/rosetta-sdk-go/blob/master/reconciler/reconciler.go

// Copyright 2020 Coinbase, Inc.
//
// Licensed under the Apache License, Version 2.0 (the "License");
// you may not use this file except in compliance with the License.
// You may obtain a copy of the License at
//
//      http://www.apache.org/licenses/LICENSE-2.0
//
// Unless required by applicable law or agreed to in writing, software
// distributed under the License is distributed on an "AS IS" BASIS,
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
// See the License for the specific language governing permissions and
// limitations under the License.

package reconciler

import (
	"context"
	"errors"
	"fmt"

This file has been truncated. show original

raynaudoe · August 5, 2020, 6:21pm

Great, thanks @patrick.ogrady
The flag --end doesn’t work as a “tip”, right ?
The blockchain I’m now using takes about 2s for each /block call, and it has more than 170k blocks, so it’s going to take a while to reach the reconciliations stage

patrick.ogrady · August 5, 2020, 6:26pm

No it does not . We are actively working on adding more sophisticated end conditions (like reaching tip, performing some number of reconciliations, etc.). We are tracking it with an issue in rosetta-cli (hoping to add support within the week).

Have you tried increasing the block_concurrency parameter in your config file? When doing my own testing, I usually ramp this up to 32 or even 64.

raynaudoe · August 5, 2020, 8:45pm

Great, will try that!