Bitcoin ABC 0.30.9
P2P Digital Currency
|
Provides an interface for creating and interacting with one or two chainstates: an IBD chainstate generated by downloading blocks, and an optional snapshot chainstate loaded from a UTXO snapshot. More...
#include <validation.h>
Public Types | |
using | Options = kernel::ChainstateManagerOpts |
Public Member Functions | |
ChainstateManager (Options options, node::BlockManager::Options blockman_options) | |
const Config & | GetConfig () const |
const CChainParams & | GetParams () const |
const Consensus::Params & | GetConsensus () const |
bool | ShouldCheckBlockIndex () const |
const arith_uint256 & | MinimumChainWork () const |
const BlockHash & | AssumedValidBlock () const |
kernel::Notifications & | GetNotifications () const |
void | CheckBlockIndex () |
Make various assertions about the state of the block index. More... | |
RecursiveMutex & | GetMutex () const LOCK_RETURNED( |
Alias for cs_main. More... | |
void | ResetBlockSequenceCounters () EXCLUSIVE_LOCKS_REQUIRED( |
CBlockIndex *m_best_header | GUARDED_BY (::cs_main) |
Best header we've seen so far (used for getheaders queries' starting points). More... | |
bool | ActivateSnapshot (AutoFile &coins_file, const node::SnapshotMetadata &metadata, bool in_memory) |
Construct and activate a Chainstate on the basis of UTXO snapshot data. More... | |
SnapshotCompletionResult MaybeCompleteSnapshotValidation(std::function< void(bilingual_str)> shutdown_fnc=[](bilingual_str msg) { AbortNode(msg.original, msg);}) EXCLUSIVE_LOCKS_REQUIRED(Chainstate & | ActiveChainstate () const |
Once the background validation chainstate has reached the height which is the base of the UTXO snapshot in use, compare its coins to ensure they match those expected by the snapshot. More... | |
CChain & | ActiveChain () const EXCLUSIVE_LOCKS_REQUIRED(GetMutex()) |
int | ActiveHeight () const EXCLUSIVE_LOCKS_REQUIRED(GetMutex()) |
CBlockIndex * | ActiveTip () const EXCLUSIVE_LOCKS_REQUIRED(GetMutex()) |
node::BlockMap & | BlockIndex () EXCLUSIVE_LOCKS_REQUIRED( |
bool | IsSnapshotActive () const |
std::optional< BlockHash > | SnapshotBlockhash () const |
bool | IsSnapshotValidated () const EXCLUSIVE_LOCKS_REQUIRED( |
Is there a snapshot in use and has it been fully validated? More... | |
void | LoadExternalBlockFile (FILE *fileIn, FlatFilePos *dbp=nullptr, std::multimap< BlockHash, FlatFilePos > *blocks_with_unknown_parent=nullptr, avalanche::Processor *const avalanche=nullptr) |
Import blocks from an external file. More... | |
bool | ProcessNewBlock (const std::shared_ptr< const CBlock > &block, bool force_processing, bool min_pow_checked, bool *new_block, avalanche::Processor *const avalanche=nullptr) LOCKS_EXCLUDED(cs_main) |
Process an incoming block. More... | |
bool | ProcessNewBlockHeaders (const std::vector< CBlockHeader > &block, bool min_pow_checked, BlockValidationState &state, const CBlockIndex **ppindex=nullptr, const std::optional< CCheckpointData > &test_checkpoints=std::nullopt) LOCKS_EXCLUDED(cs_main) |
Process incoming block headers. More... | |
bool | AcceptBlock (const std::shared_ptr< const CBlock > &pblock, BlockValidationState &state, bool fRequested, const FlatFilePos *dbp, bool *fNewBlock, bool min_pow_checked) EXCLUSIVE_LOCKS_REQUIRED(cs_main) |
Sufficiently validate a block for disk storage (and store on disk). More... | |
void | ReceivedBlockTransactions (const CBlock &block, CBlockIndex *pindexNew, const FlatFilePos &pos) EXCLUSIVE_LOCKS_REQUIRED(cs_main) |
Mark a block as having its data received and checked (up to BLOCK_VALID_TRANSACTIONS). More... | |
MempoolAcceptResult | ProcessTransaction (const CTransactionRef &tx, bool test_accept=false) EXCLUSIVE_LOCKS_REQUIRED(cs_main) |
Try to add a transaction to the memory pool. More... | |
bool | LoadBlockIndex () EXCLUSIVE_LOCKS_REQUIRED(cs_main) |
Load the block tree and coins database from disk, initializing state if we're running with -reindex. More... | |
void MaybeRebalanceCaches() EXCLUSIVE_LOCKS_REQUIRED(void | ReportHeadersPresync (const arith_uint256 &work, int64_t height, int64_t timestamp) |
Check to see if caches are out of balance and if so, call ResizeCoinsCaches() as needed. More... | |
bool | LoadRecentHeadersTime (const fs::path &filePath) EXCLUSIVE_LOCKS_REQUIRED(GetMutex()) |
Load the recent block headers reception time from a file. More... | |
Public Attributes | |
const Options | m_options |
std::thread | m_load_block |
node::BlockManager | m_blockman |
A single BlockManager instance is shared across each constructed chainstate to avoid duplicating block metadata. More... | |
std::atomic< int32_t > | nBlockSequenceId {1} |
Every received block is assigned a unique and increasing identifier, so we know which one to give priority in case of a fork. More... | |
int32_t | nBlockReverseSequenceId = -1 |
Decreasing counter (used by subsequent preciousblock calls). More... | |
arith_uint256 | nLastPreciousChainwork = 0 |
chainwork for the last block that preciousblock has been applied to. More... | |
std::set< CBlockIndex * > | m_failed_blocks |
In order to efficiently track invalidity of headers, we keep the set of blocks which we tried to connect and found to be invalid here (ie which were set to BLOCK_FAILED_VALID since the last restart). More... | |
int64_t | m_total_coinstip_cache {0} |
The total number of bytes available for us to use across all in-memory coins caches. More... | |
int64_t | m_total_coinsdb_cache {0} |
The total number of bytes available for us to use across all leveldb coins databases. More... | |
Chainstate &InitializeChainstate(CTxMemPool *mempool) EXCLUSIVE_LOCKS_REQUIRED(std::vector< Chainstate * | GetAll )() |
Instantiate a new chainstate. More... | |
bool DetectSnapshotChainstate(CTxMemPool *mempool) EXCLUSIVE_LOCKS_REQUIRED(void ResetChainstates() EXCLUSIVE_LOCKS_REQUIRED(Chainstate &ActivateExistingSnapshot(CTxMemPool *mempool, BlockHash base_blockhash) EXCLUSIVE_LOCKS_REQUIRED(bool ValidatedSnapshotCleanup() EXCLUSIVE_LOCKS_REQUIRED(boo | DumpRecentHeadersTime )(const fs::path &filePath) const EXCLUSIVE_LOCKS_REQUIRED(GetMutex()) |
When starting up, search the datadir for a chainstate based on a UTXO snapshot that is in the process of being validated. More... | |
Private Member Functions | |
std::unique_ptr< Chainstate > m_ibd_chainstate | GUARDED_BY (::cs_main) |
The chainstate used under normal operation (i.e. More... | |
std::unique_ptr< Chainstate > m_snapshot_chainstate | GUARDED_BY (::cs_main) |
A chainstate initialized on the basis of a UTXO snapshot. More... | |
Chainstate *m_active_chainstate | GUARDED_BY (::cs_main) |
Points to either the ibd or snapshot chainstate; indicates our most-work chain. More... | |
CBlockIndex *m_best_invalid | GUARDED_BY (::cs_main) |
CBlockIndex *m_best_parked | GUARDED_BY (::cs_main) |
bool | PopulateAndValidateSnapshot (Chainstate &snapshot_chainstate, AutoFile &coins_file, const node::SnapshotMetadata &metadata) |
Internal helper for ActivateSnapshot(). More... | |
bool | AcceptBlockHeader (const CBlockHeader &block, BlockValidationState &state, CBlockIndex **ppindex, bool min_pow_checked, const std::optional< CCheckpointData > &test_checkpoints=std::nullopt) EXCLUSIVE_LOCKS_REQUIRED(cs_main) |
If a block header hasn't already been seen, call CheckBlockHeader on it, ensure that it doesn't descend from an invalid block, and then add it to m_block_index. More... | |
const CBlockIndex *GetSnapshotBaseBlock() const EXCLUSIVE_LOCKS_REQUIRED(std::optional< int > GetSnapshotBaseHeight() const EXCLUSIVE_LOCKS_REQUIRED(bool | IsUsable (const Chainstate *const pchainstate) const EXCLUSIVE_LOCKS_REQUIRED( |
Returns nullptr if no snapshot has been loaded. More... | |
SteadyMilliseconds m_last_presync_update | GUARDED_BY (::cs_main) |
Most recent headers presync progress update, for rate-limiting. More... | |
Private Attributes | |
friend | Chainstate |
Provides an interface for creating and interacting with one or two chainstates: an IBD chainstate generated by downloading blocks, and an optional snapshot chainstate loaded from a UTXO snapshot.
Managed chainstates can be maintained at different heights simultaneously.
This class provides abstractions that allow the retrieval of the current most-work chainstate ("Active") as well as chainstates which may be in background use to validate UTXO snapshots.
Definitions:
IBD chainstate: a chainstate whose current state has been "fully" validated by the initial block download process.
Snapshot chainstate: a chainstate populated by loading in an assumeutxo UTXO snapshot.
Active chainstate: the chainstate containing the current most-work chain. Consulted by most parts of the system (net_processing, wallet) as a reflection of the current chain and UTXO set. This may either be an IBD chainstate or a snapshot chainstate.
Background IBD chainstate: an IBD chainstate for which the IBD process is happening in the background while use of the active (snapshot) chainstate allows the rest of the system to function.
Definition at line 1154 of file validation.h.
Definition at line 1241 of file validation.h.
|
explicit |
Definition at line 6948 of file validation.cpp.
bool ChainstateManager::AcceptBlock | ( | const std::shared_ptr< const CBlock > & | pblock, |
BlockValidationState & | state, | ||
bool | fRequested, | ||
const FlatFilePos * | dbp, | ||
bool * | fNewBlock, | ||
bool | min_pow_checked | ||
) |
Sufficiently validate a block for disk storage (and store on disk).
[in] | pblock | The block we want to process. |
[in] | fRequested | Whether we requested this block from a peer. |
[in] | dbp | The location on disk, if we are importing this block from prior storage. |
[in] | min_pow_checked | True if proof-of-work anti-DoS checks have been done by caller for headers chain |
[out] | state | The state of the block validation. |
[out] | fNewBlock | Optional return parameter to indicate if the block is new to our storage. |
Definition at line 4724 of file validation.cpp.
|
private |
If a block header hasn't already been seen, call CheckBlockHeader on it, ensure that it doesn't descend from an invalid block, and then add it to m_block_index.
If the provided block header is valid, add it to the block index.
Caller must set min_pow_checked=true in order to add a new header to the block index (permanent memory storage), indicating that the header is known to be part of a sufficiently high-work chain (anti-dos check).
Returns true if the block is successfully added to the block index.
Definition at line 4501 of file validation.cpp.
bool ChainstateManager::ActivateSnapshot | ( | AutoFile & | coins_file, |
const node::SnapshotMetadata & | metadata, | ||
bool | in_memory | ||
) |
Construct and activate a Chainstate on the basis of UTXO snapshot data.
Steps:
CoinsViews
contents from coins_file
.m_snapshot_chainstate
and make it our ActiveChainstate(). Definition at line 6365 of file validation.cpp.
|
inline |
Chainstate & ChainstateManager::ActiveChainstate | ( | ) | const |
Once the background validation chainstate has reached the height which is the base of the UTXO snapshot in use, compare its coins to ensure they match those expected by the snapshot.
If the coins match (expected), then mark the validation chainstate for deletion and continue using the snapshot chainstate as active. Otherwise, revert to using the ibd chainstate and shutdown. The most-work chain.
Definition at line 6869 of file validation.cpp.
|
inline |
|
inline |
|
inline |
|
inline |
Definition at line 1402 of file validation.h.
void ChainstateManager::CheckBlockIndex | ( | ) |
Make various assertions about the state of the block index.
By default this only executes fully when using the Regtest chain; see: m_options.check_block_index.
Definition at line 5844 of file validation.cpp.
|
inline |
|
inline |
|
inline |
Alias for cs_main.
Should be used in new code to make it easier to make cs_main a member of this class. Generally, methods of this class should be annotated to require this mutex. This will make calling code more verbose, but also help to:
Definition at line 1286 of file validation.h.
|
inline |
|
inline |
|
private |
The chainstate used under normal operation (i.e.
"regular" IBD) or, if a snapshot is in use, for background validation.
Its contents (including on-disk data) will be deleted upon shutdown after background validation of the snapshot has completed. We do not free the chainstate contents immediately after it finishes validation to cautiously avoid a case where some other part of the system is still using this pointer (e.g. net_processing).
Once this pointer is set to a corresponding chainstate, it will not be reset until init.cpp:Shutdown().
This is especially important when, e.g., calling ActivateBestChain() on all chainstates because we are not able to hold cs_main going into that call.
|
private |
A chainstate initialized on the basis of a UTXO snapshot.
If this is non-null, it is always our active chainstate.
Once this pointer is set to a corresponding chainstate, it will not be reset until init.cpp:Shutdown().
This is especially important when, e.g., calling ActivateBestChain() on all chainstates because we are not able to hold cs_main going into that call.
|
inlineprivate |
Points to either the ibd or snapshot chainstate; indicates our most-work chain.
Once this pointer is set to a corresponding chainstate, it will not be reset until init.cpp:Shutdown().
This is especially important when, e.g., calling ActivateBestChain() on all chainstates because we are not able to hold cs_main going into that call.
Definition at line 1193 of file validation.h.
|
inlineprivate |
Definition at line 1195 of file validation.h.
|
inlineprivate |
Definition at line 1196 of file validation.h.
|
inlineprivate |
Most recent headers presync progress update, for rate-limiting.
Definition at line 1238 of file validation.h.
|
inline |
Best header we've seen so far (used for getheaders queries' starting points).
Definition at line 1341 of file validation.h.
bool ChainstateManager::IsSnapshotActive | ( | ) | const |
Definition at line 6875 of file validation.cpp.
|
inline |
Is there a snapshot in use and has it been fully validated?
Definition at line 1414 of file validation.h.
|
inlineprivate |
Returns nullptr if no snapshot has been loaded.
Return the height of the base block of the snapshot in use, if one exists, else nullopt. Return true if a chainstate is considered usable.
This is false when a background validation chainstate has completed its validation of an assumed-valid chainstate, or when a snapshot chainstate has been found to be invalid.
Definition at line 1232 of file validation.h.
bool ChainstateManager::LoadBlockIndex | ( | ) |
Load the block tree and coins database from disk, initializing state if we're running with -reindex.
Definition at line 5513 of file validation.cpp.
void ChainstateManager::LoadExternalBlockFile | ( | FILE * | fileIn, |
FlatFilePos * | dbp = nullptr , |
||
std::multimap< BlockHash, FlatFilePos > * | blocks_with_unknown_parent = nullptr , |
||
avalanche::Processor *const | avalanche = nullptr |
||
) |
Import blocks from an external file.
During reindexing, this function is called for each block file (datadir/blocks/blk?????.dat). It reads all blocks contained in the given file and attempts to process them (add them to the block index). The blocks may be out of order within each file and across files. Often this function reads a block but finds that its parent hasn't been read yet, so the block can't be processed yet. The function will add an entry to the blocks_with_unknown_parent map (which is passed as an argument), so that when the block's parent is later read and processed, this function can re-read the child block from disk and process it.
Because a block's parent may be in a later file, not just later in the same file, the blocks_with_unknown_parent map must be passed in and out with each call. It's a multimap, rather than just a map, because multiple blocks may have the same parent (when chain splits or stale blocks exist). It maps from parent-hash to child-disk-position.
This function can also be used to read blocks from user-specified block files using the -loadblock= option. There's no unknown-parent tracking, so the last two arguments are omitted.
[in] | fileIn | FILE handle to file containing blocks to read |
[in] | dbp | (optional) Disk block position (only for reindex) |
[in,out] | blocks_with_unknown_parent | (optional) Map of disk positions for blocks with unknown parent, key is parent block hash (only used for reindex) |
Definition at line 5611 of file validation.cpp.
bool ChainstateManager::LoadRecentHeadersTime | ( | const fs::path & | filePath | ) |
Load the recent block headers reception time from a file.
Definition at line 5461 of file validation.cpp.
|
inline |
|
private |
Internal helper for ActivateSnapshot().
Definition at line 6506 of file validation.cpp.
bool ChainstateManager::ProcessNewBlock | ( | const std::shared_ptr< const CBlock > & | block, |
bool | force_processing, | ||
bool | min_pow_checked, | ||
bool * | new_block, | ||
avalanche::Processor *const | avalanche = nullptr |
||
) |
Process an incoming block.
This only returns after the best known valid block is made active. Note that it does not, however, guarantee that the specific block passed to it has been checked for validity!
If you want to possibly get feedback on whether block is valid, you must install a CValidationInterface (see validationinterface.h) - this will have its BlockChecked method called whenever any block completes validation.
Note that we guarantee that either the proof-of-work is valid on block, or (and possibly also) BlockChecked will have been called.
May not be called in a validationinterface callback.
[in] | block | The block we want to process. |
[in] | force_processing | Process this block even if unrequested; used for non-network block sources. |
[in] | min_pow_checked | True if proof-of-work anti-DoS checks have been done by caller for headers chain (note: only affects headers acceptance; if block header is already present in block index then this parameter has no effect) |
[out] | new_block | A boolean which is set to indicate if the block was first received via this call. |
Definition at line 4889 of file validation.cpp.
bool ChainstateManager::ProcessNewBlockHeaders | ( | const std::vector< CBlockHeader > & | block, |
bool | min_pow_checked, | ||
BlockValidationState & | state, | ||
const CBlockIndex ** | ppindex = nullptr , |
||
const std::optional< CCheckpointData > & | test_checkpoints = std::nullopt |
||
) |
Process incoming block headers.
May not be called in a validationinterface callback.
[in] | block | The block headers themselves. |
[in] | min_pow_checked | True if proof-of-work anti-DoS checks have been done by caller for headers chain |
[out] | state | This may be set to an Error state if any error occurred processing them. |
[out] | ppindex | If set, the pointer will be set to point to the last new block index object for the given headers. |
Definition at line 4648 of file validation.cpp.
MempoolAcceptResult ChainstateManager::ProcessTransaction | ( | const CTransactionRef & | tx, |
bool | test_accept = false |
||
) |
Try to add a transaction to the memory pool.
[in] | tx | The transaction to submit for mempool acceptance. |
[in] | test_accept | When true, run validation checks but don't submit to mempool. |
Definition at line 4944 of file validation.cpp.
void ChainstateManager::ReceivedBlockTransactions | ( | const CBlock & | block, |
CBlockIndex * | pindexNew, | ||
const FlatFilePos & | pos | ||
) |
Mark a block as having its data received and checked (up to BLOCK_VALID_TRANSACTIONS).
Definition at line 4111 of file validation.cpp.
void ChainstateManager::ReportHeadersPresync | ( | const arith_uint256 & | work, |
int64_t | height, | ||
int64_t | timestamp | ||
) |
Check to see if caches are out of balance and if so, call ResizeCoinsCaches() as needed.
This is used by net_processing to report pre-synchronization progress of headers, as headers are not yet fed to validation during that time, but validation is (for now) responsible for logging and signalling through NotifyHeaderTip, so it needs this information.
Definition at line 4688 of file validation.cpp.
|
inline |
|
inline |
std::optional< BlockHash > ChainstateManager::SnapshotBlockhash | ( | ) | const |
|
private |
Definition at line 1216 of file validation.h.
bool ChainstateManager::DumpRecentHeadersTime |
When starting up, search the datadir for a chainstate based on a UTXO snapshot that is in the process of being validated.
Switch the active chainstate to one based on a UTXO snapshot that was loaded previously. If we have validated a snapshot chain during this runtime, copy its chainstate directory over to the main chainstate
location, completing validation of the snapshot.
If the cleanup succeeds, the caller will need to ensure chainstates are reinitialized, since ResetChainstates() will be called before leveldb directories are moved or deleted.
Definition at line 1589 of file validation.h.
std::vector< Chainstate * > ChainstateManager::GetAll |
Instantiate a new chainstate.
[in] | mempool | The mempool to pass to the chainstate Get all chainstates currently being used. |
Definition at line 1359 of file validation.h.
node::BlockManager ChainstateManager::m_blockman |
A single BlockManager instance is shared across each constructed chainstate to avoid duplicating block metadata.
Definition at line 1294 of file validation.h.
std::set<CBlockIndex *> ChainstateManager::m_failed_blocks |
In order to efficiently track invalidity of headers, we keep the set of blocks which we tried to connect and found to be invalid here (ie which were set to BLOCK_FAILED_VALID since the last restart).
We can then walk this set and check if a new header is a descendant of something in this set, preventing us from having to walk m_block_index when we try to connect a bad block and fail.
While this is more complicated than marking everything which descends from an invalid block as invalid at the time we discover it to be invalid, doing so would require walking all of m_block_index to find all descendants. Since this case should be very rare, keeping track of all BLOCK_FAILED_VALID blocks in a set should be just fine and work just as well.
Because we already walk m_block_index in height-order at startup, we go ahead and mark descendants of invalid blocks as FAILED_CHILD at that time, instead of putting things in this set.
Definition at line 1335 of file validation.h.
std::thread ChainstateManager::m_load_block |
Definition at line 1291 of file validation.h.
const Options ChainstateManager::m_options |
Definition at line 1290 of file validation.h.
int64_t ChainstateManager::m_total_coinsdb_cache {0} |
The total number of bytes available for us to use across all leveldb coins databases.
This will be split somehow across chainstates.
Definition at line 1349 of file validation.h.
int64_t ChainstateManager::m_total_coinstip_cache {0} |
The total number of bytes available for us to use across all in-memory coins caches.
This will be split somehow across chainstates.
Definition at line 1345 of file validation.h.
int32_t ChainstateManager::nBlockReverseSequenceId = -1 |
Decreasing counter (used by subsequent preciousblock calls).
Definition at line 1304 of file validation.h.
std::atomic<int32_t> ChainstateManager::nBlockSequenceId {1} |
Every received block is assigned a unique and increasing identifier, so we know which one to give priority in case of a fork.
Blocks loaded from disk are assigned id 0, so start the counter at 1.
Definition at line 1301 of file validation.h.
arith_uint256 ChainstateManager::nLastPreciousChainwork = 0 |
chainwork for the last block that preciousblock has been applied to.
Definition at line 1306 of file validation.h.