-
Notifications
You must be signed in to change notification settings - Fork 8
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Missing data #198
Comments
Hey @fewensa, could share a way to reproduce your indexer? Does this happen deterministically each time you run your indexer? Do you have |
|
Hey @fewensa, I've done some analysis on your case here. It is an interesting one because I didn't expect local/hosted environments to have such different data. I ran your indexer locally and compared all your entities to find that there were 3647 mismatch where an entity appeared either locally or in the hosted indexer but not the other. They were all on the koi network. I took the block numbers from all of these queried the koi-scan API to find that the majority of these blocks were reorg blocks. OR they had neighbouring blocks which were reorg blocks. A small amount of them had a reorg block present within 10 blocks. So unfortunately the data inaccuracy is currently due to reorgs. And there is a known edge case with our reorg detection implementation RPC in that it is impossible to atomically run eth_getLogs AND eth_getBlock. Since we are checking blockhashes on the toBlock of a getLogs query its possible for Reorgs to slip by undetected. Which appears to be the case here. I'm going to do further investigation on an reorg detection with RPC to see if we can improve it. |
Describe the bug
https://envio.dev/app/darwinia-network/dip7index/1c7b270/playground
This playground,
First query chain metadata
Result is
Then query addCollator
Result is
this block events is missing
https://koi-scan.darwinia.network/tx/0x11a1bf08a4d7bf52f8bb428bbffece62e21cef340e63a1c08b18e63241a47b52?tab=logs
1117132
To Reproduce
Steps to reproduce the behavior:
E.g.
Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Local (please complete the following information):
Hosted Service (please complete the following information):
https://envio.dev/app/darwinia-network/dip7index/1c7b270/playground
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered: