Initial Information

An issue has been identified with the EOS Mainnet, the issue is being fixed by all block producers.

The chain will be restarted from irreversible block 1027926, no blockchain data will be lost.

Everyone please shutdown nodes and downgrade to 1.0.3 immeadiately. Store all data as backup for later analysis.

ETA: 3-6 hours.

Updates

9:56 UTC: The EOS mainnet blockchain paused. At 10:01 UTC Block Producers and many Standby Nodes joined together on an international conference call to identify and fix the issue. At 10:57 UTC The choice was made that all Standby Block Producers would stop their nodes and backup any information that could helpful in diagnosing the problem.

11:02 UTC: A method to unpause the chain was formulated and is currently underway. Normal functions should be available within 3 to 6 hours from the time of the publication. Incoming connections to the network are not being accepted while the work is taking place. Please wait for an update from the Top 21 Block Producers before attempting EOS mainnet transactions.

We are working directly with Block.One at this time.

13:02 UTC: We identified the root cause and are working on a fix. A full release outlining the root cause will be issued once we’ve completed the work.

The following steps will be taken:

1. A nodeos fix will be released
2. The block producer nodes will be upgraded
3. Blocks will be replayed until last irreversible block
4. Block producers will sync to each other
5. Chain will be opened up for mainnet

Root cause was due to how deferred transactions were handled. Chain will be upgraded to version 1.0.5. No data on the blockchain will be lost.

The fix is found at: https://github.com/EOSIO/eos/pull/4158

EOS Cafe Calgary