feat: support full MEV by h4ck3rk3y · Pull Request #115 · ethpandaops/ethereum-package

h4ck3rk3y · 2023-08-09T15:12:58Z

There are some immediate FLUPs here

Replace h4ck3rk3y/builder with flashbots/builder ( pending publishing of builder)
Replace h4ck3rk3y/mev-boost-relay with flashbots/mev-boost-relay (pending Capella signature fix)

h4ck3rk3y · 2023-08-09T16:06:39Z

Run using kurtosis run '{"mev_type": "full"}'

h4ck3rk3y · 2023-08-09T16:21:56Z

Use this PR over #97 @barnabasbusa @parithosh

h4ck3rk3y · 2023-08-09T16:34:21Z

You have to wait for 4 epochs or 128 slots to see payloads get delivered. This should start happening around slot 130~

parithosh · 2023-08-14T17:49:46Z

Since its in a working state now, I'd like to merge this and we iterate any fixes into separate PRs so that its a bit more digestible.

barnabasbusa · 2023-08-15T13:00:06Z

🚀

🤖 I have created a release *beep* *boop* --- ## [0.3.0](0.2.0...0.3.0) (2023-09-03) ### ⚠ BREAKING CHANGES * Uses the `plan` object. Users will have to update their Kurtosis CLI to >= 0.63.0 and restart the engine ### Features * add beacon-metrics-gazer + beacon-metrics-gazer grafana dashboard ([#114](#114)) ([5540587](5540587)) * add deneb support ([#96](#96)) ([07ed500](07ed500)) * add ethereumjs to nightly runners ([b86d886](b86d886)) * add ethereumjs to nightly runners ([#154](#154)) ([b86d886](b86d886)) * add forkmon ([#107](#107)) ([2a8ad19](2a8ad19)) * add light-beaconchain-explorer ([83e01a1](83e01a1)) * add light-beaconchain-explorer ([#125](#125)) ([83e01a1](83e01a1)) * add multiple endpoint support for lightbeaconchain expolorer ([#151](#151)) ([68572cd](68572cd)) * counting by summing each participant ([f9b638b](f9b638b)) * counting by summing each participant ([#112](#112)) ([f9b638b](f9b638b)) * disable login for grafana ([4d7df4b](4d7df4b)) * disable login for grafana ([#122](#122)) ([4d7df4b](4d7df4b)) * **formatting:** Add editorconfig, move everything to using tabs (4) ([#106](#106)) ([cb0fc69](cb0fc69)) * launch the mock mev builder ([#94](#94)) ([7fcd3e2](7fcd3e2)) * make it possible to have capella on epoch 0 or non 0 ([#108](#108)) ([1133497](1133497)) * make mev more configurable ([#164](#164)) ([0165ef1](0165ef1)) * parameterize mev_boost and mev_builder images ([#171](#171)) ([28adec1](28adec1)) * snooper support ([#121](#121)) ([d2cccf4](d2cccf4)) * support full MEV ([#115](#115)) ([e9e8c41](e9e8c41)) * use eth-network-package to spin up participant network ([#90](#90)) ([91029ac](91029ac)) ### Bug Fixes * a bug around participants ([#129](#129)) ([9382767](9382767)) * delay deneb to 500 epoch ([#102](#102)) ([d07270b](d07270b)) * dont spin up extra el/cl client for mock-mev ([#158](#158)) ([46d67fc](46d67fc)) * fix an arg parsing bug ([#135](#135)) ([f084e7c](f084e7c)) * fix passed argument parsing ([#85](#85)) ([a5d40e9](a5d40e9)) * fixed teku validator params for MEV ([#149](#149)) ([b0079cf](b0079cf)) * fixing nimbus payload url ([#155](#155)) ([55c1f59](55c1f59)) * geth failing after ethash package removal ([#93](#93)) ([41e3d2c](41e3d2c)), closes [#91](#91) * make besu a bootnode ([29296cd](29296cd)) * make besu a bootnode ([#146](#146)) ([29296cd](29296cd)) * make this work with kurtosis 0.65.0 ([#73](#73)) ([13c72ec](13c72ec)) * mention reth in package readme ([#133](#133)) ([d11a689](d11a689)) * move parallel keystore generation to global config ([0789eed](0789eed)) * move parallel keystore generation to global config ([#130](#130)) ([0789eed](0789eed)) * nightly tests that rely on etherejums get the right image ([#159](#159)) ([97b4d33](97b4d33)) * Nimbus can't run when slot time is below 12s ([#100](#100)) ([c38bff9](c38bff9)) * pass right mev-boost url to teku ([#147](#147)) ([8bb75d9](8bb75d9)) * pin postgres package ([#174](#174)) ([6b8d9d3](6b8d9d3)) * Remove nethermind restriction ([#126](#126)) ([373c6c9](373c6c9)) * Switch default images to latest ([#99](#99)) ([4a85c9d](4a85c9d)) * Update enclave name flag ([#87](#87)) ([6531a7a](6531a7a)) * update genesis generator to support netherminds new format ([#68](#68)) ([094352d](094352d)) * update nightly runner ([#163](#163)) ([4eba65d](4eba65d)) * use eth maintained tx-fuzz ([#110](#110)) ([b0903bd](b0903bd)) * use flashbots builder ([#162](#162)) ([7a0c2d0](7a0c2d0)) * use mev-boost-relay by flashbots ([#141](#141)) ([fca62fc](fca62fc)) * use named artifacts ([#69](#69)) ([968f073](968f073)), closes [#70](#70) * Use plan object ([#65](#65)) ([8e5d185](8e5d185)) * use v2 endoint to get the head block ([#153](#153)) ([f084711](f084711)) * work with latest eth-network-package ([14dc957](14dc957)) * work with latest eth-network-package ([#116](#116)) ([14dc957](14dc957)) --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please). Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Gyanendra Mishra <anomaly.the@gmail.com>

…1432) ## What Adds support for **multiple dedicated buildoor builder instances**, configured independently of the participants via `buildoor_params.instances` and enabled as an `additional_services` entry. ```yaml participants: - el_type: geth cl_type: lighthouse - el_type: reth cl_type: prysm additional_services: - buildoor # enables buildoor (like dora/spamoor/etc) buildoor_params: builder_api: true epbs_builder: true lifecycle: true instances: - participant: 1 # 1-based participant index count: 1 - participant: 2 count: 2 # two competing builders wired to participant 2 ``` This spins up `buildoor-lighthouse-geth-1`, `buildoor-reth-prysm-2-1`, and `buildoor-reth-prysm-2-2`, each wired to the named participant's own CL/EL. ## Why A block builder is independent of the network — it reads one CL's `payload_attributes` stream and (under ePBS) gossips bids to everyone. The previous model only allowed a single shared builder via `mev_type: buildoor` against participant 0. This lets you run many builders, target specific participants, and run more than one per participant. ## How - **buildoor as an additional_service** — buildoor only spins up when `buildoor` is in `additional_services` (consistent with other optional services), instead of being implied by config. With `buildoor` enabled and no `instances` set, it defaults to a single builder on the first participant. Mutually exclusive with the (deprecated) `mev_type: buildoor`. - **`buildoor_params.instances`** — `[{participant, count}]` declares which participants get builders and how many each. Validated for index range, duplicates, and count. - **Cleaner key derivation** — buildoor derives its builder BLS key itself via `--builder-mnemonic` + `--builder-key-index`, dropping the per-instance `ethdo` `run_sh` containers. - **Lifecycle / post-genesis onboarding (default on)** — each builder onboards itself after genesis via its lifecycle deposit (`--lifecycle`), so builders no longer need genesis registration and **gloas does not have to be at genesis** (works at any gloas epoch). Builder keys are derived at indices after any genesis-registered builders to avoid collisions. - **Block attribution** — each instance passes `--extra-data=<service-name>` so built blocks can be traced back to the builder that produced them. - **Service naming** — `buildoor-<cl>-<el>-<participant>` (with a `-<n>` suffix when count > 1), matching the cl/el naming convention. - **Deprecation** — `mev_type: buildoor` (single shared builder) is marked deprecated and will be dropped after the gloas fork; a runtime warning is printed. - **Docs + validation + tests** — README updated; sanity checks added for the new params; nightly tests added (`buildoor-instances.yaml`, `buildoor-instances-matrix.yaml`). ## Notes / limitations - The `--extra-data` flag and lifecycle/early-deposit onboarding require a buildoor build that supports them (in `glamsterdam-devnet-6`; not yet in `:main`). Bump the default `buildoor_params.image` once buildoor PRs #115/#110 land on main. - The CL has a single external-builder endpoint, so it is wired to its participant's first buildoor instance; additional instances still run (e.g. competing ePBS builders) but are not the CL's Builder-API endpoint. - Each instance uses a distinct prefunded account so concurrent buildoors don't collide on tx nonces; with a custom single-account `prefunded_accounts` they would share a wallet. ## Testing Validated with `kurtosis run . --dry-run`: - `additional_services: [buildoor]` + instances → all instances spin up. - `additional_services: [buildoor]`, no instances → one builder on participant 1. - instances set without `buildoor` in additional_services → clear failure. - gloas at a non-genesis epoch → builders spin up (lifecycle onboarding). - combining with `mev_type: buildoor` → conflict failure; deprecated `mev_type: buildoor` alone still works. - `black`-formatted. --------- Co-authored-by: Claude <noreply@anthropic.com>

h4ck3rk3y added 30 commits August 3, 2023 16:24

added mev boost parameters support

46fe6fc

wip

0f9fd61

added api

fdc9fea

adding full mev support

9e4bf31

fix

66003c8

bug fixing

d8a733e

fixed one

b7f1ee3

lets go

3550505

fixed ports

65fdb34

some progress

3d8df7e

added genesis validator root

ca825b7

bug fix

aa62cca

this works

7dd9e98

this should be arlight

b109c38

this seems alright

8c0ae0a

revert some stuff

41feced

lets go

54a8c01

lets go ful lmev

2f144cf

fix yaml parsing

73e1302

lets go

52887ce

actually add code

955165f

lets go

ffbe111

this looks alright

1b6d49b

fix epoch;

98afa5a

epoch testing works

eb3c4c1

lets go

9cc7603

getting builder to work

d197c27

cleanup

76ef610

go

a06068e

remove branch

fe93acf

h4ck3rk3y added 7 commits August 9, 2023 16:44

fix bug

ae299d8

+ instead of extend

ad0cc9e

update README

e304091

use tx fuzz

d0b3c26

use default branch

cbf22bb

Merge branch 'main' into gyani/current-mev

8726516

bug fix

ad2593d

h4ck3rk3y mentioned this pull request Aug 9, 2023

feat: spin up full mev #97

Closed

h4ck3rk3y requested review from barnabasbusa and parithosh August 9, 2023 16:31

h4ck3rk3y mentioned this pull request Aug 14, 2023

Capella Payload Signature Verification Fails for custom testnet flashbots/mev-boost-relay#507

Closed

h4ck3rk3y added 2 commits August 14, 2023 16:25

Merge branch 'main' into gyani/current-mev

3cffb2f

Update parse_input.star

018c4c1

h4ck3rk3y commented Aug 14, 2023

View reviewed changes

Comment thread main.star

h4ck3rk3y added 2 commits August 14, 2023 16:30

tag application protocol

ac42be7

Merge branch 'main' into gyani/current-mev

24330c7

parithosh approved these changes Aug 14, 2023

View reviewed changes

h4ck3rk3y commented Aug 14, 2023

View reviewed changes

Comment thread main.star

h4ck3rk3y merged commit e9e8c41 into main Aug 15, 2023

h4ck3rk3y deleted the gyani/current-mev branch August 15, 2023 12:59

github-actions Bot mentioned this pull request Aug 15, 2023

chore(main): release 0.3.0 #75

Merged

barnabasbusa mentioned this pull request Jun 24, 2026

feat(buildoor): support multiple per-participant buildoor instances #1432

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat: support full MEV - #115

feat: support full MEV#115
h4ck3rk3y merged 83 commits into
mainfrom
gyani/current-mev

h4ck3rk3y commented Aug 9, 2023 •

edited by github-actions Bot

Loading

Uh oh!

h4ck3rk3y commented Aug 9, 2023

Uh oh!

h4ck3rk3y commented Aug 9, 2023

Uh oh!

h4ck3rk3y commented Aug 9, 2023

Uh oh!

Uh oh!

parithosh commented Aug 14, 2023

Uh oh!

Uh oh!

barnabasbusa commented Aug 15, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

h4ck3rk3y commented Aug 9, 2023 • edited by github-actions Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

h4ck3rk3y commented Aug 9, 2023

Uh oh!

h4ck3rk3y commented Aug 9, 2023

Uh oh!

h4ck3rk3y commented Aug 9, 2023

Uh oh!

Uh oh!

parithosh commented Aug 14, 2023

Uh oh!

Uh oh!

barnabasbusa commented Aug 15, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

h4ck3rk3y commented Aug 9, 2023 •

edited by github-actions Bot

Loading