Hi all,
Ray, Jeremy, Paolo and I just had our weekly Embench 2.0 engineering call, here's the current status of things:
Progress since last week:
- Removing library overhead from the size benchmark: implementation done
- Updating the build toolchain to be more declarative and easier to use from the command line: prototype done, have to adjust all previous configurations
- Removing benchmarks: nbody, cubic, primecount due for removal
Things to-do until next week:
- Update the documentation and examples for new changes to the toolchain
- Update the size computation to not rely on section names (identify sections based on flags instead)
- Change the interface of the speed benchmark to allow for greater user flexibility
- Remove the 'lief' dependency from the size benchmark and replace it with something available on all relevant OS's
- ML Benchmark: Ray is going to find some potential candidates
Long-term (Until paper deadline) tasks:
- Decide on a reference board
- Compute baseline results for the reference board
- Create a Google Drive similar to what Stefan Wallentowitz has for the FOSSi Foundation
If you're missing something from embench 2.0 for the paper, you can message Jeremy/Konrad for technical topics, or Ray Simar.