Crash Reporting Headlines (November 2021)

[William Kahn-Greene]

(cross-posted to firefox-dev, stability, and crash-reporting-wg)

Status updates for crash reporting.

Details

Completed

• Crash reporter: added diagnostics to analyze a macOS-specific exception handling 

• https://bugzilla.mozilla.org/show_bug.cgi?id=1731162

• Symbols: started scraping symbols for Ubuntu PPA nightly builds

• https://github.com/gabrielesvelto/symbol-scrapers/commit/7dfd2a85

• Symbols: started scraping symbols for Intel closed-source video acceleration libraries

• https://github.com/gabrielesvelto/symbol-scrapers/commit/fc6bdd20

• rust-minidump: feature parity with Socorro's minidump-stackwalk

• https://github.com/luser/rust-minidump/

• Almost at feature parity and ready for testing in Socorro.

• Missing two fields: last_error_value and exploitability

• Needs better handling of XSTATE cpu contexts

• Metabug: https://github.com/luser/rust-minidump/issues/153

• Several improvements over minidump-stackwalk:

• several fixed bugs!

• at least twice as fast in local testing

• compiles and runs painlessly on all platforms and also packaged (cargo install minidump-stackwalk)

• better defaults including picking a reasonable cache directory

• socc-pair: improvements for better rust-minidump minidump-stackwalk testing

• https://github.com/Gankra/socc-pair/

• Downloads crash data from Crash Stats, runs rust-minidump on minidump, and compares output taking into account known-good differences between the two stackwalkers.

• Reports concerning divergences and dumps findings/logs to disk for investigation.

• Symbolication Service: completed standing up new symbolication service

• https://symbolication.services.mozilla.com/

• Service is now running and the work to migrate users of the symbolication API from https://symbols.mozilla.org/ to https://symbolication.services.mozilla.com/ is beginning.

• socorro-siggen: released 1.0.7

• https://github.com/willkg/socorro-siggen/releases/tag/v1.0.7

• This picks up changes to signature generation in Socorro since April 2021.

In progress

• All: Rust rewrite of all things breakpad

• rust minidump-stackwalk:

• https://github.com/luser/rust-minidump/tree/master/minidump-stackwalk

• https://github.com/luser/rust-minidump/issues/153

• You can now install and test rust-minidump minidump-stackwalk

• Same CLI as existing minidump-stackwalk that Socorro uses. Outputs the same JSON schema.

• Ready for testing in the Socorro processor--working on that now.

• Firefox profiler: display richer symbol information and inline source view

• Display C++ and Rust source code with per-line sample counts right inside the profiler.

• Make the profiler display richer symbol information, specifically inline call stacks with file and line information.

• https://github.com/firefox-devtools/profiler/pull/3530

• Symbols: improving process for acquiring symbols for macOS Big Sur

• https://bugzilla.mozilla.org/show_bug.cgi?id=1683758

• This enables profiles collected on beta versions of macOS with the Firefox profiler to have symbolicated system libraries and will improve stacks in crash reports for beta versions of macOS.

• Work is ongoing.

• Crash ping: Signature generation for crash pings (blocked)

• https://bugzilla.mozilla.org/show_bug.cgi?id=1631563

• Current status is in comment 17. It's blocked on fixing the fx-crash-sig library and a project plan.

• Socorro: Better signature generation for Java crash reports (on hold)

• https://bugzilla.mozilla.org/show_bug.cgi?id=1541120

• Taking this off the backlog for now. If you're interested in this, please comment in the bug.

More information

The crash reporting working group puts these out once a month so it's clearer what's going on in the wild world of crash reporting.

Wiki: https://wiki.mozilla.org/Data/WorkingGroups/CrashReporting

Matrix: #crashreporting

Mailing list: crash-reporting-wg

For support on symbols, stacks, stack unwinding, crash reports, Crash Stats, signature generation, and anything related to crash reporting, we hang out in #crashreporting on Matrix.

If this summary is missing something, please let us know!

/will

--
You received this message because you are subscribed to the Google Groups "firef...@mozilla.org" group.
To unsubscribe from this group and stop receiving emails from it, send an email to firefox-dev...@mozilla.org.
To view this discussion on the web visit https://groups.google.com/a/mozilla.org/d/msgid/firefox-dev/CAKnh9qij-9C%3D1TScUoJQ6DN7eZG-Ro-vrYM1Ot4E7ukLW4AwxA%40mail.gmail.com.