fyi: supersearch "terms" query is now "match" query

[William Kahn-Greene]

Hi!

TLDR: I fixed a long long long standing issue with supersearch, we no longer have "terms" queries which didn't work right, and we now have "match" queries which do what you would expect. If you use supersearch in scripts or systems, you might have to update your queries.

Long version:

Bug 1100790 covers a long long long standing issue where you can't search for crash reports where platform is "Mac OS X" and something else. For example, you can search for crash reports for Mac OS X and you can search for crash reports for Linux, but if you search for crash reports for Linux AND Mac OS X, you only see crash reports for Linux.

There were a handful of bugs with how Supersearch built "terms" queries where it did completely different kinds of queries depending on whether there was a space in the value and whether there were multiple values provided.

I rewrote how that works and changed "terms" queries to "match" queries.

This is a heads-up that these changes have landed in the staging environment, but haven't been deployed to production, yet.

The end result of this is that a bunch of queries work as you would expect them to now:

1. "Find me crash reports where platform matches "Mac OS X" or "Linux"" now work.

Before changes:

$ supersearch --platform='Mac OS X' --platform='Linux' --num=5 --_columns=uuid --_columns=platform
526805c4-125d-4b5c-8560-e84ce0240822 Linux
0ebd62a7-04db-4ac5-a751-e94bd0240822 Linux
7b433f9a-0fac-4559-802c-9d6b10240822 Linux
392b184b-fd13-4462-97df-ed7df0240822 Linux
27c6deaa-b2e6-4973-bb54-c72b10240822 Linux

After changes:

$ supersearch --host=https://crash-stats.allizom.org/ --platform='Mac OS X' --platform='Linux' --num=5 --_columns=uuid --_columns=platform
4ea87e6b-2161-4da2-9a3d-60e370240822 Mac OS X
ca33225f-9de4-4f84-b1d3-69aaa0240822 Linux
53a16fbf-7fee-431a-8ab7-7d07a0240822 Mac OS X
59871071-5c52-49ae-8630-fa7f60240822 Linux
78e5cbd6-b0d2-41cf-9398-f32d10240822 Linux

2. "Find me crash reports where crash_report_keys matches "BuildID"" now work.

Before changes:

$ supersearch --crash_report_keys=BuildID --_columns=uuid --num=5

After changes:

$ supersearch --host=https://crash-stats.allizom.org/ --crash_report_keys=BuildID --_columns=uuid --num=5
c4d39102-6fc6-4276-98f9-575ad0240822
963a28cd-238c-44dc-9dd3-1c8f40240822
6289782e-f5f7-42f2-a8d5-adf4b0240822
c59f3bd9-3a17-494e-a526-5bf740240822
b4c12696-f32e-4b15-add2-78ffd0240822

3. "Find me crash reports where crashing_thread_name matches "MainThread"" now work.

Before changes:

$  supersearch --crashing_thread_name=MainThread --num=5

After changes:

$ supersearch --host=https://crash-stats.allizom.org/ --crashing_thread_name=MainThread --num=5
e8df3b0a-ba26-4e1c-849d-38fb20240822
02063aca-6251-42ce-82bf-0cafe0240822
c4d39102-6fc6-4276-98f9-575ad0240822
6289782e-f5f7-42f2-a8d5-adf4b0240822
c59f3bd9-3a17-494e-a526-5bf740240822

I did some extensive testing across all the possible fields. Most fields should work better now. I know that "android_model" is indexed wrong so it doesn't work well in searches.

If you see other problems, please let us know by writing up a bug in Socorro.

Thank you!

/will

Observability Team