Certs recorded by crt.sh not appearing in search results

[Aidan Steele]

Hi,

Firstly: I love the service. It's an amazing thing you've built - thank you.

I've noticed that certain certs (e.g. https://crt.sh/?id=3093324162) don't appear when I do an ILIKE search on %.iggsz.biz, e.g. https://crt.sh/?q=iggsq.biz&dir=^&sort=2&group=none

Looking at the results on that page, it looks like the search results don't include anything since mid-2018. Is there some kind of pagination that I'm perhaps missing..? I'm hoping it's just user error, but I can't figure it out :)

Thanks,

Aidan

[Rob Stradling]

Hi Aidan.  This is the same issue that I described at https://crt.sh/forum?place=msg%2Fcrtsh%2FPJBu5cvm0G8%2FiCIy0vBPAwAJ.

If there are "too many" certificates for a given search term, the crt.sh code has to limit the number that it will process, for performance reasons.  Although I labelled this as "a temporary hack", I'm no closer to devising a solution I'm afraid.  ISTM that postgres's Full Text Search just isn't geared towards sorting or paginating large result sets.  :-(

[Aidan Steele]

Hi Rob,

Ah I missed that one. Your explanation makes sense and I can indeed see why it would be a tricky problem to solve! I'll try think about ways that it could be addressed, but I'm unlikely to come up with anything useful.