Have a great day!
I have a table with more then 300 000 000 records and in only 30% of them makes sense to search for, rest 70% have special field-flag: system_data and there is no point in polluting the index with this data, moreover this "system_data" rows contains more data, than usual rows.
I understand that I can use this field in search stage - but then my index will be about 1Tb (instead of ~100Mb), and I will have really high Postgres -> Elastic write rate.
Is there any methods that I can use to skip some documents from indexing? I can't use partial INDEX as ZomboDB says that "ZomboDB indices cannot contain WHERE clauses". Maybe I can use FUNCTION somehow to stop sending data to ZomboDB?