I am having some dataproc serverless batch jobs which read from GCS , apply some transformation and write to BQ . I wanted to have a lineage for them and also see some basic telemetry around the jobs, like number of records read from source after transformation what was the count of records and the final records written in BQ.
is there a way we can enable the lineage feature for the Dataproc Serverless ?