It is recommended to look at the
Stackdriver logs for your job to investigate why it is taking so long. Since you increased the data, this is most likely a memory issue where the workers performing the job do not have enough memory resources to handle your increased data. If you see 'GC (Allocation Failure)' in your logs this is a sign of not enough memory.
- The solution is to either audit your code to ensure that you do not have a memory leak, and/or to
increase the machine type to an
machine with more memory. Also ensure that your
work and data can be properly split so that Dataflow can scale up more workers to complete a job instead of tasking a single worker to do it all (which would be limited to machine type resources).