InvalidResourceRequestException requestedMemory vs maxMemory

Igor Gatis

unread,

Oct 30, 2013, 9:25:21 PM10/30/13

to dumbo...@googlegroups.com

I'm hitting:

13/10/31 01:23:56 ERROR streaming.StreamJob: Error Launching job : org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException: Invalid resource request, requested memory < 0, or requested memory > max configured, requestedMemory=1536, maxMemory=512

Any clues how to solve that?

Klaas Bosteels

unread,

Oct 31, 2013, 5:50:32 AM10/31/13

to dumbo...@googlegroups.com

Sounds like YARN isn't configured properly.

I've not used YARN yet myself (still on MRv1 for everything), so won't be able to help much with this one I'm afraid...

-K

--
You received this message because you are subscribed to the Google Groups "dumbo-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dumbo-user+...@googlegroups.com.
To post to this group, send email to dumbo...@googlegroups.com.
Visit this group at http://groups.google.com/group/dumbo-user.
For more options, visit https://groups.google.com/groups/opt_out.

Igor Gatis

unread,

Oct 31, 2013, 5:53:04 AM10/31/13

to dumbo...@googlegroups.com

Is there a way to force v1?

Chris

unread,

Jun 26, 2014, 8:30:09 AM6/26/14

to dumbo...@googlegroups.com

Configure yarn.app.mapreduce.am.resource.mb. Its default is 1.5G. See: https://hadoop.apache.org/docs/r2.3.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml. It must be within yarn.nodemanager.resource.memory-mb (not sure whether also within yarn.scheduler.maximum-allocation-mb).