current position:Home>What parameters are frequently adjusted when running MapReduce tasks?

What parameters are frequently adjusted when running MapReduce tasks?

2022-02-04 16:37:48 Alibaba cloud Q & A

Running mapreduce Tasks , What are the frequently adjusted parameters ?




Take the answer 1:

Running mapreduce Tasks , Frequently adjusted parameters are :

1.mapred.reduce.tasks: Manual settings reduce Number

2.mapreduce.map.output.compress:map Whether the output result is compressed

3.mapreduce.map.output.compress.codec

4.mapreduce.output.fileoutputformat.compress:job Whether the output result is compressed

5.mapreduce.output.fileoutputformat.compress.type

6.mapreduce.output.fileoutputformat.compress.codec


copyright notice
author[Alibaba cloud Q & A],Please bring the original link to reprint, thank you.
https://en.cdmana.com/2022/02/202202041637469772.html

Random recommended