current position：Home>What is the basic logic of MapReduce client for map phase parallelism planning?
What is the basic logic of MapReduce client for map phase parallelism planning?
2022-02-04 16:52:31 【Alibaba cloud Q & A】
mapreduce The client to map What is the basic logic of stage parallelism planning ？
Take the answer 1：
Perform logical slicing of the data to be processed （ That is, according to a specific slice size , Divide the data to be processed into logical multiple individual split）, And then every one split Allocate one mapTask Parallel instance processing This section of logic and the resulting slice plan description file , By FileInputFormat Implementation class getSplits() Method . This method returns List , InputSplit Encapsulates the information of each logical slice , Including length and position Information , and getSplits() Method returns a group InputSplit
author[Alibaba cloud Q & A],Please bring the original link to reprint, thank you.
The sidebar is recommended
- What is the relationship between serverless and logging?
- How many layers does the MySQL logical architecture diagram have?
- What is the function of shard number?
- What are the three paradigms of database?
- What are the common developer tools for calling ECS APIs?
- Configuration and description of source database information synchronized from DTS self built Mysql to RDS MySQL?
- What are the trends and challenges of serverless?
- What are the MySQL permission tables?
- What is the process of installing httpd service and PHP in ganglia?
- What is the role of Alibaba cloud toolkit?
guess what you like
What is the log centralization of serverless applications?
Configuration and description of target database information synchronized from DTS self built Mysql to RDS MySQL?
HTML common tag examples
Laravel statement reports an error. How to solve it?
Please answer the questions about ＃ C ＃!
Use pagination JS paging plug-in paging, get the number of pages, but click the next page without refreshing the data
C + + keyboard input, sorting, list output
Technologies needed for wechat applet development
The expression has been given to find the image?
OSPF address configuration of switch
- Let's see how to correct this mistake. I didn't find it myself.
- PCIe TX / RX pin constraint problem
- HDU1096 presentation wrong
- Does anyone understand why the first process will operate through P and the second process will block at p?
- Data structure PTA questions do not know how to change
- On the grid position and width of Tkinter
- Use of react material UI 5.0 components
- Android modifies the interface displayed on the white screen through the theme of activity
- When configuring Powermode in vscode, expected comma is displayed
- Stc89c52rc controls the stepping motor, and the program card is in the first line of main,
- Zhejiang University pat class B 1048 test points 4 and 5 cannot pass, solution
- What's the difference between the same sentence?
- Enter several student grades at random
- Expression 1 + 4 / 5 + 15 & lt; The value of 7 + 4% 5 + (8,10) is
- 7-3 simple character transformation (20 points)
- After the spring boot project is jar packaged and deployed to alicloud server, init datasource error is displayed. But local operation is good.
- The automated test tool RF cannot modify the font size
- Question about CSS: since I have div nesting, how can I write CSS style
- The problem that DSS + FTP cannot be played online
- How to automatically execute pycharm file after clicking it
- How to solve the problem that the raspberry pie prompt cannot locate the software package when installing ngnix?
- How should I make up this problem? Please ask me
- What does this error message mean
- Beg, an exercise problem, can't figure out a way of thinking
- How to judge whether the folding screen is unfolded when there is a problem of folding screen adaptation at the mobile terminal?
- On the issue of CAS authentication, there is the problem of bill invalidation
- Why should e add 127 to e? Xiaobai said he didn't understand
- How can I get the value behind this k? Wentang college wants to use crawlers to crawl e-books.
- Pyqt5 how to output percentages directly?
- When the Android 10 app version is downgraded, you are prompted that the application is not installed. How to solve it?
- Different expressions of month, month and day have been output. How to judge the season according to the output month
- Canine distemper sports I Oh, afraid qwe
- Short answer: SQL statements complete the following queries
- What are the input formats of MySQL binlog?
- What is the business logic of wordcount?
- What is the function of terraform?
- What are the four features of MySQL's InnoDB engine?
- What are the instructions for configuring the task steps of DTS self built MySQL synchronization to RDS MySQL?
- What is the process of installing other dependencies in ganglia?
- What are the advantages and disadvantages of MySQL index?