Data mining and data mining system
The method comprises setting data mining workflow, said workflow comprising a plurality of parallel data processing task, and activating the workflow, and said plurality of when parallel dataprocessing task is triggered can improve the efficiency of data mining.
Abstract
The present invention discloses a data mining and data mining system, the method comprises: setting data mining workflow, said workflow comprising a plurality of parallel data processing task; activating the workflow, and said plurality of when parallel data processing task is triggered, allocating for each data processing task execution node therein, so that the plurality of parallel data processing tasks executed in parallel on the assigned execution node; and, in the execution of each execution node a data processing tasks, data processing tasks to be executed in parallel Map task process by the Map / Reduce mechanism, the Map task processing result of each data processing task corresponding to the merging process performed by respective corresponding data processing tasks are Reduce the results of the processing task. According to the present invention can improve the efficiency of data mining.