S) join and rollup example
Input Output
1 A 1 ABC
2 B 2 ABC
3 C 3 ABC
Rollup :
out :: rollup(in) =
begin
out.id::string_join(accumulation(in.data),"");
end;
join
null key (cartisian join)
T) For data parallelism, we can use partition components. For component parallelism, we can use replicate component. Like this which component(s) can we use for pipeline parallelism?
You can use components that does not require any sorted data (explicit or in memory sort) to get pipeline parallelism. Like Reformat,FBE, Redefine components. And Components that needed sorted data like join, roll-up, merge, sort, partition by key and sort breaks the pipeline parallelism.
Comments
Post a Comment