S) Scan example with null key using concatenation function
Input Output
1 1
2 12
3 123
4 1234
5 12345
Scan
Out ::scan(in)=
Out .id :: concatenation(in.id);
Key :: null key
T) For data parallelism, we can use partition components. For component parallelism, we can use replicate component. Like this which component(s) can we use for pipeline parallelism?
You can use components that does not require any sorted data (explicit or in memory sort) to get pipeline parallelism. Like Reformat,FBE, Redefine components. And Components that needed sorted data like join, roll-up, merge, sort, partition by key and sort breaks the pipeline parallelism.
Comments
Post a Comment