Posts

Showing posts with the label performance tuning

T) Difference between max core and max memory.

    Max core : component max-core parameter determines the maximum amount of memory the component will consume per partition before it spills to disk.   Max memory : Enables the collection of memory usage data for components.

S) Rollup Accumulation Function Scenario

Image
          Solution:-     Ip - DML     Record   String( “| ”)id ;   String(“\n ”)data ;   End;     Rollup      Key :id     out : : rollup(in) =   begin     out. data : : string_join (accumulation( in.data ), "" );     out.id : : in.id;   end ;     Op- DMl     Record   String( “| ”)id ;   String(“\n ”)data ;   end      

T) Broadcast versus Replicate component. Anyone could u plz explain ?

Broadcast and replicate behavior varies with flow type and default flow type is different for both. It's always difficult to remember it unless you try all scenarios. On a short note when you connect this component between same depth, default flow type for broadcast is all to all and it multiplies the data.  I would suggest to read help and simultaneously run trials. Primary motive of broadcast is data parallelism and it duplicates data in each partition flow. As I said it behaves differently based on flow type and you need to run it to get correct understanding.

T) How is Maximum max-core value allowed for system is calculated?

 It's 2^31 - 1 for 32 bit around 2GB space