Posts

Showing posts with the label performance optimization

T) What is Single Stage and Multi stage component ?

  Single stage components process each record in a single step.Below are example of single stage component.  Filter by expression  Reformat  Dedup    Multi stage components process records in multiple stages allowing more complex operations like  initialisation,  finalization   Below are the example of the multi stage components    Normalize  Rollup  Scan  Scan with rollup etc.

S) scan ,rollup and dedup with null key and unique key

Image
  Scan with null key ---11 rec   Rollup with null key –1 record( depends if the data is sorted then last if data is not sorted then fst record)   Dedup with null key —( keep fst )—1 record   Dedup with null key —( keep lst )—1 record   Dedup with null key —( keep unique)—0 record ( key didn’t get the unique record bcoz it treats every record is one group      

S) How to take a count of vowel present in a string ?

Image
 Solution: Redefine Format   record   string( 1) data;   end     FBE   data member [ vector "A","a","E","e","I"," i "," O","o","U","u " ]     Sort   Key –Data     Rollup     Key –Data     out : : rollup(in) =   begin     out. data : : in.data ;     out.cc : : count( in.data );   end;          

T) When does Abinito creates work directories where it stores the temp files? Does it create when the sort component uses a particular layout for the first time or it has to be created separately?

Which ever path is provided in layout option, will be used to crate intermediate files.