T) Explain the Run time behaviour DEDUP SORTED component ?

-

 Step-by-Step Process:

  1. Reads Grouped Data

    • Takes in records that are already sorted by a specific key (like customer ID or date)

  2. Optional Filter Check

    • If you have a filter expression:

      • Filter returns FALSE (0): Record is skipped

      • Filter returns NULL: Record goes to reject port with error message

      • Filter returns TRUE: Record continues processing

    • If no filter: All records are processed

  3. Handles Record Groups

    • Groups consecutive records with the same key value together

    • For single-record groups: Record goes directly to output

    • For multi-record groups (duplicates):

      • Uses your "keep" setting to decide which record to keep

      • If keep = "first" or "last": Keeps one record (sends to output), sends others to duplicate port

      • If keep = "unique-only": Sends ALL records from duplicate groups to duplicate port (output gets nothing)

Key Points:

  • Data MUST be sorted first for this to work correctly

  • Works with consecutive duplicate records

  • You control which duplicate to keep (first, last, or none)

  • Filter is optional - use it to skip certain records before deduplication

Output Results:

  • out port: Contains unique records (based on your keep setting)

  • dup port: Contains the duplicate records that were removed

  • reject port: Gets records that caused filter errors

Comments

Post a Comment

Popular posts from this blog

T) For data parallelism, we can use partition components. For component parallelism, we can use replicate component. Like this which component(s) can we use for pipeline parallelism?

-
You can use components that does not require any sorted data (explicit or in memory sort) to get pipeline parallelism. Like Reformat,FBE, Redefine components. And Components that needed sorted data like join, roll-up, merge, sort, partition by key and sort breaks the pipeline parallelism.  
Read more

T) When to use sort within groups ?

-
Use Sort within Groups only if records within a group are processed before being sorted on a minor key. i.e. if processing "A" needs records to be sorted on field {"1"} and later in the flow processing "B" needs records to be sorted on field {"1", "2"}. In this case before processing "2" and after processing "1" use sort within groups with major-key as {"1"} and minor key as {"2"}. If records are not grouped to start with, use Sort with a multi-part key. There is no benefit to using Sort within Groups directly after using a Sort component.
Read more

T) Explain about on .abi-unc files in abinitio ?

-
 These are temporary files used by the checkout process. Under normal circumstances you should not see them. However, if the checkout failed or was interrupted, these files can be left behind. Delete them and try checking out again.    Details: The checkout procedure includes two steps to ensure that a checkout does not leave your sandbox in a half-checked-out state: 1. It checks out the files, but gives them the .abi-unc suffix (for "uncommitted"). 2. Once every file is successfully checked out, the . abi-unc files replace the real files. If an error occurs midway through checkout, any .abi-unc files that have been created might be left behind. If you receive the error message "Cannot write project parameters file: /path/filename.abi-unc" during checkout and you see . abi-unc files, delete them and try checking out again. Uncommitted files are usually left behind because a checkout process was aborted.  
Read more