Search This Blog

Questions Ab Initio

Crack Ab Initio Interviews with Real-Time Q&A

Home
About This Blog
Theory Questions

More…

Posts

Showing posts with the label duplicate removal

Show all

S) Dedup Example

Get link
Facebook
X
Pinterest
Email
Other Apps

- August 20, 2025

input : - id 1 1 1 2 2 3 Output required id 1 1 2 Id 3 Id 1 2 Note : - Use dedup keep fst and keep last with null key .

T) For data parallelism, we can use partition components. For component parallelism, we can use replicate component. Like this which component(s) can we use for pipeline parallelism?

- April 24, 2025

You can use components that does not require any sorted data (explicit or in memory sort) to get pipeline parallelism. Like Reformat,FBE, Redefine components. And Components that needed sorted data like join, roll-up, merge, sort, partition by key and sort breaks the pipeline parallelism.

T) Explain about on .abi-unc files in abinitio ?

- March 06, 2021

These are temporary files used by the checkout process. Under normal circumstances you should not see them. However, if the checkout failed or was interrupted, these files can be left behind. Delete them and try checking out again. Details: The checkout procedure includes two steps to ensure that a checkout does not leave your sandbox in a half-checked-out state: 1. It checks out the files, but gives them the .abi-unc suffix (for "uncommitted"). 2. Once every file is successfully checked out, the . abi-unc files replace the real files. If an error occurs midway through checkout, any .abi-unc files that have been created might be left behind. If you receive the error message "Cannot write project parameters file: /path/filename.abi-unc" during checkout and you see . abi-unc files, delete them and try checking out again. Uncommitted files are usually left behind because a checkout process was aborted.

T) When to use sort within groups ?

- April 24, 2025

Use Sort within Groups only if records within a group are processed before being sorted on a minor key. i.e. if processing "A" needs records to be sorted on field {"1"} and later in the flow processing "B" needs records to be sorted on field {"1", "2"}. In this case before processing "2" and after processing "1" use sort within groups with major-key as {"1"} and minor key as {"2"}. If records are not grouped to start with, use Sort with a multi-part key. There is no benefit to using Sort within Groups directly after using a Sort component.

Labels

.abi-unc files
.abinitiorc
.rec files
$ vs ${} Substitution
32-bit limitations
Ab Initio
Ab Initio administration
Ab Initio Advanced
Ab Initio Architecture
Ab Initio Best Practices

Ab Initio CLI
Ab Initio commands
Ab Initio components
Ab Initio Concepts
Ab Initio config
Ab Initio Developer Interview
Ab Initio examples
Ab Initio Graphs
Ab Initio Interview Q&A
Ab Initio Parameters
Ab Initio Tips
Ab Initio troubleshooting
Ab Initio Tutorial
AB_JOB_PREFIX
AB_LOCAL
AB_TIMEOUT
abinitiorc
aborted checkout
admin controls
Aggregate Functions
Aggregation Example
air object commands
air object referencing-files
air project Command
air sandbox
air tag
all-to-all
Analytical Query
API Mode
append mode
array handling
Average
backend cleanup
Batch Processing
Best Practices in Sorting
Broadcast component
change-version
checkout process
checkpointing
Co>Op monitoring
Co>Operating System
Column Concatenation
Combine Data
component behavior
Component Phases
Component Usage
component usage tracking
concatenation
Conditional Logic
Conditional Output
configuration files
Configuration Management
Count
cross-reference checks
CSV processing
Cumulative Calculation
data aggregation
Data Cleaning
Data Cleansing
Data Engineer Interviews
Data Filtering
data flattening
Data Generation
data joining
Data Loss Prevention
Data Multiplication
Data Organization
data parallelism
Data Patterns
data pipelines
data preprocessing
data processing
Data Processing Modes
data quality
Data Routing
Data Sorting
data transformation
data validation
Data Wrangling
Database Query
Dataset Counting
Dedup Alternative
dedup component
Dedup Sorted
delete-recreate
Deleted Object Recovery
Dense Rank
Department Wise Salary
deployment best practices
Disaster Recovery
disk space management
distributed processing
DML Examples
DML Programming
DML String Manipulation
Duplicate Handling
duplicate removal
EME Recovery
EME Version Control
environment variables
error recovery
ETL Automation
ETL best practices
ETL Cleaning
ETL Configuration
ETL data cleaning
ETL data flow
ETL Data Processing
ETL development
ETL impact analysis
ETL Interview
ETL job recovery
ETL Logic
ETL Metadata
ETL operations
ETL parallelism
ETL Performance
ETL pipeline
ETL pipelines
ETL Processing
ETL server tuning
ETL setup
ETL temporary storage
ETL Transformation
ETL transformations
expression
fault tolerance
file
file access modes
file cleanup
file I/O
file manipulation
File Transformation
File Validation
filter by expression
Find and Replace
Fixed-Length Normalize
flow types
full outer join
function
GDE Configuration
GDE Functions
GDE Settings
get-required-file
Graph Dependencies
Graph Design
Graph Development
graph execution
Graph Logic
graph management
Graph-Level Questions
grep commands
Group By
group by operations
Grouped Data
hardware constraints
header removal
Header Trailer Processing
High-Volume Output
Impact Analysis
In-memory Processing
Input File Detection
input file handling
input/output flow
intermediate files
Interview Questions
job control
job execution
job logging
job management
job parameters
job restart
Join component
join operations
Keep Parameter
key
key assignment
key-based processing
kill command
layout configuration
left join
lookup function
m_kill command
m_rollback
Max Core
Max Memory
max-core value
memory allocation
memory management
metadata queries
Million Records
Modulo Logic
multi-file processing
Multi-stage Component
multifile
Multiple Outputs
next_in_sequence
Normalize
Normalize Component
Nth Highest Salary
Null Key
Null Key Example
object management
Optimization
Output Index
Output Ports
Parallel Processing
Parameter Syntax
partition
partition handling
partition logic
performance optimization
performance tuning
phase execution
plan-level parameters
precedence rules
Process Limits
process termination
project-wide searches
Q&A Series
Rank Function
Real-world Example
rec files
record deduplication
Record Expansion
record filtering
record matching
record numbering
record processing
Record Sequencing
recovery files
redefine reformat
Reformat Component
reformat techniques
Regular Expressions
Reject Handling
Remove Duplicates
Replicate component
Repository Management
right join
rollback mechanisms
rollup aggregation
Rollup component
row to column
Running Concatenation
Running Total
Runtime Behavior
Sales Analysis
same-file operations
sandbox management
Scalable Data
Scan Component
Scenario-Based Questions
Select Parameter
sequence generation
serialfile
server settings
Shell Scripting
Short Questions
sort component
Sorted Data
Sorting Algorithms
SQL Query
Stage Component
Stateful Logic
string manipulation
string_replace function
Sum
Summarize Data
summary calculations
Surrogate Key
system administration
system configuration
System Resources
tag operations
temp files
temporary files
Text Processing
this_partition()
Top 10 Ab Initio Questions
Trailer Records
trailer removal
Transform Function
Unique Key
unique records
Unix memory
Unix processes
user preferences
Utility Mode
Variable Expansion
version control
version switching
When to Sort Groups
Window Functions
Without Sort
work directories
workflow automation
Workflow Optimization
workflow orchestration
write conflicts
xfr dependencies

Show more Show less