Enterprise Data Warehouse ETL Developer (Ab Initio Specialist)
Position Overview
We are seeking an experienced ETL Developer with specialized expertise in Ab Initio for developing complex data integration solutions for Teradata EDW.
The candidate must have strong telecommunications domain knowledge and ability to translate technical specifications into high-performance ETL solutions.
Experience Required: Minimum 5+ years in ETL development with Ab Initio
Core Responsibilities
Ab Initio Development
- Design and develop complex ETL workflows using Ab Initio GDE for Teradata EDW
- Build scalable data pipelines using Ab Initio components (Reformat, Join, Rollup, Dedup, Partition, Sort, Lookup)
- Develop reusable components, sub-graphs, and implement error handling, checkpoints, and recovery mechanisms
- Optimize performance through parallelization, partitioning, and efficient component usage
- Work with Ab Initio EME, Control Center, Conduct>It, and Co>Operating System
Data Integration & Loading
- Integrate data from Oracle, flat files, XML, JSON into Teradata using Ab Initio
- Implement Ab Initio to Teradata connectivity using BTEQ, FastLoad, MultiLoad, TPump
- Develop incremental/full load strategies, CDC logic, and SCD Types 1, 2, 3 implementations
- Create data quality checks, validation rules, and reconciliation processes
- Work with Cloudera Data Platform (CDP) for big data integration (Plus)
Documentation & Collaboration
- Translate LLD and mapping documents into Ab Initio graphs
- Create technical documentation: design docs, graph specifications, deployment guides
- Collaborate with data modelers, architects, QA teams, and Teradata DBAs
- Develop Ab Initio scripts (.pset, .ksh, .plan files) and Unix shell scripts for automation
Production Support
- Troubleshoot Ab Initio job failures, analyze logs, and implement performance tuning
- Manage version control (Git/SVN) and coordinate deployments
- Monitor jobs through Control Center and provide production support
Required Skills
Ab Initio (Primary - Required)
- 5+ years hands-on experience with Ab Initio GDE, Co>Operating System, Conduct>It, Express>It
- Advanced expertise in Ab Initio components, graph development, and performance tuning
- Ab Initio DML, parameter management, EME, and deployment procedures
- Unix/Linux shell scripting for Ab Initio automation
Teradata & Database (Required)
- Strong Teradata SQL, utilities (BTEQ, FastLoad, MultiLoad, TPump, TPT)
- Understanding of Teradata architecture (AMP, PE, partitioning, indexing: PI, SI, NUSI)
- Oracle SQL and PL/SQL for source data extraction
Big Data (Plus)
- Cloudera Data Platform (CDP) experience; Hadoop ecosystem (Hive, HDFS, Sqoop)
Telecommunications Domain (Required)
- Strong understanding of telecom processes, data flows, and industry standards
- OSS: Network inventory, provisioning, fault/performance management
- BSS: Billing, customer management, order management, revenue assurance
- Telecom KPIs: ARPU, churn rate, network utilization
Professional Skills
- Full SDLC (Agile/Scrum, Waterfall); strong analytical and debugging skills
- Good communication for technical and business collaboration
Preferred Qualifications
- Bachelor's degree in Computer Science or related field
- Ab Initio certification
- Experience with Ab Initio Express>It for data quality
Key Deliverables
- Functional Ab Initio ETL graphs with parameter files and scripts
- Technical documentation: design docs, graph specs, deployment guides
- Unit tested and optimized code ready for production
- Data reconciliation reports and performance tuning recommendations