Job Description
Job Description
6+ Years of Development Experience
3+ Years ETL AWS Glue
3+ Years Spark
3+ Years AWS Cloud
3 Years S3 and FTP Servers
ETL: 5 years
Ab Initio: 2+ years
We are looking for a skilled Software Engineer – with ETL On Prem and AWS Cloud Experience to design and fill data warehousing environment. The duties will include consulting with the data management team, reviewing the storage needs of the company, extracting data from company servers, filling the new warehouse, and testing it upon completion.
Skillset requirements:
Strong experience in AWS GLUE, Hudi, Data brew, experience extracting data from multiple sources, working with GLUE Studio.
Experience working with AWS Elastic search, RDS, PostgreSQL preferred
Experience AWS services such as Lambda, EMR, developing and maintaining data pipelines using AWS Cloud formation.
Experience in Requirements Analysis, Data Analysis, Application Design, Application Development, Implementations and Testing of Data warehousing business systems.
Solid experience in developing Ab Initio applications for Extraction, Transformation, Cleansing and Loading into Data Warehouse/Data mart.
Experience in developing re-usable generic applications for high-volume DWH environment.
Extensively used Ab Initio EME data store/sandbox for version control, code promotion, and impact analysis or any other ETL tool
Experience in writing UNIX Shell Scripts.