Data Engineer
Role Overview
Looking for highly motivated and experienced Data Engineer to join a team focused on building a cutting-edge Data Analytical Platform. The right candidate will have expert level experience in supporting Legacy/Big Data platforms, products, and data ingestion/transformation activities from different data sources to and from the Enterprise Data Lake.
Responsibilities
- Data modeling, coding, analytical modeling, root cause analysis, investigation, debugging, testing and collaboration with the business partners, product managers, architects & other engineering teams.
- Adopting and enforcing best practices related to data ingestion and extraction of data from the big data platform.
- Developing (enhancements and maintenance) new ETL and Business Intelligence Solutions using Legacy and New Technologies.
- Monitor Production jobs, maintain, and enhance legacy ETL Processes on a regular basis. Improve slow running jobs with the help of redesign and better ETL processes to meet business needs.
- Prepares and presents recommendations for data warehouse/business intelligence solutions options that best achieve business needs; simplifies the data landscape, and increases the ability to discover, manage, and analyze data.
- Ensure company is adhering to data management standards.
Required Qualifications
- Bachelor’s degree in engineering or master’s degree in computer application
- 5 or more years of experience within information & technology or financial services industry.
- Experience in ETL/Database development/Data Modelling/Data Ingestion/Data Transformation.
- Experience with AWS or other cloud vendors.
- Experience with business process design and major process improvement.
- Experience with quality check on the ETL application
- Excellent analytical skills and strong quantitative skills
- Team player who can establish excellent working relationships with peers and other teams.
- Knowledge of Programming Languages (Python, SQL, Snowflake, Git, Shell script).
- A dedicated, self-starter, who thrives in a fast-paced organization often managing multiple deliverables under tight deadlines.
Preferred Qualifications
- 5+ years of work experience with ETL, data modeling, and business intelligence big data architectures.
- 3+ years of experience with the Cloud and big data ecosystems.
- Expert in at least one SQL language
- Experience developing and managing data warehouses on a terabyte or petabyte scale.
- Strong experience in massively parallel processing & columnar databases.
- Experience working in a Linux environment.
- Deep understanding of advanced data warehousing concepts and track record of applying these concepts on the job.
- Good communication skills.
- Dynamic team player.
