- Career Center Home
- Search Jobs
- Lead Engineer Data
Results
Job Details
Explore Location
Empower
Bangalore, India
(on-site)
Job Type
Full-Time
Industry
Other
Job Function
Other
Lead Engineer Data
The insights provided are generated by AI and may contain inaccuracies. Please independently verify any critical information before relying on it.
Lead Engineer Data
The insights provided are generated by AI and may contain inaccuracies. Please independently verify any critical information before relying on it.
Description
Our vision for the future is based on the idea that transforming financial lives starts by giving our people the freedom to transform their own. We have a flexible work environment, and fluid career paths. We not only encourage but celebrate internal mobility. We also recognize the importance of purpose, well-being, and work-life balance. Within Empower and our communities, we work hard to create a welcoming and inclusive environment, and our associates dedicate thousands of hours to volunteering for causes that matter most to them.Chart your own path and grow your career while helping more customers achieve financial freedom. Empower Yourself.
Empower-Retirement is looking for an experienced Lead Data Engineer with experience in implementing ELT/ETL data pipelines, AWS data ecosystems, pipelines, and transformations with Python. As a Sr Data Engineer, you will be responsible for building, maintaining, and implementing ELT/ETL pipelines and database structures. The Sr Data Engineer will be responsible for the data lifecycle and will collaborate with other developers on the team. The Sr Data Engineer will work with internal technology teams in order to understand and aid in the implementation of database and data transformation requirements in order to deliver enterprise reporting solutions.
\n
Duties / Responsibilities / Essential Functions:
- Design and build data structures throughout all stages of the data lifecycle (raw, refined, analytics/report ready)
- Maintain and optimize existing data structures throughout all stages of the data lifecycle (raw, refined, analytics/report ready)
- Build ELT/ETL Python scripts to source data from various systems, to conform to reporting database structures
- Maintain and optimize current Python ELT/ETL scripts/processes and data structures
- Validate data and transformations throughout the entire data lifecycle
- Analyze data discrepancies (throughout all stages of the data lifecycle) to determine root cause and identify correct course of action
- Integrate up-and-coming data management and software engineering technologies into existing data structures.
- Document data lineage (source to target), data transformations, business logic, calculations, data dictionary
- Validate data and transformations throughout the entire data lifecycle
- Work with team to validate expectations and accuracy of the data with business and development leaders
- Provide guidance on automated data QA checks throughout data lifecycle
- Design, construct, install, test and maintain data management systems.
- Ensure that all systems meet the business/company requirements as well as industry practices.
- Employ an array of technological languages and tools to connect systems together.
- Collaborate with members of your team the project deliverables goals.
- Install/update disaster recovery procedures
- Recommend different ways to constantly improve data reliability and quality
- Train and mentor others on the team on best practices, techniques, and languages
Education:
- Bachelor's degree in computer science, software/computer engineering, applied mathematics, or physics statistics.
REQUIRED QUALIFICATIONS:
- 6+ years of Python programming experience using python packages such as numpy, pandas etc to manipulate and transform data from application web to server side.
- Strong experience using Python on event-drive programming, familiar with using python lists, classes, dictionaries to build module/functions etc
- Has experience analyzing, mapping, and connecting with various source system data
- Solid experience with building and maintaining ETL/ELT pipelines using Python
- Strong experience with Postgres and PSQL writing data transformation and data structures
- Strong working and conceptual knowledge of building and maintaining physical and logical data models
- Excellent communication skills with the ability to collaborate with non-technical partners
- Experience working in an Agile environment working on a Scrum team
- Strong understanding of concepts or experience with ETL and ELT, Data piplines, Data Warehousing and Data Marts, Kimball Vs. Inmon architecture patterns, TDD, Source control, CI/CD, DevOps
OTHER PREFERRED QUALIFICATIONS:
- Experience with BI ETL tools (Informatica, SSIS, Alteryx) in creating ELT/ETL and augmented data workflows for data or reporting deliverables
- Experience in cloud-based data engineering in AWS Cloud, EC2, CloudFrontRoute5, API Gateway, CloudWatch, CloudTrail, CloudFormation, RDS, Redshift, DynamoDB, S3, Aurora
- Experience working in AWS: Glue, Lambda, Step, EMR, Data Pipeline, Kenisis, Athena, Quicksight strongly preferred
- Experience with Business Intelligence, end-to-end implementation and requirements gathering, in Tableau, Power BI or Snowflake in strongly desired
- Familiarity with Scala, Java, .Net
We are an equal opportunity employer with a commitment to diversity. All individuals, regardless of personal characteristics, are encouraged to apply. All qualified applicants will receive consideration for employment without regard to age, race, color, national origin, ancestry, sex, sexual orientation, gender, gender identity, gender expression, marital status, pregnancy, religion, physical or mental disability, military or veteran status, genetic information, or any other status protected by applicable state or local law.
Job ID: 82091838
Jobs You May Like
Median Salary
Net Salary per month
$952
Cost of Living Index
22/100
22
Median Apartment Rent in City Center
(1-3 Bedroom)
$336
-
$885
$611
Safety Index
46/100
46
Utilities
Basic
(Electricity, heating, cooling, water, garbage for 915 sq ft apartment)
$18
-
$55
$29
High-Speed Internet
$7
-
$13
$10
Transportation
Gasoline
(1 gallon)
$4.39
Taxi Ride
(1 mile)
$0.53
Data is collected and updated regularly using reputable sources, including corporate websites and governmental reporting institutions.
Loading...