Infocepts-Data Engineer-Dataiku/Python
Position: Data Engineer (Python/Dataiku/Spark/SAS DI)
Location: Bangalore/Chennai
Type of Employment: Full time
Purpose of the Position:
As a Data Engineer, this position requires candidate who are enthusiastic about specialized skills in any DE tools like Python/Dataiku/Spark/SAS DI and features. As a member of the team, you will help our clients, by building data pipelines that supports to progress on their Data and Analytics journey.
Key Result Areas and Activities:
Driving Data Engineering Initiatives:
- Work with clients to understand and define the data initiatives based on business needs.
- Review all project architectures/codes and contribute towards the development of the project delivery.
Data Integration and ETL Development:
- Design, develop, and implement data integration solutions using Data Engineering tools like Python/Dataiku/Spark/SAS data integration.
- Develop and maintain automated data pipelines for real-time and scheduled data ingestions.
Performance Tuning and Optimization:
- Conduct performance tuning and optimization of queries and data models.
- Optimize data workflows for efficiency and scalability.
Database Design and Implementation:
- Design and implement database objects such as tables, views, schemas, and stored procedures.
- Ensure data quality and consistency across the data warehouse.
Collaboration and Communication:
- Work closely with cross-functional teams to gather requirements and translate them into technical specifications.
- Collaborate seamlessly with clients across multiple geographies.
Problem Solving and Troubleshooting:
- Troubleshoot and resolve data-related issues.
- Apply strong analytical and problem-solving abilities to ensure data quality.
Drive the Project & Technical Team:
- Work with client to gather the data requirements.
- Provide required technical support to development team while delivering the code/project.
- Manage end to project deliverables as technical lead/spoc for client and Infocepts.
-
Essential Skills:
- Experience on data engineering tools like Python/Dataiku/Spark/SAS data integration.
- Collate data from various data sources and implement business logic while loading into data mart layer.
- Must have strong SQL experience and extract data from various databases and perform required analysis on data.
- Should have BI knowledge to understand the analytics needs of business users.
- Communication with business users to understand the requirements. Able to convert the business requirements into technical requirements.
- Understanding of data modeling concepts, including relational and dimensional modeling.
Desirable Skills
- Good analytical skill to perform data analysis for different banking products data
- Experience on any BI tools like Microstrategy, Power BI
Qualifications:
- 3+ years of experience to Design and develop efficient and scalable data integration/engineering solutions to support our organization’s data analytics and reporting needs.
- Technical certifications that attribute to continuous learning aspirations.
Qualities:
- Influences and implements change with confidence and sound decisions.
- Tackles problems head-on with a logical, systematic, and practical approach; follows up with developers.
- Consults, writes, and presents persuasively.
- Works effectively in self-organized, cross-functional teams.
- Iterates based on new information, peer reviews, and feedback.
- Collaborates seamlessly with clients across geographies.
- Proficient in English (read/write/speak) and email communication.