Consultant-AWS Data Engineer

About Tredence

Tredence is a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in the data analytics and data science space. Our capabilities range from Data Visualization, Data Management to Advanced analytics, Big Data and Machine Learning. Our uniqueness is in building Scalable Big Data Solutions on Onprem/GCP/Azure cloud in a very cost effective and easily scalable manner for our clients. We also come in with some strong IP and pre-built analytics solutions in data mining, BI and Big Data. 
 

Job Summary

1. Design, develop, and maintain data pipelines and ETL processes using AWS services such as ECS (Fargate), S3, and Redshift.

2. Utilize Python, SQL-DBT for data processing, transformation, and analysis tasks.

3. Implement and optimize SQL queries for performance and efficiency on Redshift.

4. Work closely with cross-functional teams to integrate data from various sources and systems.

5. Collaborate with stakeholder and BAs to understand the data gaps and work with L1, L2 & L3 teams.

6. Implement data modeling and schema design best practices of Redshift.

7. Monitor data pipelines, identify performance bottlenecks, and implement optimizations to ensure reliability and scalability.

8. Develop and maintain documentation for data pipelines, workflows, and data models.

9. Stay updated with the latest developments in AWS services, Airflow, DBT, and other relevant technologies, and evaluate their potential impact on our data infrastructure.

10. Participate in code reviews, provide constructive feedback, and mentor junior team members.

Job Location

Bangalore / Chennai / Gurgaon / Pune

Roles & Responsibilities

1. Bachelor’s degree in computer science, Engineering, or a related field; or equivalent work experience.

2. Proven experience as a Data Engineer or similar role, with a focus on building and maintaining data pipelines.

3. Strong proficiency in AWS services, particularly ECS, Redshift, S3, Cloudwatch and other services like Airflow, DBT, Github.

4. Proficiency in SQL with experience optimizing queries for performance.

Qualification & Experience

1. Master’s degree in computer science, Engineering, or a related field.

2. AWS Certification (e.g., AWS Certified Solutions Architect, AWS Certified Big Data - Specialty).

3. Experience with other data processing frameworks and technologies such as Apache Airflow, Apache Kafka.

4. Knowledge of containerization technologies (e.g., Docker, Kubernetes).

5. Experience with machine learning and data science concepts.

6. Contributions to open-source projects or active participation in technical communities.

Why Join Tredence?

There is a reason we are one of the fastest growing private companies in the country! You will have the opportunity to work with some of the smartest and fun-loving people in the data analytics space. You will work with the latest technologies and interface directly with the key decision stakeholders at our reputed clients, some of the largest and most innovative global business brands. Our people are our greatest asset and we value every one of them. We are an equal opportunity employer who adhere to our core values & reflect this in our day to day life. So, please come & see why we’re so successful in one of the most competitive and fastest growing industries in the world.