Senior Software Engineer - Data Engineering - IOT - Data Engineer

Date: May 13, 2022

Location: Bangalore / Gurgaon / Chennai , India

Company: Tredence

About Tredence

Tredence is a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in the data analytics and data science space. Our capabilities range from Data Visualization, Data Management to Advanced analytics, Big Data and Machine Learning. Our uniqueness is in building Scalable Big Data Solutions on Onprem/GCP/Azure cloud in a very cost effective and easily scalable manner for our clients. We also come in with some strong IP and pre-built analytics solutions in data mining, BI and Big Data. 
 

Job Details

The role requires experience in Azure core technologies – IOT Hub/ Event hub, Stream analytics, IOT Central, Azure Data Lake Storage, Azure Cosmos, Azure Data Factory, Azure SQL Database, Azure HDInsight / Databricks, SQL data warehouse.

You Will:
• Translate functional requirements into technical design
• Interact with clients and internal stakeholders to understand the data and platform requirements in detail and determine core Azure/AWS services needed to fulfill the technical design
• Design, Develop and Deliver IOT data integration interfaces in ADF and Azure Data Bricks with PySpark based data pipelines
• Design, Develop and Deliver data provisioning interfaces to fulfill consumption needs
• Deliver data models on Azure platform, it could be on Azure Cosmos, Delta lake, SQL DW / Synapse or SQL
• Advise clients on ML Engineering and deploying ML Ops at Scale on AKS
• Automate core activities to minimize the delivery lead times and improve the overall quality
• Optimize platform cost by selecting right platform services and architecting the solution in a cost effective manner
• Deploy Azure DevOps and CI CD processes
• Deploy logging and monitoring across the different integration points for critical alerts


 

Job Location

Bangalore / Chennai / Gurgaon / Pune

Roles & Responsibilities

You Will:
• Translate functional requirements into technical design
• Interact with clients and internal stakeholders to understand the data and platform requirements in detail and determine core Azure/AWS services needed to fulfill the technical design
• Design, Develop and Deliver IOT data integration interfaces in ADF and Azure Data Bricks with PySpark based data pipelines
• Design, Develop and Deliver data provisioning interfaces to fulfill consumption needs
• Deliver data models on Azure platform, it could be on Azure Cosmos, Delta lake, SQL DW / Synapse or SQL
• Advise clients on ML Engineering and deploying ML Ops at Scale on AKS
• Automate core activities to minimize the delivery lead times and improve the overall quality
• Optimize platform cost by selecting right platform services and architecting the solution in a cost effective manner
• Deploy Azure DevOps and CI CD processes
• Deploy logging and monitoring across the different integration points for critical alerts


 

Qualification & Experience

• 3 - 5 years of software development experience
• Minimum 2 year of experience in IOT/streaming data pipelines solution development
• Bachelor's and/or Master’s degree in computer science
• Strong Consulting skills in data management including data governance, data quality, security, data integration, processing and provisioning
• Delivered data management projects with real time/near real time data insights delivery on Azure / AWS Cloud
• Translated complex analytical requirements into technical design including data models, ELTs and Dashboards / Reports
• Experience deploying dashboards and self-service analytics solutions on both relational and non-relational databases
• Experience with different computing paradigms in databases such as In-Memory, Distributed, Massively Parallel Processing
• Successfully delivered large scale IOT data management initiatives covering Plan, Design, Build and Deploy phases leveraging different delivery methodologies including Agile
• Experience on handling telemetry data with Spark streaming, kafka, flink, Scala, pyspark, Spark sql,
• Hands on experience on containers and Dockers
• Exposure to streaming protocols like MQTT and AMQP
• Knowledge of OT network protocols like OPC UA, CAN Bus and similar protocols
• Strong knowledge of continuous integration, static code analysis and test-driven development
• Experience in delivering projects in a highly collaborative delivery model with teams at onsite and offshore
• Must have Excellent analytical and problem-solving skills
• Delivered change management initiatives focused on driving data platforms adoption across the enterprise
• Strong verbal and written communications skills are a must, as well as the ability to work effectively across internal and external organizations

Competencies

Be Entrepreneurial
Constantly Curious
Do the right thing
Pursue Excellence
Tech Skill-1
Tech Skill-2
Tech Skill-3
Think Impact

Why Join Tredence?

There is a reason we are one of the fastest growing private companies in the country! You will have the opportunity to work with some of the smartest and fun-loving people in the data analytics space. You will work with the latest technologies and interface directly with the key decision stakeholders at our reputed clients, some of the largest and most innovative global business brands. Our people are our greatest asset and we value every one of them. We are an equal opportunity employer who adhere to our core values & reflect this in our day to day life. So, please come & see why we’re so successful in one of the most competitive and fastest growing industries in the world.