Data Engineer

Top Talents

0 +

Overview

Vivasoft, a leading software outsourcing company, is seeking a talented Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines that collect, process, and store data from various sources. You will work closely with business stakeholders to ensure that the data is reliable, accessible, and usable for data-driven decision-making.

Responsibilities:

Leadership and ownership in the project.
Develop, construct, test, and maintain scalable data pipelines for both batch and real-time processing.
Perform data ingestion, extraction, transformation, and loading (ETL) from various sources such as databases, APIs, files, etc.
Optimize and tune SQL queries for efficiency, and implement best practices in data partitioning, sharding, and indexing.
Collaborate with cross-functional teams to understand data requirements and provide optimal solutions.
Utilize principles, architecture, and tools for Data Warehousing and Data Modeling to design efficient and scalable data solutions.

Requirements:

4+ years of experience in data engineering, data warehousing, or related roles.
Knowledge in programming languages like Python/Java.
Proficiency in SQL, including query optimization, partitioning, sharding, and stored procedures & functions.
Knowledge in NoSQL Databases, especially MongoDB.
Expertise in Google Cloud’s data service like Composer, Data Flow, Big Query, Data Fusion, or equivalent stack knowledge of other cloud providers or open-source platforms.
Skill in open source ETL pipeline frameworks like Apache Airflow.
Familiarity in Big Data ecosystem like databricks and nice to have knowledge of scala.
Proficiency in Source Version Control (GIT) and nive to have in Data Version Control (DVC) systems and various aspects of CI/CD pipelines.
Strong understanding of principles, architecture, and tools for Data Warehousing and Warehouse Data Modeling.
Familiarity with batch and stream data processing principles and tools(kafka/kinesis/dataproc etc).
Knowledge in Linux operating system, Bash & Shell Scripting, and Docker Containers.
Experience in data visualization tools such as Looker/ Tableau/ Power BI/ QlikSense is a plus.

What we offer:

Good working environment.
Festival bonus: 2
Friendly work environment (Game room, gym facilities, music corner)
Scope for professional development & career growth
If you want to be prepared for the FAANG interview, we will assign a mentor for you
Other perks as per company policy