Data Engineer – Bangalore, Pune, Hyderabad, Chennai
Experience: 4.5+ Years
Employment Type: Full-Time
Location: Bangalore, Pune, Hyderabad, or Chennai, India
About the Role:
We are seeking a skilled Data Engineer to join our innovative team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and infrastructure to support data-driven solutions. If you are passionate about working with large datasets, optimizing data workflows, and collaborating with cross-functional teams, this is your opportunity to make a significant impact!
Core Responsibilities:
- Design, develop, and maintain scalable and efficient data pipelines to process and transform large volumes of data.
- Build and optimize data models to support analytics, reporting, and machine learning applications.
- Implement ETL/ELT processes to integrate data from various sources into data warehouses or lakes.
- Ensure data quality, integrity, and security across all data processes.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Optimize data storage and retrieval processes for performance and cost efficiency.
- Implement and maintain CI/CD pipelines for data workflows and automation.
- Monitor and troubleshoot data pipeline issues to ensure reliability and performance.
- Stay updated with the latest data engineering tools, technologies, and best practices.
Required Technical Skills:
- 4.5+ years of experience in data engineering or related roles.
- Strong proficiency in programming languages such as Python, Java, or Scala.
- Expertise in SQL for data querying, transformation, and optimization.
- Experience with big data technologies (e.g., Apache Spark, Hadoop, or Flink).
- Hands-on experience with data pipeline tools (e.g., Apache Airflow, Apache NiFi, or Luigi).
- Proficiency in working with cloud-based data platforms (e.g., AWS, Azure, or Google Cloud).
- Experience with data warehousing solutions (e.g., Snowflake, Redshift, or BigQuery).
- Familiarity with data modeling, schema design, and database management (SQL/NoSQL).
- Knowledge of version control systems (e.g., Git) and CI/CD methodologies.
- Strong understanding of data integration, ETL/ELT processes, and data governance principles.
Preferred Qualifications:
- Experience with real-time data processing and streaming technologies (e.g., Kafka, Kinesis).
- Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
- Knowledge of data lake architectures and tools (e.g., Delta Lake, Apache Iceberg).
- Experience with infrastructure as code (e.g., Terraform, CloudFormation).
- Understanding of machine learning pipelines and integration with data engineering workflows.
- Familiarity with data visualization tools (e.g., Tableau, Power BI) and analytics platforms.
- Exposure to Agile/Scrum methodologies and tools like Jira.
- Relevant certifications (e.g., AWS Certified Data Analytics, Google Cloud Professional Data Engineer).
Comments:
- Immediate joiners preferred.
- Please include a link to your portfolio or GitHub profile showcasing relevant data engineering projects.
- Shortlisted candidates will be required to complete a technical assessment.
How to Apply:
Interested candidates are requested to submit their updated resume through the application form on our website, including the following details:
- Current CTC
- Expected CTC
- Notice Period
- Links to relevant projects or portfolio
Join our team and contribute to building cutting-edge data solutions that drive innovation and impact!
We are an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.