Data Engineer | 006_2024_SDE2
Experience: 3-4+ Years | Location: Guwahati (Remote or Hybrid)
Date of posting: 03-11-2024
This is a full-time hybrid role for a Data Engineer at Cogneo Technologies. As a Data Engineer, you will be responsible for daily tasks related to data engineering, including data modeling, ETL processes, data warehousing, and data analytics. This role offers flexibility for remote work.
Role and responsibilities
- Develop and maintain data pipelines for data ingestion, transformation, and loading
- Design and implement data models for efficient storage and retrieval
- Cleanse and validate data to ensure accuracy and consistency
- Write efficient and maintainable data processing scripts
- Optimize data pipelines for performance and scalability
- Implement data quality checks and monitoring throughout the data lifecycle
- Automate data pipelines using scheduling tools
- Collaborate with data analysts, data scientists, and stakeholders to understand data requirements
- Secure data access and permissions within data storage systems
- Troubleshoot and debug data processing issues
- Stay up-to-date on the latest data engineering tools and technologies
- Contribute to the development and documentation of data engineering practices
- Work with infrastructure teams to ensure smooth integration of data pipelines with other systems
Requirements
- Data Engineering, Data Modeling, and ETL skills
- Data Warehousing and Data Analytics skills
- Strong problem-solving and analytical skills
- Proficiency in programming languages (such as Python, Java, or Scala)
- Experience with SQL and database management systems.
- Familiarity with tools like DBT / Databricks would be a plus.
- Familiarity with data visualization tools (such as Tableau or Power BI or databricks)
- Excellent communication and teamwork skills
- Bachelor's or Master's degree in Computer Science, Data Science, or related field
- Relevant certifications (e.g., AWS Certified Big Data - Specialty) are a plus
Benefits
- Competitive salary and benefits package.
- Opportunities for professional growth and career development.
- Flexible work environment with remote and hybrid work options.
- Flexible timing and work-life balance.
- Collaborative and inclusive culture that values diversity and creativity.