Data Engineer

Key Responsibilities:

• Design, develop, and maintain APIs for seamless data integration and access.
• Leverage AWS services such as Lambda, Glue, S3, and EC2 to create scalable, reliable data pipelines.
• Work with NoSQL databases and manage data in various formats, particularly JSON.
• Develop and execute ETL processes to transform raw data into actionable insights.
• Write and optimize SQL queries for data extraction and analysis.
• Collaborate with cross-functional teams to gather data requirements and ensure data quality.
• Support data warehousing solutions using Snowflake or similar technologies.
• Monitor, troubleshoot, and optimize data pipelines and workflows for maximum efficiency.

Qualifications:

• Proficient in Python for data processing and scripting.
• Strong hands-on experience with AWS services, especially Lambda, Glue, S3, and EC2.
• Familiarity with NoSQL databases and data modeling concepts.
• Solid understanding of ETL processes and data warehousing principles.
• Strong experience in writing and optimizing SQL for data manipulation and analysis.
• Knowledge of Snowflake or other cloud-based data warehousing solutions is an advantage.
• Excellent problem-solving skills with a keen attention to detail.
• Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams.

Preferred Skills:

• API development, AWS (Lambda, Glue, S3, EC2)
• Familiarity with NoSQL databases and JSON data formats
• Python programming for ETL and data processing
• Expertise in SQL and data warehousing (Snowflake or similar)