ROLE-AWS Data Engineer
EXP-3-5 Years
LOCATION-Preferably Chennai, or Gurgaon/ Bangalore/ Mumbai/ Kolkata, WFO 5 days
Job Overview:
We are looking for an AWS Glue Consultant with 3-5 years of experience to join our Cloud Solutions team. The ideal candidate will be responsible for designing, developing, and optimizing data pipelines using AWS Glue, integrating data from multiple sources, and ensuring efficient data transformation and ETL (Extract, Transform, Load) workflows. As a consultant, you will collaborate closely with stakeholders to provide tailored data solutions that drive business insights and operational efficiency.
Key Responsibilities:
Design, develop, and manage ETL workflows using AWS Glue.
Integrate data from multiple sources such as RDS, S3, Redshift, and other AWS services.
Transform raw data into structured formats for analysis, reporting, and business intelligence.
Optimize and fine-tune Glue jobs for performance and scalability.
Ensure proper data validation, error handling, and data quality in pipelines.
Collaborate with cross-functional teams, including data analysts, data scientists, and business stakeholders, to understand data requirements and deliver solutions.
Implement best practices for data processing, data security, and data governance within AWS environments.
Monitor and troubleshoot AWS Glue jobs and ensure the reliability of the data pipelines.
Provide technical support and guidance on AWS Glue usage and configurations.
Stay updated with the latest AWS services and features, ensuring that solutions leverage cutting-edge technologies.
Required Skills and Qualifications:
3-5 years of experience in designing and building ETL pipelines using AWS Glue.
Proficiency in writing and optimizing PySpark or Python scripts for Glue jobs.
Strong experience with AWS cloud services including S3, RDS, Lambda, Redshift, Athena, and IAM.
Understanding of data formats such as Parquet, Avro, ORC, and JSON.
Hands-on experience in building data lakes and data warehouses on AWS.
Experience with data modeling, database design, and working with large-scale data.
Strong troubleshooting skills and experience with performance tuning ETL jobs.
Experience with workflow orchestration tools such as AWS Step Functions or Airflow.
Familiarity with AWS security best practices, including IAM roles, policies, and encryption.
Strong problem-solving skills with attention to detail.
Excellent communication and collaboration skills.
About Status Neo
At StatusNeo, we make it happen!!!
We are the catalysts of transformation, a distinguished global consulting firm that empowers businesses through cutting-edge AI, automation, and cloud-first digital solutions.
We are experts in product & platform engineering who elevate businesses with unparalleled user experience, design, and functionality.
As passionate community leaders for D3manifesto.org, we guide and inspire CXOs across the globe to achieve remarkable outcomes by embracing the power of Digital, Data AI, and DevSecOps. With unrivaled expertise, our team comprises top-notch software engineers and product designers, handpicked from the industry's finest talent pool.
At Status Neo, we don't just talk the talk; we walk the walk. Our exceptional work environment, fueled by innovation and collaboration, has earned us the prestigious Great Place To Work certification.
We take immense pride in nurturing a culture that breeds success, empowering our exceptional workforce to deliver excellence every step of the way.
Are you ready to embark on a transformative journey? Join forces with StatusNeo today and witness the remarkable results.