Software Engineer

Job title: Software Engineer

Company: Evizot

Job description: Title: Senior Software Engineer – Data EngineeringClient: Co- BankVisa: USC and GCLocation: Denver CO, Chicago IL, Memphis MN (Hybrid 3 Days a week)
Duration: Long term
Interview: in personNeed Updated LinkedIn with profile pic . Need One Managerial reference with LinkedIn profile, official id and number.Top Skills Details
7+ years of experience as a Data Engineer (or 5+ years of experiences in software engineering or DevOps) with a strong focus on cloud-based environments.
Strong proficiency in Python.
Extensive experience with AWS Cloud services such as AWS Glue, AWS Lambda, EKS, Amazon S3, Amazon Redshift, Amazon EMR, and AWS Kinesis.
Knowledge of cloud-native technologies and serverless computing.
Knowledge of data warehousing/data lake concepts and best practices.
Understanding of data modeling and data architecture.
Strong problem-solving and analytical skills.
Strong communication and collaboration skills.NICE TO HAVE:
– Expertise in Terraform highly preferred
– Expertise in AWS Glue highly preferred
– Quicksight experience highly preferredKey Responsibilities
Data Pipelines and Automation
o Design, develop, and maintain scalable data pipelines and ETL processes using AWS services like AWS Glue, AWS Lambda, Amazon S3, Amazon Redshift, and Amazon EMR.
o Develop and maintain data infrastructure, including data lakes, data warehouses, and data marts. Integrate data products with the broader data platform, including data lakes, data warehouses, and analytics tools.
o Design and develop data sharing mechanisms and APIs to enable data exchange between teams.
o Develop, configure, and manage CI/CD pipelines using tools such as Github Actions.
o Automate and streamline deployment and testing processes to enhance solution delivery speed and quality.
o Implement pipeline monitoring and alerting using AWS CloudWatch, Prometheus, and other monitoring tools.
Data Integration:
o Collaborate with data engineers to design and implement data integration strategies to extract, transform, and load (ETL) data from various sources into the cloud data platform.
o Collaborate with data architects and analysts to understand their data needs and requirements.
o Assist in migrating existing data warehouses to AWS, including planning, execution, and optimization.
o Optimize data pipelines for performance, scalability, and cost-efficiency.
o Implement best practices for indexing, partitioning, and clustering to improve query performance.
o Troubleshoot and resolve data- and ETL-related issues.
Security and Governance:
o Implement robust security measures to protect sensitive data, including encryption, access controls, and data masking.
o Develop and enforce data governance policies to ensure data quality, consistency, and compliance with regulations.
o Implement data lineage and provenance to track data movement and transformations.
Technical Leadership:
o Provide technical guidance and mentorship to data engineers, analysts, and scientists.
o Collaborate with business stakeholders to understand data requirements and translate them into technical solutions.Additional Skills & QualificationsBachelor\’s Degree in Computer Science, Software Engineering, Data Engineering, or a related field.

Expected salary:

Location: USA

Job date: Wed, 26 Mar 2025 23:55:26 GMT

Apply for the job now!