Job title: Lead Data Engineer
Company: Incedo
Job description: Company OverviewIncedo is a US-based consulting, data science and technology services firm with over 3000 people helping clients
from our six offices across US, Mexico and India. We help our clients achieve competitive advantage through
end-to-end digital transformation. Our uniqueness lies in bringing together strong engineering, data science, and
design capabilities coupled with deep domain understanding. We combine services and products to maximize
business impact for our clients in telecom, Banking, Wealth Management, product engineering and life science
& healthcare industries.
Working at Incedo will provide you an opportunity to work with industry leading client organizations, deep
technology and domain experts, and global teams. Incedo University, our learning platform, provides ample
learning opportunities starting with a structured onboarding program and carrying throughout various stages of
your career. A variety of fun activities is also an integral part of our friendly work environment. Our flexible
career paths allow you to grow into a program manager, a technical architect or a domain expert based on your
skills and interests.
Our Mission is to enable our clients to maximize business impact from technology by
- Harnessing the transformational impact of emerging technologies
- Bridging the gap between business and technology
Role DescriptionRole Description:
As a Technical Lead – Big Data Platform at Incedo, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects. You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure. You will be skilled in big data technologies such as Hadoop, Spark, and Kafka and have experience in cloud computing platforms such as AWS or Azure. You will be responsible for ensuring the performance, scalability, and security of the big data platform and troubleshooting any issues that arise.Roles & Responsibilities:
- Designing, developing and maintaining large-scale big data platforms using technologies like Hadoop, Spark and Kafka
- Creating and managing data warehouses, data lakes and data marts
- Implementing and optimizing ETL processes and data pipelines
- Developing and maintaining security and access controls
- Troubleshooting and resolving big data platform issues
- Collaborating with other teams to ensure the consistency and integrity of data
Technical SkillsSkills Requirements:
- 8+ Years experience Driving Delivery of Data Engineering , Data Design , Data Modeling and Data Analysis Projects
- Hands on Experience in Hadoop Stack of Technologies ( Hadoop ,Spark, HBase, Hive , Pig , Sqoop, Scala ,Flume, HDFS , Map Reduce).
- Hands on experience with Python & Kafka .
- Good understanding of Database concepts , Data Design , Data Modeling and ETL.
- Hands on in analyzing, designing, and coding ETL programs which involves Data pre-processing , Data Extraction , Data Ingestion , Data Quality ,Data Normalization & Data Loading.
- Working experience in delivering projects in Agile Methodology and hands on in Jira.
- Experience in Client Facing Roles with good communication & thought leadership skills to co-ordinate deliverables across the SDLC .
- Good understanding of Machine Learning Models and Artificial Intelligence preferred.
- Good understanding of Data Components , Data Processing & Data Analytics on AWS is good to have .
- Experience with data modeling tools like Erwin is good to have.
- Preferred Location : Cleveland or Pittsburgh.
- Master’s/Bachelor’s in computer science or equivalent fields
Nice-to-have skillsQualificationsQualifications
- 7-9 years of work experience in relevant field
- B.Tech/B.E/M.Tech or MCA degree from a reputed university. Computer science background is preferred
Company ValueWe value diversity at Incedo. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
Expected salary:
Location: Pittsburgh, PA – Cleveland, OH
Job date: Sun, 19 Jan 2025 07:41:53 GMT
Apply for the job now!