Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI.
Inviting applications for the role Lead Consultant – Data Engineer (ML/AI)
We are looking for a highly skilled Lead Data Engineer who can code, design complex data projects, manage cross-functional teams, and effectively communicate with stakeholders. The ideal candidate should have core skills in Python, ETL, Pyspark. Additionally, familiarity with Machine learning and knowledge of AI is preferred.
Responsibilities:
• Build Spark pipelines required for extraction, transformation and loading the data from wide variety of sources using pyspark and SQL
• Ability to Schedule and merge dependent Airflow jobs
• Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility
• Implement processes and systems to monitor data quality, ensuring production data is accurate and available
• Work closely with engineering teams to develop strategy for long term data platform architecture
• Design and develop machine learning and deep learning systems.
Requirements:
• Bachelor’s degree in Computer Science, IT, engineering, or a related field.
• Experience working with high-performance, distributed and in-memory systems
• Working knowledge of pyspark and airflow, preferably on Databricks Platform
• Working knowledge of Open Source Trino (Presto) or Starburst
• Working knowledge in Python and other Object-Oriented languages
• Working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases (Postgres, Oracle, Vertica, Delta-lake)
• Working knowledge of Kafka, preferably Commercial version of Confluent
• Working knowledge of AWS or any other cloud services (rds, msk, s3, etc.)
• Knowledge of Vertica Columnar Database
• Familiarity with machine learning libraries/frameworks (keras, pytorch, scikit-learn), plotting libraries (matplotlib, seaborn, Plotly), and Jupyter notebooks.
• Knowledge of a variety of machine learning techniques (clustering, decision tree learning, artificial neural networks, etc.) and their real-world advantages/drawbacks.
• Knowledge of Gan-AI with small scale project success.
• Experience with or knowledge of Agile methodologies such as SCRUM.
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation. Get to know us at www.genpact.com and on X, Facebook, LinkedIn, and YouTube.
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a ‘starter kit,’ paying to apply, or purchasing equipment or training.
Project Role : AI / ML EngineerProject Role Description : Develops applications and systems that utilize AI tools, Cloud AI...
How to applyAt Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of...
How to applyJob Title – Lead Business Analyst – Finance Analytics & AICareer level – E Leverage technology to impact patients and...
How to applyThe AI platform is responsible for all AI infrastructure across Datadog. Our mission is to provide tools and platforms that...
How to applySummary Want to build the training platform that engineers rely on to develop next-generation Apple Intelligence products and services? As...
How to applyResponsibilities TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring...
How to apply