Gen Ai Data Engineer – Manager Full-time

Line of Service
Advisory

Industry/Sector
Not Applicable

Specialism
Advisory – Other

Management Level
Manager

Job Description & Summary
At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.

Those in intelligent automation at PwC will focus on conducting process mining, designing next generation small- and large-scale automation solutions, and implementing intelligent process automation, robotic process automation and digital workflow solutions to help clients achieve operational efficiencies and reduce costs.

Enhancing your leadership style, you motivate, develop and inspire others to deliver quality. You are responsible for coaching, leveraging team member’s unique strengths, and managing performance to deliver on client expectations. With your growing knowledge of how business works, you play an important role in identifying opportunities that contribute to the success of our Firm. You are expected to lead with integrity and authenticity, articulating our purpose and values in a meaningful way. You embrace technology and innovation to enhance your delivery and encourage others to do the same.

Examples of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not limited to:

• Analyse and identify the linkages and interactions between the component parts of an entire system.
• Take ownership of projects, ensuring their successful planning, budgeting, execution, and completion.
• Partner with team leadership to ensure collective ownership of quality, timelines, and deliverables.
• Develop skills outside your comfort zone, and encourage others to do the same.
• Effectively mentor others.
• Use the review of work as an opportunity to deepen the expertise of team members.
• Address conflicts or issues, engaging in difficult conversations with clients, team members and other stakeholders, escalating where appropriate.
• Uphold and reinforce professional and technical standards (e.g. refer to specific PwC tax and audit guidance), the Firm’s code of conduct, and independence requirements.

Job Description: GenAI Data Engineering – Manager (PwC US AC)

PwC US – Acceleration Center is looking for an experienced and visionary GenAI Data Engineer to join our team as a Manager. This leadership role involves overseeing the development and maintenance of data pipelines, the implementation of machine learning models, and the optimization of data infrastructure for our GenAI projects. The ideal candidate will have an extensive background in data engineering, with a deep focus on GenAI technologies, and a solid understanding of data processing, event-driven architectures, containerization, and cloud computing.

Responsibilities:

• Lead the design, development, and maintenance of robust data pipelines and ETL processes for GenAI projects.

• Manage and guide a team of data scientists and software engineers in implementing complex machine learning models and algorithms.

• Strategize and optimize data infrastructure and storage solutions to ensure efficient, scalable, and reliable data processing across projects.

• Champion the implementation of event-driven architectures to facilitate real-time data processing and analysis.

• Oversee the deployment of containerization technologies like Kubernetes and Docker to enhance scalability and operational efficiency.

• Direct the development and governance of data lakes, ensuring effective management of large volumes of structured and unstructured data.

• Lead the integration of LLM frameworks (such as Langchain and Semantic Kernel) to advance language processing and analytical capabilities.

• Collaborate with cross-functional teams to architect and implement solution frameworks that align with GenAI project goals.

• Leverage cloud computing platforms like Azure or AWS to maximize data processing, storage, and deployment efficiency.

• Monitor, diagnose, and resolve issues within data pipelines and systems to maintain continuous and smooth operations.

• Stay at the forefront of GenAI technology advancements and introduce innovative solutions to elevate data engineering practices.

• Translate complex business requirements into effective technical solutions, driving project success and technological innovation.

• Document and standardize data engineering processes, methodologies, and best practices across teams.

• Ensure professional development and certification in solution architecture for team members, maintaining industry best practices.

Requirements:

• Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.

• 10+ years of relevant technical/technology experience, with a strong emphasis on GenAI projects

• Python Proficiency: Minimum 3 years of hands-on experience building applications with Python.

• Scalable System Design: Solid understanding of designing and architecting scalable Python applications, particularly for Gen AI use cases, with a strong understanding of various components and systems architecture patterns to make cohesive and decoupled, scalable applications.

• Web Frameworks: Familiarity with Python web frameworks (Flask, FastAPI) for building web applications around AI models.

• Modular Design & Security: Demonstrated ability to design applications with modularity, reusability, and security best practices in mind (session management, vulnerability prevention, etc.,).

• Cloud-Native Development: Familiarity with cloud-native development patterns and tools (e.g., REST APIs, microservices, serverless functions).

• Cloud Deployments: Experience deploying and managing containerized applications on Azure/AWS (Azure Kubernetes Service, Azure Container Instances, or similar).

• Version Control (Git): Strong proficiency in Git for effective code collaboration and management.

• CI/CD: Knowledge of continuous integration and deployment (CI/CD) practices on cloud platforms.

• 3-5 years of relevant technical/technology experience, with a focus on GenAI projects.

• Strong programming skills in Python.

• Experience with data processing frameworks like Apache Spark or similar.

• Proficiency in SQL and database management systems.

Preferred Skills:

• Gen AI Frameworks: Experience with LLM frameworks or tools for interacting with LLMs such as LangChain, Semantic Kernel, LlamaIndex

• Data Pipelines: Experience in setting up data pipelines for model training and real-time inference.

Join PwC US – Acceleration Center as a Manager in GenAI Data Engineering to lead strategic initiatives and contribute to pioneering GenAI solutions. We offer a stimulating work environment that fosters innovation and significant opportunities for professional growth and advancement.

Education (if blank, degree and/or field of study not specified)
Degrees/Field of Study required:

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Optional Skills
Accepting Feedback, Accepting Feedback, Active Listening, Agile Methodology, Analytical Thinking, Automation Algorithms, Automation Engineering, Automation Framework Design and Development, Automation Programming, Automation Solutions, Automation Studio, Automation System Efficiency, Blue Prism, Business Analysis, Business Performance Management, Business Process Analysis, Business Process Automation (BPA), Business Transformation, Business Value Optimization, C++ Programming Language, Coaching and Feedback, Cognitive Automation, Communication, Conducting Discovery, Configuration Management (CM) {+ 41 more}

Desired Languages (If blank, desired languages not specified)

Travel Requirements
Not Specified

Available for Work Visa Sponsorship?
No

Government Clearance Required?
No

Job Posting End Date