Data Engineer – Gen AI – Manager Full-time

Line of Service
Advisory

Industry/Sector
Not Applicable

Specialism
Data, Analytics & AI

Management Level
Manager

Job Description & Summary
A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge.

As part of our Analytics and Insights Consumption team, you’ll analyze data to drive useful insights for clients to address core business issues or to drive strategic outcomes. You’ll use visualization, statistical and analytics models, AI/ML techniques, Modelops and other techniques to develop these insights.

To really stand out and make us fit for the future in a constantly changing world, each and every one of us at PwC needs to be a purpose-led and values-driven leader at every level. To help us achieve this we have the PwC Professional; our global leadership development framework. It gives us a single set of expectations across our lines, geographies and career paths, and provides transparency on the skills we need as individuals to be successful and progress in our careers, now and in the future.

As a Manager, you’ll work as part of a team of problem solvers, helping to solve complex business issues from strategy to execution. PwC Professional skills and responsibilities for this management level include but are not limited to:

• Develop new skills outside of comfort zone.
• Act to resolve issues which prevent the team working effectively.
• Coach others, recognise their strengths, and encourage them to take ownership of their personal development.
• Analyse complex ideas or proposals and build a range of meaningful recommendations.
• Use multiple sources of information including broader stakeholder views to develop solutions and recommendations.
• Address sub-standard work or work that does not meet firm’s/client’s expectations.
• Use data and insights to inform conclusions and support decision-making.
• Develop a point of view on key global trends, and how they impact clients.
• Manage a variety of viewpoints to build consensus and create positive outcomes for all parties.
• Simplify complex messages, highlighting and summarising key points.
• Uphold the firm’s code of ethics and business conduct.

Job Description: GenAI Data Engineering – Manager (PwC US AC)

PwC US – Acceleration Center is looking for an experienced and visionary GenAI Data Engineer to join our team as a Manager. This leadership role involves overseeing the development and maintenance of data pipelines, the implementation of machine learning models, and the optimization of data infrastructure for our GenAI projects. The ideal candidate will have an extensive background in data engineering, with a deep focus on GenAI technologies, and a solid understanding of data processing, event-driven architectures, containerization, and cloud computing.

Responsibilities:

• Lead the design, development, and maintenance of robust data pipelines and ETL processes for GenAI projects.
• Manage and guide a team of data scientists and software engineers in implementing complex machine learning models and algorithms.
• Strategize and optimize data infrastructure and storage solutions to ensure efficient, scalable, and reliable data processing across projects.
• Champion the implementation of event-driven architectures to facilitate real-time data processing and analysis.
• Oversee the deployment of containerization technologies like Kubernetes and Docker to enhance scalability and operational efficiency.
• Direct the development and governance of data lakes, ensuring effective management of large volumes of structured and unstructured data.
• Lead the integration of LLM frameworks (such as Langchain and Semantic Kernel) to advance language processing and analytical capabilities.
• Collaborate with cross-functional teams to architect and implement solution frameworks that align with GenAI project goals.
• Leverage cloud computing platforms like Azure or AWS to maximize data processing, storage, and deployment efficiency.
• Monitor, diagnose, and resolve issues within data pipelines and systems to maintain continuous and smooth operations.
• Stay at the forefront of GenAI technology advancements and introduce innovative solutions to elevate data engineering practices.
• Translate complex business requirements into effective technical solutions, driving project success and technological innovation.
• Document and standardize data engineering processes, methodologies, and best practices across teams.
• Ensure professional development and certification in solution architecture for team members, maintaining industry best practices.

Requirements:

• Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
• 10+ years of relevant technical/technology experience, with a strong emphasis on GenAI projects.
• Advanced programming skills in Python and proficiency in data processing frameworks like Apache Spark.
• Expertise in SQL and sophisticated database management systems.
• In-depth knowledge of event-driven architectures and real-time data processing.
• Proven experience with containerization technologies like Kubernetes and Docker.
• Extensive experience managing data lakes and understanding of data lake architecture.
• Familiarity with LLM frameworks such as Langchain and Semantic Kernel.
• Robust experience with cloud computing platforms such as Azure or AWS.
• Exceptional leadership, problem-solving, and analytical skills.
• Superior communication and collaboration abilities, capable of leading high-performing teams.
• Ability to navigate a fast-paced and dynamic work environment.

Nice to Have Skills:

• Proficiency with technologies like Databricks, Azure AI Search, Azure OpenAI, Azure Event Hub, Azure Data Lake Storage, AWS Open Search, AWS Bedrock, AWS Event Bridge, AWS S3, Azure Key Vault, Hashicorp Key Vault, DataDog, and Splunk.
• Relevant advanced certifications in solution architecture and cloud computing.

Join PwC US – Acceleration Center as a Manager in GenAI Data Engineering to lead strategic initiatives and contribute to pioneering GenAI solutions. We offer a stimulating work environment that fosters innovation and significant opportunities for professional growth and advancement.

Education (if blank, degree and/or field of study not specified)
Degrees/Field of Study required:

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Optional Skills

Desired Languages (If blank, desired languages not specified)

Travel Requirements
Not Specified

Available for Work Visa Sponsorship?
No

Government Clearance Required?
No

Job Posting End Date
July 26, 2024