Data Engineer – Gen AI – Senior Manager Full-time

Line of Service
Advisory

Industry/Sector
Not Applicable

Specialism
Data, Analytics & AI

Management Level
Senior Manager

Job Description & Summary
A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge.

As part of our Analytics and Insights Consumption team, you’ll analyze data to drive useful insights for clients to address core business issues or to drive strategic outcomes. You’ll use visualization, statistical and analytics models, AI/ML techniques, Modelops and other techniques to develop these insights.

To really stand out and make us fit for the future in a constantly changing world, each and every one of us at PwC needs to be a purpose-led and values-driven leader at every level. To help us achieve this we have the PwC Professional; our global leadership development framework. It gives us a single set of expectations across our lines, geographies and career paths, and provides transparency on the skills we need as individuals to be successful and progress in our careers, now and in the future.

As a Senior Manager, you’ll work as part of a team of problem solvers, helping to solve complex business issues from strategy to execution. PwC Professional skills and responsibilities for this management level include but are not limited to:

• Encourage everyone to have a voice and invite opinion from all, including quieter members of the team.
• Deal effectively with ambiguous and unstructured problems and situations.
• Initiate open and candid coaching conversations at all levels.
• Move easily between big picture thinking and managing relevant detail.
• Anticipate stakeholder needs, and develop and discuss potential solutions, even before the stakeholder realises they are required.
• Contribute technical knowledge in area of specialism.
• Contribute to an environment where people and technology thrive together to accomplish more than they could apart.
• Navigate the complexities of cross-border and/or diverse teams and engagements.
• Initiate and lead open conversations with teams, clients and stakeholders to build trust.
• Uphold the firm’s code of ethics and business conduct.

Job Description: GenAI Data Engineering – Senior Manager

PwC US – Acceleration Center is seeking a seasoned and visionary GenAI Data Engineer to join our team at the Senior Manager level. In this leadership role, you will oversee the development and enhancement of data pipelines, champion the implementation of machine learning models, and drive the optimization of our data infrastructure for GenAI projects. The ideal candidate will have extensive experience in data engineering with a deep focus on GenAI technologies, coupled with an advanced understanding of data processing, event-driven architectures, containerization, and cloud computing solutions.

Responsibilities:

• Lead the strategic planning and development of advanced data pipelines and ETL processes tailored for GenAI projects.
• Direct and mentor teams of data scientists and software engineers in the implementation and optimization of machine learning models and algorithms.
• Spearhead the optimization and scaling of data infrastructure and storage solutions to support efficient data processing across diverse GenAI applications.
• Design and implement robust event-driven architectures to facilitate real-time data processing and analytics.
• Oversee the deployment and management of containerization technologies like Kubernetes and Docker, ensuring high scalability and efficiency.
• Manage the creation and maintenance of expansive data lakes for effective handling of large-scale structured and unstructured data.
• Guide the integration and practical application of LLM frameworks (Langchain, Semantic Kernel) to enhance natural language processing and analysis capabilities.
• Lead cross-functional teams in designing and executing comprehensive solution architectures for GenAI initiatives.
• Champion the use of cloud computing platforms such as Azure or AWS to streamline data processing, storage, and deployment efforts.
• Conduct high-level monitoring and troubleshooting of data pipelines and systems to guarantee continuous and reliable data flow.
• Stay abreast of the latest developments in GenAI technologies and lead the adoption of cutting-edge solutions to refine data engineering practices.
• Facilitate the translation of complex business requirements into scalable technical solutions, enhancing data-driven decision-making processes.
• Develop and enforce documentation standards for data engineering processes, methodologies, and best practices.
• Maintain and advance professional knowledge through ongoing certification and training in solution architecture and industry best practices.

Requirements:

• Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
• 13+ years of relevant technical/technology experience, with significant expertise in GenAI projects.
• Advanced programming skills in Python and fluency in data processing frameworks like Apache Spark.
• Extensive experience with SQL, database management systems, and data architecture principles.
• Proven track record with event-driven architectures and real-time data processing systems.
• In-depth knowledge of containerization technologies such as Kubernetes and Docker.
• Comprehensive understanding of data lakes and strategies for data management.
• Expertise in LLM frameworks including Langchain and Semantic Kernel.
• Proficiency in cloud computing platforms such as Azure or AWS.
• Exceptional leadership, problem-solving, and analytical abilities.
• Superior communication and collaboration skills, with experience managing high-performing teams.
• Ability to operate effectively in a dynamic, fast-paced environment.

Nice to Have Skills:

• Experience with additional technologies such as Databricks, Azure AI Search, Azure OpenAI, Azure Event Hub, Azure Data Lake Storage, AWS Open Search, AWS Bedrock, AWS Event Bridge, AWS S3, Azure Key Vault, DataDog, and Splunk.
• Possession of relevant solution architecture certificates and continuous professional development in data engineering and GenAI.

Join PwC US – Acceleration Center as a Senior Manager in GenAI Data Engineering to lead transformative projects and drive innovation in a collaborative and forward-thinking environment. We offer a competitive compensation package and significant opportunities for career advancement and professional growth.

Education (if blank, degree and/or field of study not specified)
Degrees/Field of Study required:

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Optional Skills

Desired Languages (If blank, desired languages not specified)

Travel Requirements
Not Specified

Available for Work Visa Sponsorship?
No

Government Clearance Required?
No

Job Posting End Date