Data Engineer, Client Services Data & AI Full-time

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

The Business Intelligence Solutions group within the Client Services Data & AI organization works with internal stakeholders to enable faster decision-making, data democratization and self-service through building innovative, scalable best-in-class dashboard and reporting solutions. Our goal is to empower and enable business partners to glean valuable insights from Visa’s unique global data assets.

We are looking for an established individual contributor who is comfortable engaging with business owners, data enthusiasts, and technology teams. Successful candidates have strong experience in developing data solutions for business intelligence applications. This role will be hands-on focused on building data pipelines and solutions at scale and with a focus on sustained operational excellence.

Responsibilities

• As a BI Data Engineer, you will be responsible for establishing robust data processes, innovative data solutions, and efficient automations tailored to meet both business and technical requirements by leveraging Visa-supported big data technologies and third-party tools.
• Lead and manage data engineering projects of varying scales, either independently or as an integral member of a project team.
• Efficiently extract, transform, and manipulate large datasets using industry-standard tools such as Hadoop (Hive), Spark, Python (pandas, NumPy), Presto, SQL, etc.
• Leverage Visa’s advanced data analytics capabilities and industry expertise to develop, standardize, and implement comprehensive BI datasets.
• Identify opportunities to create and automate repeatable analyses, streamlining data flows for business stakeholders.
• Develop and deploy solutions within an agile development framework, utilizing Visa’s single source of truth (SSoT) framework.
• Engage in business requirements gathering, effort estimation, architecture planning, and analyze findings to provide strategic cloud solution recommendations and adoption strategies.
• Provide consistent and reliable operational support for monthly production environments.
• Communicate complex concepts and analysis results clearly and effectively to diverse audiences.
• Research, analyze, recommend, and select innovative technical approaches to solve complex development and integration challenges.
• Offer coaching, guidance, and project mentorship to junior professionals, fostering their growth and development.
• Collaborate with team members and clients to design and implement cutting-edge cloud data and analytics solutions.
• Design, implement, and maintain a comprehensive data quality monitoring system, ensuring thorough source-to-target data validations.
• Develop and maintain the Enterprise Data Catalog / Visa Data Catalog platform, ensuring it meets the organization’s evolving needs.
• Demonstrate strategic thinking and good business acumen to align data engineering with business needs.
• Identify opportunities for enhancements to standards and processes.
• Engage in hands-on activities including POCs, design, documentation, coding, testing, and implementation.
• Work with various stakeholders to implement business requirements and manage the technical aspects of the development pipeline.

Qualifications

Basic Qualifications:

• 5 or more years of relevant work experience with a Bachelor’s Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD
• 5 years of technical experience leading business intelligence or data analytics projects.

Preferred Qualifications:

• 6 or more years of work experience with a Bachelor’s Degree or 4 or more years of relevant experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or up to 3 years of relevant experience with a PhD
• Bachelor’s degree with 7 years of work experience, or Master’s degree with 4 years of experience in a technical or related field.
• Proficiency in building and maintaining high-performing ETL processes in Hadoop, including data quality and testing.
• Advanced SQL knowledge and experience with HQL, Presto, Spark, SQL, and performance tuning.
• Experience with big data technologies such as Hadoop Hive, Spark, and Kafka streaming, and cloud computing technologies.
• Strong problem-solving capabilities with the ability to quickly propose feasible solutions.
• Experience in Python and Spark, with exposure to scheduling tools like Tuber (Airflow) preferred.
• Knowledge of CI/CD concepts and experience with version control systems such as Git.
• Experience working in Agile environments (Scrum, Kanban) or fast-paced, dynamic settings.
• Ability to create data dictionaries, set up/monitor data validation alerts, and maintain data pipelines.
• Effective communication skills for conveying status, issues, and risks precisely and timely.
• Experience with visualization software (e.g., Tableau, MicroStrategy, PowerBI) is a plus.
• Experience with data virtualization tools like Denodo or Snowflake is a big plus.
• Strong leadership, mentoring skills, and the ability to work independently or as part of a team.
• Strong analytical and problem-solving skills, with the ability to juggle multiple projects and adapt to changing business drivers.
• Quick learner, self-starter, and detail oriented.
• Visa experience or knowledge of the payments industry is a plus, but not mandatory

Additional Information

Work Hours: Varies upon the needs of the department.

Travel Requirements: This position requires travel 5-10% of the time.

Mental/Physical Requirements: This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers.

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Visa will consider for employment qualified applicants with criminal histories in a manner consistent with applicable local law, including the requirements of Article 49 of the San Francisco Police Code.

U.S. APPLICANTS ONLY: The estimated salary range for a new hire into this position is 117,700.00 to 199,300.00 USD per year, which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge, skills, experience, and location. In addition, this position may be eligible for bonus and equity. Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401 (k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program.