PySpark Developer

Discover your future at Citi

Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your community and make a real impact.

Job Overview

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

We are seeking an experienced and highly skilled PySpark Developer to design, develop, and maintain robust and scalable data processing solutions. The ideal candidate will have a strong background in big data technologies, particularly Apache Spark with Python (PySpark), and a deep understanding of data warehousing, ETL/ELT processes, and cloud platforms. This role will involve working closely with data scientists, data engineers, and other stakeholders to build data pipelines that support analytics, machine learning, and business intelligence initiatives.

Key Responsibilities

• 8 years of experience in software development with a focus on data engineering.

• 3+ years of experience with PySpark for data processing, ETL (Extract, Transform, Load) operations, data manipulation, and building distributed computing solutions on large datasets.

• Proficiency in designing and building robust data pipelines, data ingestion, transformation, and processing workflows

• Solid understanding of data modeling principles, database design, and strong SQL skills for data querying and analysis.

• Ability to analyze data, identify patterns, uncover insights, and translate business needs into actionable data solutions.

• Leading and mentoring a team of data engineers or analysts, fostering best practices, and ensuring the delivery of high-quality data products.

• Working closely with product partners and business analysts, to understand requirements and deliver impactful analytical solutions.

• Strong understanding of data processing concepts and techniques.

• Proficiency in SQL and experience with relational databases.

• Experience with cloud platforms such as AWS, Azure, or GCP is a plus.

• Familiarity with data warehousing concepts and technologies.

• Experience with big data technologies such as Hadoop, Hive, or Impala is a plus.

• Excellent problem-solving and communication skills.

• Ability to work independently and as part of a team.

• Understanding of microservices architecture principles and design patterns.

• Experience with DevOps practices and tools.

• Technical Skills:

  • PySpark Expertise:Expert-level proficiency in PySpark for data processing, transformations, and analysis.

  • Python:Strong programming skills in Python, including object-oriented programming and standard libraries.

  • SQL:Advanced SQL knowledge for data querying, manipulation, and optimization.

Education:

• Bachelor’s degree/University degree or equivalent experience

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

Responsibilities:

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.