Catalyte is looking for a Python developer to create and maintain scripts for data ingestion, cleaning, and transformation. You will work with large datasets from various sources, ensuring data quality and preparing it for analysis and machine learning models. This long-term project is central to our data-driven talent identification platform and requires strong scripting skills and attention to detail.

Join our data engineering team and contribute to the core of Catalyte's platform. As a Data Processing Script Developer, you will be responsible for building the pipelines that fuel our predictive analytics. You will write efficient, scalable, and reliable Python scripts to handle complex data processing tasks.

Core Responsibilities

• Develop Python scripts to automate the extraction, transformation, and loading (ETL) of data from diverse sources like APIs, databases, and flat files.
• Implement data cleaning and validation logic to ensure high data quality and integrity.
• Work with libraries such as Pandas, NumPy, and Dask for data manipulation and analysis.
• Collaborate with data scientists to understand their data requirements and provide them with clean, well-structured datasets.
• Optimize scripts for performance and scalability to handle growing data volumes.
• Write unit tests for your code and contribute to our CI/CD processes.
• Document your code and data pipelines clearly.

This is a challenging role that offers the opportunity to work with big data technologies and make a significant impact on our business. You will be part of a team that is passionate about using data to discover and develop human potential.

• 2+ years of experience in Python programming.
• Proficiency with data manipulation libraries, especially Pandas.
• Experience with reading/writing data from various formats (CSV, JSON, Parquet).
• Familiarity with SQL and relational databases.
• Understanding of data quality and validation concepts.
• Basic knowledge of version control with Git.

• Work on a meaningful project with a social impact.
• Gain extensive experience in data engineering and ETL processes.
• Long-term, stable remote contract.
• Opportunity to learn from experienced data scientists and engineers.