Senior Software Engineer - Data Platform

About Clarity AI 🪴 Clarity AI is a global tech company founded in 2017 with a unique mission: bringing societal impact to markets. We leverage AI and machine learning technologies to provide top international investors, governments, companies, and consumers with the right data, methodologies, and tools to make more informed decisions.  We are now a team of more than 300 highly passionate and curious individuals from all over the world, with offices in New York, Madrid, London, Paris, and Abu Dhabi. Together, we have established Clarity AI as a leading sustainability tech AI company backed by investors and strategic partners such as BlackRock, SoftBank, and Deutsche Börse , who believe in us and share our goals.  We are dedicated to cultivating an exceptional workplace environment, and we take pride in our culture, defined by our commitment to being fact-based, diverse, transparent, meritocratic, and flexible.  We have plans to continue growing our teams globally, so if you would like to join us on this rocket ship, keep reading! Your work will shape and guide the sustainable decisions of investors, companies and consumers worldwide. About The Role  💻 We are looking for a Senior Software Engineer with a certain background in Data who will help us deliver the different parts of our production-ready product while co-designing and implementing an architecture that can scale up with the product and the company.  This role will primarily focus on software engineering tasks , ensuring the scalability, reliability, and performance of some of the processes that generate part of the core-data of Clarity AI inside our Data Platform. This Software Engineer will work closely alongside a stable team of other Software Engineers with varying levels of experience, a Tech Lead, and a Product Manager. As a member of this team and the Data Platform , you will be involved in conversations with stakeholders. As part of the Data Platform, we build data products and capabilities that power Clarity AI’s mission to bring clarity to sustainability. Our team manages  the entire ingestion flow of data : From gathering information from tens of public sources and vendors to making it accessible to clients and internal teams. We harmonize data that tracks the sustainability performance of companies and governments worldwide, while managing the cross-references and fundamental datasets that make this information interoperable and impactful for financial clients. Beyond this, we provide core data services and infrastructure that empower other Clarity AI teams to innovate, experiment, and deliver value faster.  In our team we work in a collaborative environment (the team always comes before individuals, and we don't like heroes), with a Lean/Agile mindset , where quality is non-negotiable. We value flexibility , remote work, and autonomy in how we work. We place a great deal of importance on working in a trustful environment where everyone can find a good work-life balance . For more insight into the technologies used by the engineering team at Clarity AI, please explore our Tech Stack Location 🌍  The role is based in our tech hub in Madrid, Spain, but we are remote-friendly and open to the CET timezone +/- 2 hours. Way of Working: Remote/Hybrid What You’ll Be Doing 🚀 As a Senior Engineer, this is what we expect from you: About your coding skills:  You are able to design, develop, and maintain processes, data pipelines and services with a focus on simplicity, scalability, reliability, and performance. You write high-quality, clean, well-tested code. Software Quality is non-negotiable for us. Writing automated tests (unit, integration, etc.) continuously must be part of your coding practice. You are used to programming in continuous cycles of coding-testing-refactoring or testing-coding-refactoring. In terms of language, this is a no-stack position. We are currently using Python, DBT, and SQL but previous experience in Python or DBT is not a requirement, but you should have mastery of SQL. You are familiar with the main design patterns and know how to approach your work to create decoupled artifacts . You have experience with APIs , both in using them and in creating them. About your data skills:  You are able to design and understand complex Data Models .  You understand data storage and can make informed decisions about it. You are familiar with working with relational databases, data warehousing, columnar storage, and in-memory databases. You will implement automated Data Quality actions to ensure the integrity of all the datasets we produce. You will build and maintain fully automated and orchestrated data pipelines (ETL/ELT) . Currently, we use Airflow as the main tool for this, but you don't need to be an expert in Airflow.  About your mindset:  You have a Product Engineer mindset , being involved in all aspects of the life cycle of a Product: from understanding th