Senior Software Engineer, Ingestion Team

Pryon · New York, NY · $175k - $200k
full-time senior Posted 3 weeks ago

About this role

About Pryon:  We’re a team of AI, technology, and language experts whose DNA lives in Alexa, Siri, Watson, and virtually every human language technology product on the market. Now we’re building an industry-leading knowledge management and Retrieval-Augmented Generation (RAG) platform. Our proprietary, cutting-edge natural language processing capabilities transform unstructured data into meaningful experiences that increase productivity with unmatched accuracy and speed. The Opportunity: The Ingestion team is responsible for everything that happens between content arriving from a connector and that content being ready for search and retrieval. This means document processing pipelines that handle parsing, text extraction, chunking, metadata enrichment, embedding generation, and index population — across every file format and content type our customers throw at us. We’re in the middle of a significant architectural evolution — migrating from a legacy pipeline to a modern, workflow-orchestrated architecture with cleanly separated processing stages: intake, transformation, enrichment, and indexing. The team is also actively designing the next iteration of the pipeline to push further on throughput and resilience. This is real systems engineering: the problems are about scale, reliability, and the messy realities of processing millions of documents with wildly different structures.

Similar Jobs

Related searches:

Remote Jobs Senior Jobs Remote Senior Jobs Senior NLP & Language AISenior AI Agents & RAG AI Jobs in New York NLP & Language AI in New YorkAI Agents & RAG in New York nlprag