We're on a mission to empower experts with groundbreaking knowledge discovery tools. If you're a seasoned Software Engineer - Data with a passion for building AI-native data processing pipelines, we want you on our team!
Your Role:
- Design, optimize, and maintain robust data pipelines for complex knowledge-intensive documents.
- Curate and manage large-scale data ingestion and indexing pipelines, ensuring data quality and error handling.
- Implement end-to-end encryption and data isolation for secure data handling.
- Collaborate with a diverse team to integrate search infrastructure for large language models.
Your First 3 Months:
- Enhance data ingestion framework, boosting efficiency and scalability.
- Improve scalability and performance of data infrastructure, setting new benchmarks.
- Mentor team members and promote best practices in data engineering.
What You Bring:
- Experience building and optimizing search infrastructure in cloud environments.
- Proficiency in Python and cloud/data infrastructure (AWS, GCP, Azure).
- Commitment to secure data practices and continuous learning.
- Proven track record of scaling data pipelines for large volumes of data.
- Proactive problem-solver with a passion for data.
Ready to shape the future of knowledge discovery? Apply now!
