Senior Data Architect - AI-Powered Data Platforms

Description

• Design metadata extraction and enrichment pipelines that enhance discoverability of unstructured assets
• Design security and access control models that work across legacy systems and modern AI platforms
• Build architectures for multi-modal AI applications that combine structured and unstructured data sources
• Design tiered storage architectures that balance performance needs with storage costs
• Implement caching layers for frequently accessed embeddings and AI model inputs
• Build architectures for continuous learning where RAG systems are updated with new data in near real-time
• Design scalable architectures for processing and indexing unstructured data (PDFs, documents, emails, logs, images) for AI consumption
• Implement chunking strategies and embedding pipelines for diverse document types and data sources
• Implement intelligent document extraction using LLMs' native vision and context capabilities to handle complex layouts, tables, and mixed media
• Architect document processing pipelines that leverage multi-modal LLMs (GPT-4V, Claude, Gemini) for direct document understanding without traditional OCR preprocessing
• Design end-to-end RAG architectures that leverage existing data lakes and enterprise knowledge bases
• Optimize storage strategies for cost-effective management of structured and unstructured data
• Architect hybrid search systems combining traditional keyword search with semantic/vector search capabilities
• Create data governance frameworks that ensure compliance while enabling AI innovation

Requirements

• Proficiency in Python and SQL, with experience in data processing libraries
• 12+ years of experience modernizing legacy data architectures for cloud and AI workloads
• Must be 18 years or older.
• Understanding of modern document processing using multi-modal LLMs and traditional extraction methods
• Master's degree in Computer Science, Information Systems, or related field
• Deep expertise in unstructured data processing using both multi-modal LLMs and traditional methods
• Experience with multi-modal LLMs for document understanding and their cost/performance trade-offs
• Experience with multi-modal AI architectures combining text, image, and structured data
• Background in information retrieval, search engineering, or content management systems
• 5+ years of experience working with both structured (SQL databases, data warehouses) and unstructured data (documents, logs, multimedia)
• Bachelor's degree in Computer Science, Information Systems, or related field
• 10+ years of experience as a Data Architect, Data Platform Engineer, or similar role with enterprise data systems
• Legal authorization to work in the U.S. is required. We will not sponsor individuals at the Bachelor’s level for employment visas, now or in the future, for this job opening.

Benefits

Training + Development

Interview process

Visa Sponsorship

Security clearance