Senior Data Engineering / AI Specialist (RAG / Vector Search)
- Рівень:
- senior
- Джерело:
- djinni.co
Що робити
- Design and implement scalable batch ingestion pipelines for millions of documents.
- Build resumable, partitioned data processing workflows with retries, deduplication, and quality controls.
- Develop document parsing pipelines, including OCR, table extraction, and layout analysis.
- Generate structure-aware chunks, embeddings, metadata, and hierarchical summaries.
- Design and optimize hybrid search infrastructure combining BM25 and vector search.
Що очікуємо
- Strong production experience with large-scale data processing, including millions of documents or multi-terabyte datasets.
- Hands-on experience with Spark, Ray, AWS Batch/Glue, Kubernetes Jobs, or equivalent technologies.
- Experience with vector databases and search engines such as OpenSearch, Elasticsearch, pgvector, Milvus, or Qdrant.
- Strong understanding of vector indexing, hybrid search, ANN tuning, and partitioning.
- Experience with document parsing, OCR, and table extraction technologies.
Що пропонуємо
- GPU inference experience with vLLM, Triton, or TEI.
- Experience with Apache Iceberg, Delta Lake, or Parquet.
- Knowledge of GraphRAG and entity linking.
- Experience with permission-aware retrieval and audit requirements.
- Background in construction, engineering, legal technology, or other document-intensive domains.
Схожі вакансії
Senior Data Engineer (Data Ops, Search and Matching)GenSoft$3 000 - $4 500 на місяцьremotesenior- Senior Data Engineer (Data Ops, Search and Matching)GenSoftsenior
- Senior Data Engineering / AI SpecialistKozak Agencysenior
Senior Data Engineering / AI Specialist (Contractor)CodeITremotesenior- Senior Data Engineer - Analytics and Data ProductsBrainway$4 000 - $5 000 на місяцьsenior
З блогу Trackr
Усі статті →
Знайдено через trackr.help/jobs · Канал: @trackrhelp · Бот для персональних сповіщень: @trackrhelpBot