Mid-level AI Engineer/Data Engineer

Dice is seeking a Mid-level AI Engineer/Data Engineer to work on a platform that converts unstructured financial data into high-quality, structured datasets for financial institutions. The role involves designing data pipelines, building extraction workflows, and ensuring data quality and reliability in production environments.

Responsibilities • Extract data from noisy, inconsistent sources • Validate and reconcile outputs across multiple inputs • Ensure correctness, traceability, and auditability • Designing pipelines that process high-volume financial documents (batch + near real-time) • Building LLM-powered extraction workflows (classification, parsing, summarization) • Implementing validation layers (rule-based + model-based) to reduce hallucinations • Developing retrieval systems using embeddings and vector search • Architecting end-to-end systems: ingestion → processing → storage → serving • Ensuring data quality, observability, and fault tolerance • Collaborating with product to turn messy data into usable financial intelligence

Skills • Have 4-8 years of software development/engineering with AI and Data Engineering experience • Have worked in the investment management, investment banking area processing FINANCIAL MARKET DATA pipelines, RAG, Vector databases • Fluent with Python and API development and streaming systems like Kafka or similar • Strong Python and backend/data engineering experience • Experience building production data pipelines (ETL, streaming, or async systems) • Solid understanding of distributed systems and failure modes • Experience working with LLM-based systems in production: Prompt design, Output validation, Retry/fallback strategies, Evaluation and monitoring • Experience with data storage systems (SQL + NoSQL) • Familiarity with cloud infrastructure (AWS or similar) • Experience with RAG / vector search systems • Background in financial data or capital markets • Experience with streaming systems (Kafka, etc.) • Experience building multi-step or agent-style workflows

Company Overview • Dice is a job-searching platform for technology professionals. It is a sub-organization of DHI Group. It was founded in 1990, and is headquartered in Santa Clara, California, USA, with a workforce of 201-500 employees. Its website is http://www.dice.com.