Job Description Senior Data Engineer (GenAI / AWS) Duration: 3+ Months (Extension Possible) Experience: 14+ years Cloud Platform: AWS Primary Language: Python Key Responsibilities - Design and develop data pipelines using AWS Step Functions, Lambda, S3, Textract, and Comprehend. - Build automated document-processing workflows for extracting, transforming, and processing structured and unstructured data. - Implement document chunking, embeddings, vector indexing, and semantic search. - Develop and maintain vector databases and knowledge bases to support Retrieval-Augmented Generation (RAG). - Integrate knowledge bases with AI agents for contextual information retrieval. - Build AI agents using Claude Agent SDK and deploy them on Amazon Bedrock AgentCore Runtime. - Develop CI/CD pipelines using GitHub Actions to automate builds, testing, and deployments. - Optimize data pipelines for scalability, reliability, security, and performance. Additional Information All your information will be kept confidential according to EEO guidelines.
Summary
Design and build AWS data pipelines, document-processing workflows, vector databases, and RAG knowledge bases; integrate AI agents using Claude Agent SDK on Amazon Bedrock; develop CI/CD with GitHub Actions. Requires 14+ years of experience, AWS cloud platform expertise, and Python.
Responsibilities
Design and develop AWS data pipelines; build document-processing workflows; implement chunking, embeddings, vector indexing, and semantic search; develop vector databases and RAG knowledge bases; integrate AI agents; build agents with Claude Agent SDK on Amazon Bedrock AgentCore Runtime; develop CI/CD with GitHub Actions; optimize pipelines for scalability, reliability, security, and performance
Qualifications
14+ years of experience; Cloud Platform: AWS; Primary Language: Python
Experience requirements
14+ years of experience; Cloud Platform: AWS; Primary Language: Python