Job Summary:
The AI Engineering Experienced Manager serves as the senior development lead for the AI capabilities embedded across the DT&I product portfolio, with primary emphasis on the architecture, development, production operation, and continuous improvement of agent architectures, orchestration, and LLM-powered application features. This role owns the hands-on engineering of intelligent capabilities—from model selection and prompt and tooling design through evaluation, deployment, and observability—ensuring AI features are accurate, reliable, secure, and cost-effective within BDO’s Azure ecosystem. The AI Engineering Experienced Manager works within and ensures that all AI capabilities are designed, deployed, and operated in alignment with BDO’s AI Governance Policies and responsible-AI standards. The role works in close coordination with the Context Engineering Experienced Manager and Data & Analytics Lead to deliver well-integrated, properly provisioned AI solutions. The AI Engineering Experienced Manager partners closely with cross-functional teams to align AI engineering practices and product delivery with BDO’s AI Governance Policies, responsible AI standards, assurance service delivery objectives, firm policies, and security standards.
Job Duties:
Agent & Orchestration Engineering
Designs and builds agent architectures and multi-agent orchestrations using Semantic Kernel and Azure AI Foundry across the DT&I portfolio
Serves as the principal technical authority on agent design, planners, tool and function calling, memory, and workflow patterns
Architects and implements production-grade AI features, turning prototypes into reliable capabilities within the product stack
Evaluates and integrates emerging models, frameworks, and orchestration tools to continuously improve capability and efficiency
Designs agent observability, error handling, retry, and fallback strategies to ensure resilient, fault-tolerant AI workflows
Sets engineering quality standards for AI application design, testing, deployment, monitoring, and operational support.
LLM Application Engineering
Implements retrieval-augmented generation (RAG) pipelines, structured outputs, function calling, and application-layer prompt strategies
Integrates AI capabilities into the .NET 10 / React product stack across the Advantage portfolio (PEM, RevRec, GCM 2.0, Centralized Billing, and others)
Partners with the Context Engineering Experienced Manager to integrate governed knowledge, context and grounding within agent and application runtimes
Builds reusable AI service components, SDKs, and patterns for use across DT&I product teams
Establishes development practices that promote maintainability, extensibility, testability, and operational readiness
Guides engineering teams through technical challenges, design decisions, production incident, and remediation activities
Ensures AI capabilities meet defined product, assurance service delivery, performance, usability, and reliability objectives
Model Strategy, Evaluation & Responsible AI
Establishes model selection, routing, fallback, and cost and latency optimization across AI features
Designs evaluation harnesses, regression tests, and guardrails to measure and defend accuracy, cost, and latency targets
Implements responsible-AI controls including safety, bias mitigation, accuracy, and human-in-the-loop appropriate to a regulated assurance context
Works within and maintains alignment with BDO’s AI Governance Policies—including approved-model, acceptable-use, data-handling, and responsible-AI requirements—across all AI features
Owns LLMOps including deployment, monitoring, observability, and drift detection for AI systems within the Advantage SDLC and CI/CD pipeline
Risk Management
Ensures AI systems comply with BDO’s AI Governance Policies, firm security policies, regulatory requirements, and responsible-AI standards (SOC 2, PCAOB AS 2201, QC 1000, ISO 27001)
Coordinates AI governance reviews and approvals and maintains the documentation and evidence required to demonstrate alignment with BDO’s AI Governance Policies
Manages data handling, auditability, and the controls required for AI-assisted assurance work
Partners with risk and compliance stakeholders to maintain alignment between AI systems and firm governance requirements
Performs other duties as assigned
Willingly accepts share of less desirable assignments
Supervisory Responsibilities:
Acts as a direct supervisor to engineering and development team members, as assigned
Acts as a career advisor and mentor to engineering and development team members as assigned
Qualifications, Knowledge, Skills, and Abilities:
Education:
High School Diploma/GED, required
Bachelor’s degree with a focus in Computer Science, Information Systems, Engineering, Information Technology, preferred
Experience:
Eight (8) or more years of experience in software engineering or related technology fields, required
Four (4) or more years of hands-on experience building and deploying production AI/ML or LLM applications, required
Four (4) or more years of experience with AI orchestration frameworks (Semantic Kernel, LangChain, or equivalent) and Azure AI services, required
Demonstrated delivery of agent, RAG, or function-calling features to production, required
Experience delivering enterprise-scale AI solutions in professional services, assurance, or accounting industries, preferred
Experience establishing AI evaluation, responsible-AI, or model governance frameworks, preferred
Experience leading technical teams or directing complex engineering initiatives, preferred
Experience delivering enterprise AI solutions within professional services, assurance, accounting, financial services, or another regulated industry, preferred
License/Certifications:
Microsoft Certified: Azure AI Engineer Associate, or equivalent, preferred
Technology:
Expert-level knowledge of Microsoft Azure AI services including Azure AI Foundry, Azure OpenAI, and Azure AI Search, required
Strong understanding of the AI application lifecycle including prompt design, evaluation, deployment, monitoring, and observability, required
Experience with AI orchestration and agent frameworks (Semantic Kernel, LangChain, Durable Functions), required
Strong development experience with .NET 10 / C# and React, required
Experience with RAG, structured outputs, function calling, and vector technologies (Azure AI Search, embeddings), required
Experience with CI/CD pipelines (Azure DevOps), source control (Git), and containerization (Docker, Azure Container Apps), preferred
Experience with AI evaluation and observability tooling and agentic development tooling (Claude Code or equivalent), preferred
Knowledge, Skills, & Abilities:
Expert-level knowledge of applied LLM and agent engineering for production systems
Proven ability to serve as a hands-on AI engineer while providing team leadership and engineering governance
Deep knowledge of agent architectures, orchestration, RAG, and responsible-AI practices
Working knowledge of AI governance frameworks and the ability to design, build, and operate AI systems in alignment with BDO’s AI Governance Policies
Familiarity with data architecture and the ability to collaborate with context, infrastructure, and data engineering teams on dependencies
Excellent problem-solving skills with a focus on accuracy, reliability, cost optimization, and operational efficiency
Strong communication skills with the ability to convey technical concepts to non-technical stakeholders and leadership
Experience presenting AI architecture and governance recommendations to governance bodies (e.g., Architecture Review Boards)
Strong knowledge of AI security, data privacy, and compliance considerations in regulated environments
Ability to work across technical teams and business stakeholders in complex, fast-paced enterprise environments
Self-directed with the ability to manage multiple priorities and competing deadlines
Collaborative mindset with the ability to build relationships across all levels of the organization
Ability to travel up to 10%, no relocation required
Individual salaries that are offered to a candidate are determined after consideration of numerous factors including but not limited to the candidate’s qualifications, experience, skills, and geography.
National Range: $150,000 - $180,000
Maryland Range: $150,000 - $180,000
NYC/Long Island/Westchester Range: $150,000 - $180,000
About the company
At BDO, how we show up matters. We build strong relationships by supporting one another, our clients, and our communities with care, curiosity, and a commitment to helping one another grow and succeed. Here, you’ll find meaningful work, leaders invested in your success, and opportunities to build a career around what matters most to you.
Our purpose is to be the people our clients count on to grow with confidence and achieve what matters most. Our values guide how we bring that purpose to life each day. Together, they shape how we work with one another, serve our clients, and create meaningful impact.
BDO provides assurance, tax, and advisory services to clients across the U.S. and around the world. No matter your role, you’ll be part of a team helping clients navigate complexity and move forward with clarity.
As technology continues to shape how we work, BDO values the ability to apply generative and agentic AI solutions to develop work products, improve workflows and identify potential risks. Across our firm, we emphasize professional judgment in validating AI-generated outputs for accuracy, quality, and compliance.
We are proud to be an ESOP company, offering participants a stake in the firm’s success through beneficial ownership and a unique opportunity to enhance their financial well-being. As a qualified retirement plan, the ESOP is a meaningful addition to our comprehensive compensation and Total Rewards benefits* offerings. It also reinforces an ownership mindset that strengthens our connection to one another, our clients, and the future we’re building together.
Learn more about our benefits: BDO Total Rewards encompass more than traditional benefits. Click here to find out more!
*Benefits may be subject to eligibility requirements.
Equal Opportunity Employer, including disability/vets
Click here to find out more!
Summary
The AI Engineering Experienced Manager leads hands-on engineering of agent architectures, orchestration, and LLM-powered features across BDO's DT&I portfolio within Azure, owning model selection, RAG, evaluation, deployment, and observability. Requires 8+ years of software engineering, 4+ years building production AI/ML or LLM apps, and 4+ years with AI orchestration frameworks and Azure AI services. High school diploma or GED required; bachelor's preferred.
Responsibilities
Designs and builds agent architectures and multi-agent orchestrations; implements RAG pipelines, structured outputs, function calling; integrates AI into .NET/React product stack; establishes model selection, routing, fallback, cost/latency optimization; designs evaluation harnesses, guardrails; implements responsible-AI controls; owns LLMOps; ensures compliance with AI governance and security policies; supervises and mentors engineering team members
Qualifications
High School Diploma/GED required; Bachelor's in CS/IS/Engineering/IT preferred; 8+ years software engineering; 4+ years production AI/ML/LLM apps; 4+ years AI orchestration frameworks and Azure AI; demonstrated delivery of agent/RAG/function-calling features to production; preferred enterprise-scale AI in professional services/assurance/accounting and team leadership
Education requirements
High School Diploma/GED required; Bachelor's degree with focus in Computer Science, Information Systems, Engineering, or Information Technology preferred
Experience requirements
Eight or more years of experience in software engineering or related technology fields; four or more years hands-on building and deploying production AI/ML or LLM applications; four or more years with AI orchestration frameworks and Azure AI services; demonstrated delivery of agent, RAG, or function-calling features to production
Benefits
ESOP ownership stake; comprehensive Total Rewards benefits (eligibility may apply); travel up to 10%