
Principal AI Agent Engineer – Agentic AI & LLM Applications
Alpharetta, GAFull-time$155–261K/yrSeen todayIn the employer's feed · checked in the last 2 days
See where you stand before you apply. No sign-up to start.
You apply on the posting's application page, with no Olive account needed.
Watch jobs like this. New roles like this one near Alpharetta, GA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive focuses on jobs in the United States, including remote roles you can work from there.
Job overview
AT&T’s Business Agent Foundry seeks a Principal AI Agent Engineer to build and scale production-grade AI agents and LLM applications for business problems. The role partners with business and product teams to move solutions from problem definition and prototype into production, with attention to security, reliability, observability, Responsible AI, and maintainability. The position is onsite five days per week and offers an annual salary range of $155,400 to $261,100.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
This is a full-time onsite role based in the location(s) posted and is performed from the designated work location five days per week. No relocation is offered.
The Business Agent Foundry is seeking a Principal AI Agent Engineer to design, build, and scale production-grade AI agents and LLM-powered applications that solve high-value business problems.
This is not a traditional software engineering role with AI layered on top. You will work directly with business partners to turn complex, sometimes ambiguous problems into working AI-enabled solutions, moving quickly from problem definition and prototype to production while maintaining enterprise standards for security, reliability, observability, Responsible AI, and maintainability.
We’re looking for someone who has already shipped AI agents, LLM-powered workflow automation, or applied GenAI solutions into production and can clearly explain how those systems worked, how they were adopted, and the measurable impact they delivered.
What You'll Do:
-
Design, build, and deploy production-grade AI agents and agentic workflows that improve customer experience, employee productivity, operational efficiency, quality, or cost.
-
Partner directly with business leaders, product teams, and process owners to identify high-value AI opportunities and translate ambiguous requirements into scalable solutions.
-
Build conversational, workflow, and task-oriented agents capable of using tools, APIs, enterprise data, retrieval, structured reasoning, and human-in-the-loop approvals .
-
Develop agent orchestration using LangGraph, Semantic Kernel, AutoGen, CrewAI, Bedrock Agents , or similar production-capable frameworks.
-
Engineer prompts, system instructions, context-management strategies, state, memory, and retrieval flows to improve agent accuracy and reliability.
-
Integrate AI solutions with enterprise APIs, databases, knowledge repositories, systems of record, vector stores, and other data sources.
-
Implement RAG and advanced retrieval patterns , including enterprise search, semantic retrieval, and context engineering.
-
Establish evaluation frameworks using golden datasets, scenario testing, regression testing, human review, and production feedback loops.
-
Build observability across prompts, model calls, retrieval, tool execution, latency, errors, and user interactions.
-
Design guardrails, escalation paths, human oversight, and secure access patterns for sensitive or higher-risk workflows.
-
Apply Responsible AI, privacy, security, and governance principles throughout solution design and deployment.
-
Establish reusable engineering patterns, templates, and components that other teams can leverage across the AI platform.
What You'll Bring:
-
Demonstrated experience building and shipping AI agents, LLM-powered applications, or GenAI workflow automation into production for real users or business teams.
-
The ability to explain the scope and impact of previously deployed AI systems, including architecture, users, workflows, data sources, integrations, adoption, operating model, and measurable business outcomes.
-
Deep hands-on experience with Python and backend/full-stack development using technologies such as FastAPI, Flask, or Django .
-
Strong understanding of LLM application architecture , including prompt engineering, context engineering, RAG, tool/function calling, session state, structured outputs, and response validation.
-
Hands-on experience with agent orchestration frameworks such as LangGraph, Semantic Kernel, AutoGen, CrewAI, or comparable platforms.
-
Experience designing APIs, service integrations, authentication, database interactions, and deployment-ready application components .
-
Experience connecting AI applications to enterprise data, APIs, knowledge repositories, vector databases, or systems of record.
-
Strong software engineering discipline across automated testing, code review, CI/CD, logging, monitoring, observability, and production support .
-
The ability to evaluate tradeoffs among AI models based on accuracy, latency, cost, reliability, risk, and business requirements.
-
Strong communication skills and the ability to explain complex AI and engineering decisions to both technical and non-technical stakeholders.
What You'll Need:
-
Typically 8+ years of software engineering experience , including experience designing and operating complex production systems.
-
Significant hands-on experience developing and deploying LLM, GenAI, or agentic AI applications .
-
Strong proficiency in Python, APIs, distributed application architecture, and enterprise integration .
-
Experience with at least one production-capable agent or AI orchestration framework.
-
Experience implementing evaluation, monitoring, observability, and reliability controls for AI-enabled applications.
-
Understanding of Responsible AI, data privacy, security, access control, auditability, and AI guardrails .
-
Ability to work in an onsite, highly collaborative environment with business and technology partners.
Preferred Qualifications:
-
Technical leadership experience establishing architecture, engineering standards, or reusable patterns across multiple teams.
-
Experience applying AI within enterprise functions such as customer care, operations, network, sales, finance, service delivery, or employee productivity .
-
Experience with advanced RAG, knowledge graphs, enterprise search, ontology-driven retrieval, or semantic data modeling .
-
Experience evaluating or serving LLMs at scale, including quality, latency, token/cost, and reliability optimization .
-
Front-end development, data visualization, or rapid product prototyping experience.
-
Open-source contributions or reusable frameworks related to AI agents, LLM applications, AI evaluation, or GenAI engineering .
Our Principal Software Engineering jobs earn between $155,400.00 - $261,100.00 USD Annual. Not to mention all the other amazing rewards that working at AT&T offers. Individual starting salary within this range may depend on geography, experience, expertise, and education/training.
Joining our team comes with amazing perks and benefits:
-
Medical/Dental/Vision coverage
-
401(k) plan
-
Tuition reimbursement program
-
Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company-designated holidays)
-
Paid Parental Leave
-
Paid Caregiver Leave
-
Additional sick leave beyond what state and local law require may be available but is unprotected
-
Adoption Reimbursement
-
Disability Benefits (short term and long term)
-
Life and Accidental Death Insurance
-
Supplemental benefit programs: critical illness/accident hospital indemnity/group legal
-
Employee Assistance Programs (EAP)
-
Extensive employee wellness programs
-
Employee discounts up to 50% off on eligible AT&T mobility plans and accessories, AT&T internet (and fiber where available) and AT&T phone
Weekly Hours:
40
Time Type:
Regular
Location:
Alpharetta, Georgia, Dallas, Texas, Plano, Texas, USA:GA:Atlanta / 1057 Lenox Park Blvd Ne - Adm:1057 Lenox Park Blvd Ne
Salary Range:
$155,400.00 - $261,100.00
AT&T and its subsidiaries are committed to equal employment opportunity. All hiring, promotion, and other employment decisions remain merit-based and free from discrimination on the basis of race, color, religion, religious creed, national origin, ancestry, age, sex, sexual orientation, gender, gender identity, gender expression, physical disability, mental disability, pregnancy, medical condition, genetic information, marital status, citizenship status, military status, veteran status, or any other characteristic protected by federal, state, or local laws. In addition, AT&T will provide reasonable accommodations to qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made. Click here (https://urldefense.com/v3/\_\_https:/www.eeoc.gov/poster\_\_;!!BhdT!gVgkRvpoFXvxCPguQlKOpna1E9V2xmnpQvxcjhTWaBpnwCl09S3N6PYnLgM6kQjmJXAYFLihSQ4W3Sw2boE9zgEA$) to learn more or request an application accommodation here (https://urldefense.com/v3/\_\_https:/www.att.jobs/accommodation/\_\_;!!BhdT!gVgkRvpoFXvxCPguQlKOpna1E9V2xmnpQvxcjhTWaBpnwCl09S3N6PYnLgM6kQjmJXAYFLihSQ4W3Sw2bszyLYN3$) .
AT&T will consider for employment qualified applicants in a manner consistent with the requirements of federal, state and local laws
We expect employees to be honest, trustworthy, and operate with integrity. Discrimination and all unlawful harassment (including sexual harassment) in employment is not tolerated. We encourage success based on our individual merits and abilities without regard to race, color, religion, national origin, gender, sexual orientation, gender identity, age, disability, marital status, citizenship status, military status, protected veteran status or employment status
How this job compares
Set against the 36,955 open Software Engineer jobs on Olive Jobs, counted November 22, 2026.
- Pay
- This posting$155–261K/yr
- Georgia median$114–200K/yr505 salary ranges
- US median$131–215K/yr30,098 salary ranges
This range's midpoint, $208K, is 34% above the Georgia median midpoint ($155K) — in the top quarter of Software Engineer salary ranges in Georgia.
- Openings
- Olive Jobs lists 726 open Software Engineer jobs in Georgia and 36,955 across the US. 8% of them nationwide are listed as remote or flexible.
- Hiring the most in Georgia
- Oracle72 open
- Deloitte50 open
- Home Depot36 open
- Experience
- This posting asks for at least 8 years of experience — more than three in four Software Engineer postings that state a minimum ask for (median 5 years, across 30,474 postings).
- Education
- 10,846 of the 36,955 open Software Engineer jobs (29%) ask for a bachelor's degree or higher.
Pay, requirements and demand for Software Engineer jobs
Counted across the open, public US postings on Olive Jobs on November 22, 2026. Figures based on too few postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.



