Hybrid Senior Prompt-Context Engineer

at AT&T

• Job title: Senior Prompt-Context Engineer
• Job type: Full Time
• Experience level: Senior
• Salary: $116,700 - $196,100 per year
• Degree requirement: Bachelor's Degree
• Tech skills: Cloud, Django, Docker, Flask, NoSQL, Postgres, Python, SQL
• Location requirements: Hybrid, Alpharetta, United States

About the role

• Senior Software Engineer designing context-rich AI solutions at AT&T. Focused on integrating large language models and prompt engineering.

Responsibilities

• We are looking for a highly skilled Senior Software Engineer (LLM/Prompt-Context Engineer) with a strong full stack Python background to design, develop, and integrate intelligent systems focused on large language models (LLMs), prompt engineering, and advanced context management.
• Play a critical part in architecting context-rich AI solutions, crafting effective prompts, and ensuring seamless agent interactions using frameworks like LangGraph.
• Design, optimize, and evaluate prompts for LLMs to achieve precise, reliable, and contextually relevant outputs across a variety of use cases.
• Architect and implement dynamic context management strategies, including session memory, retrieval-augmented generation, and user personalization, to enhance agent performance.
• Integrate, fine-tune, and orchestrate LLMs within Python-based applications, leveraging APIs and custom pipelines for scalable deployment.
• Build and manage complex conversational and agent workflows using the LangGraph framework to support multi-agent or multi-step solutions.
• Develop robust backend services, APIs, and (optionally) front-end interfaces to enable end-to-end AI-powered applications.
• Work closely with product, data science, and engineering teams to define requirements, run prompt experiments, and iterate quickly on solutions.
• Implement testing, monitoring, and evaluation pipelines to continuously improve prompt effectiveness and context handling.

Requirements

• Deep experience with fullstack Python development (FastAPI, Flask, Django; SQL/NoSQL databases).
• Demonstrated expertise in prompt engineering for LLMs (e.g., OpenAI, Anthropic, open-source LLMs).
• Strong understanding of context engineering, including session management, vector search, and knowledge retrieval strategies.
• Hands-on experience integrating AI agents and LLMs into production systems.
• Proficient with conversational flow frameworks such as LangGraph.
• Familiarity with cloud infrastructure, containerization (Docker), and CI/CD practices.
• Solid understanding of PostgreSQL or other relational databases, including fundamentals of database design and querying.
• Exceptional analytical, problem-solving, and communication skills.
• Preferred: Experience evaluating and fine-tuning LLMs or working with RAG architectures.
• Background in information retrieval, search, or knowledge management systems.
• Contributions to open-source LLM, agent, or prompt engineering projects.

Benefits

• Medical/Dental/Vision coverage
• 401(k) plan
• Tuition reimbursement program
• Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company-designated holidays)
• Paid Parental Leave
• Paid Caregiver Leave
• Additional sick leave beyond what state and local law require may be available but is unprotected
• Adoption Reimbursement
• Disability Benefits (short term and long term)
• Life and Accidental Death Insurance
• Supplemental benefit programs: critical illness/accident hospital indemnity/group legal
• Employee Assistance Programs (EAP)
• Extensive employee wellness programs
• Employee discounts up to 50% off on eligible AT&T mobility plans and accessories, AT&T internet (and fiber where available) and AT&T phone.