Senior Software Engineer designing context-rich AI solutions at AT&T. Focused on integrating large language models and prompt engineering.
Responsibilities
We are looking for a highly skilled Senior Software Engineer (LLM/Prompt-Context Engineer) with a strong full stack Python background to design, develop, and integrate intelligent systems focused on large language models (LLMs), prompt engineering, and advanced context management.
Play a critical part in architecting context-rich AI solutions, crafting effective prompts, and ensuring seamless agent interactions using frameworks like LangGraph.
Design, optimize, and evaluate prompts for LLMs to achieve precise, reliable, and contextually relevant outputs across a variety of use cases.
Architect and implement dynamic context management strategies, including session memory, retrieval-augmented generation, and user personalization, to enhance agent performance.
Integrate, fine-tune, and orchestrate LLMs within Python-based applications, leveraging APIs and custom pipelines for scalable deployment.
Build and manage complex conversational and agent workflows using the LangGraph framework to support multi-agent or multi-step solutions.
Develop robust backend services, APIs, and (optionally) front-end interfaces to enable end-to-end AI-powered applications.
Work closely with product, data science, and engineering teams to define requirements, run prompt experiments, and iterate quickly on solutions.
Implement testing, monitoring, and evaluation pipelines to continuously improve prompt effectiveness and context handling.
Requirements
Deep experience with fullstack Python development (FastAPI, Flask, Django; SQL/NoSQL databases).
Demonstrated expertise in prompt engineering for LLMs (e.g., OpenAI, Anthropic, open-source LLMs).
Strong understanding of context engineering, including session management, vector search, and knowledge retrieval strategies.
Hands-on experience integrating AI agents and LLMs into production systems.
Proficient with conversational flow frameworks such as LangGraph.
Familiarity with cloud infrastructure, containerization (Docker), and CI/CD practices.
Solid understanding of PostgreSQL or other relational databases, including fundamentals of database design and querying.
Exceptional analytical, problem-solving, and communication skills.
Preferred: Experience evaluating and fine-tuning LLMs or working with RAG architectures.
Background in information retrieval, search, or knowledge management systems.
Contributions to open-source LLM, agent, or prompt engineering projects.
Benefits
Medical/Dental/Vision coverage
401(k) plan
Tuition reimbursement program
Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company-designated holidays)
Paid Parental Leave
Paid Caregiver Leave
Additional sick leave beyond what state and local law require may be available but is unprotected
Manufacturing Engineer working with engineering and production to enhance manufacturing methods for STULZ Air Technology Systems. Focusing on process optimization, training, and design layouts.
Control Systems Engineer at Mitsubishi Power develops and executes control system designs across the Americas. Involves system configuration, testing, and customer training support.
Environmental Engineer, Scientist or Geologist supporting environmental and natural resources activities in Bethlehem, PA. Focusing on construction oversight, site investigation, and remediation tasks.
Development Engineer at Rogers Corporation developing products to support market - driven growth opportunities in Suzhou, China. Responsible for lab - scale trials and data analysis with cross - team collaboration.
Senior Process Engineer providing day - to - day engineering support for manufacturing operations and implementing process improvements. Collaborating on technical issues and mentoring junior engineers.
Validation and Calibration Engineer ensuring equipment reliability and product quality in a pharmaceutical environment. Planning, executing, and maintaining validation and calibration activities in compliance with cGMP regulations.
Specialist, Validation conducting qualification and validation activities for pharmaceutical projects at Hikma. Collaborating across teams to ensure compliance and effective execution of validation processes.
Project Engineer - Electrical delivering engineering projects to support safe and efficient mining operations at Ernest Henry. Collaborating with teams for successful project execution and electrical system management.
Mine Planning Engineer responsible for developing underground mine designs and schedules for Evolution Mining. Collaborating with planning, scheduling, and underground operations teams for efficient execution.