
AI Engineer – Technical Leader (Agentic AI & FPGA Systems)
Altera · Shanghai, China
- Hardware & Semiconductors
- 1,001–5,000 employees
- San Jose, California
Mixed hiring record · median 42 days open
- First seen
- 11 September 2026
- Reposted
- Not since September 2026
- Last checked
- Today · still on the employer's board
All reasons
- Open 67 days
- 36% of this employer's openings are over 60 days old
In its favour
- Still listed on the employer's own board
Job Details
Job Description
Role Overview
We are seeking a highly experienced AI Technical Leader to drive the design and deployment of next-generation agentic AI systems optimized for FPGA/ASIC platforms.
This role sits at the convergence of
- Large Language Models (LLMs)
- Agentic AI & autonomous systems
- Retrieval-Augmented Generation (RAG)
- Hardware-aware AI system design (FPGA / ASIC / EDA)
You will define system architecture, lead technical strategy, and deliver scalable AI solutions that tightly integrate software intelligence with hardware acceleration, with a strong focus on AI model optimization and deployment on FPGA.
Key Responsibilities
AI Architecture & System Design
- Architect and implement end-to-end agentic AI systems (data → reasoning → action)
- Design scalable multi-agent orchestration frameworks
- Build enterprise-grade RAG pipelines for knowledge integration and retrieval
- Define system-level architecture bridging cloud, edge, and hardware acceleration
Agentic AI & LLM Development
- Develop advanced agent workflows, including:
- Tool-using agents
- Planning and reasoning agents
- Multi-agent collaboration systems
- Evaluate and integrate state-of-the-art LLMs (open-source and proprietary)
- Optimize prompting, memory, and reasoning strategies for performance and reliability
AI Model Optimization on FPGA (Core Focus)
- Lead AI model optimization and deployment on FPGA platforms, including:
- Quantization (INT8 / BF16 / mixed precision)
- Graph compilation and operator fusion
- Model partitioning across CPU/GPU/FPGA
- Memory and bandwidth optimization
- Develop workflows to map AI models (e.g., CV, LLM inference) from PyTorch/Hugging Face to FPGA
- Enable low-latency, high-efficiency inference pipelines on FPGA-based systems
- Collaborate with hardware teams to align model architecture with FPGA constraints (DSP, BRAM, interconnect)
Hardware-Aware AI Co-Design
- Co-design AI systems with:
- FPGA acceleration
- ASIC platforms
- Heterogeneous compute architectures (CPU/GPU/FPGA)
- Integrate AI workflows into EDA toolchains and hardware design flows
- Drive innovations in software-hardware co-optimization
Framework & Platform Development
- Build internal AI platforms leveraging:
- LangChain
- LlamaIndex
- Custom agent orchestration frameworks
- Develop reusable components for:
- Memory management
- Tool integration
- Knowledge retrieval and indexing
- Enable scalable deployment pipelines for AI applications on FPGA
Technical Leadership
- Lead architecture design reviews and set technical direction
- Mentor senior engineers and guide cross-functional teams
- Drive innovation at the intersection of AI systems and semiconductor platforms
What Makes This Role Unique
- Define agentic AI architecture for hardware-native AI systems
- Work at the frontier of:
- AI reasoning systems
- FPGA-based acceleration
- Next-generation computing platforms
- High-impact role shaping AI + semiconductor convergence
Impact
You will enable a new class of intelligent systems where
AI agents are tightly coupled with hardware, delivering
- Real-time decision-making pipelines
- Efficient, scalable AI deployment on FPGA
- End-to-end automation from model to hardware execution
Summary
This role is ideal for a senior technical leader who can:
- Bridge LLM + Agentic AI + RAG with FPGA/ASIC system architecture
- Drive AI model optimization and deployment on FPGA
- Lead innovation in next-generation AI + hardware integrated systems
Qualifications
Required
- Strong experience in LLMs, agentic AI, or RAG systems
- Proven track record in large-scale AI system architecture and deployment
- Solid programming skills in Python/C++ and modern AI frameworks
- Experience designing distributed or production AI systems
- Strong system-level thinking across software and infrastructure
Preferred / Plus
- Experience with FPGA, ASIC, or hardware acceleration platforms
- Familiarity with FPGA development flows and toolchains (e.g., synthesis, compilation, HLS, runtime)
- Experience with AI model optimization for hardware (quantization, compilation, deployment)
- Exposure to EDA tools and semiconductor design workflows
- Background in heterogeneous computing systems (CPU/GPU/FPGA)
Job Type
Regular
Shift
Shift 1 (China)
Primary Location
Shanghai, China
Additional Locations
Posting Statement
All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.
Skills
- LLM
- Retrieval-Augmented Generation
- PyTorch
- Hugging Face
- LangChain
- LlamaIndex
- Python
- C++
More jobs at Altera
All 50- Head of AI & Product SecurityAltera · San Jose, California, United Statesyesterday
- Software Security / DevSecOps ArchitectAltera · San Jose, California, United States4d ago
- Physical AI Solutions ArchitectAltera · Marlow, Buckinghamshire, United Kingdom5d ago
- FPGA Development Tools EngineerAltera · Toronto, Ontario, Canada · CAD 110,000–120,000/yr7d ago
- Software Engineer - InternAltera · Toronto, Ontario, Canada · CAD 95,000–100,000/yr7d ago
Similar roles
- Senior Information Technology Officer (AI Infrastructure)HKBU e-Recruitment System · Hong Kong · Chinatoday
- Senior Backend JavaScript DeveloperBright Data · Beijing, Chinatoday
- Senior Staff Software EngineerWorkstream · Shanghai · Chengdu3d ago
- Staff Software EngineerWorkstream · Shanghai · Chengdu3d ago
- Software Engineering Intern, Neural Reconstruction and Rendering - 2027NVIDIA · China, Shanghai3d ago
- Software Engineering Intern, NCCL - 2027NVIDIA · China, Shanghai · China, Beijing3d ago