Senior Software Engineer - Akamai Inference Cloud @ Akamai Technologies

Popis pozice

O pozici / o projektu

Původní popisek. Are you excited about building the systems that process and optimize AI inference requests at scale?

Do you want to work hands-on with cutting-edge AI serving technologies and large language models?

Join the Akamai Inference Cloud Team!

The Akamai Inference Cloud team develops AI platforms for inference models and applications within Akamai's Cloud Technology Group. The Inference Execution & Runtimes team manages the inference engine, AI runtime frameworks, model serving infrastructure, and execution environment. Their work impacts latency, throughput, and efficiency of AI workloads across Akamai's extensive global infrastructure. #AIC

Partner with the best

As a Senior Software Engineer on the Inference Execution & Runtimes team, contribute to prompt processing, tokenization, and request handling pipelines. Collaborate with experienced engineers to transform user requests into optimized model inputs. This role offers significant exposure to AI inference systems and opportunities to gain expertise in a rapidly evolving infrastructure engineering field.

Odpovědnosti

Původní popisek. • Developing and maintaining prompt processing and tokenization pipelines that prepare inference requests for efficient model execution.

• ▪Implementing request routing, scheduling, and batching logic that optimizes throughput and latency across concurrent inference workloads.
• ▪Contributing to the integration of new model architectures and serving backends into the runtime framework.
• ▪Writing well-tested, well-documented code and participating in code reviews to maintain high engineering standards across the inference stack.
• ▪Supporting operational readiness through monitoring, debugging, and performance analysis of runtime components.

Detail pracovní nabídky

• ▪Online nábor
• ▪Jazyk náboru: Polština
• ▪Ihned
• ▪Práce plně na dálku
• ▪Flexibilní pracovní doba

Výhody v kanceláři

• ▪Bezplatná káva
• ▪Posilovna
• ▪Parkování kol
• ▪Bezplatné nápoje
• ▪Vnitřní školení
• ▪Moderní kancelář
• ▪Bez požadavku na dress code

Výhody

• ▪Sportovní balíček
• ▪Rozpočet na školení
• ▪Soukromá zdravotní péče
• ▪Mezinárodní projekty

O firmě