Hugging Face models in Amazon Bedrock

Source: HuggingFace Date: 2024-12-09 URL: https://huggingface.co/blog/bedrock-marketplace

Summary

Integration tutorial: 83 open HF models now available in Amazon Bedrock Marketplace, managed by SageMaker JumpStart. Full Bedrock API compatibility including Agents, Knowledge Bases, Guardrails, and Model Evaluations. Available in 14 AWS regions. Tutorial deploys Gemma 2 27B Instruct via boto3 Converse API.

Implications

Thread: HF as open-source ML hub. HF models in Bedrock completes the major cloud hyperscaler integration trifecta (GCP, Azure, AWS). The Bedrock Agents + Knowledge Bases compatibility is the key enterprise feature — it means HF open-weight models can slot into existing AWS agentic workflows without changing the orchestration layer. 83 models is a meaningful catalog at launch. The managed SageMaker JumpStart backend hides the deployment complexity that previously required custom containers; the tradeoff is less flexibility on serving parameters. This expands the accessible deployment surface for HF models significantly into the enterprise AWS user base.