CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/maven-dev-langchain4j--langchain4j-bedrock

AWS Bedrock integration for LangChain4j enabling Java applications to interact with various LLM providers through a unified interface

Overview
Eval results
Files

chat-models.mddocs/api/

API: Chat Models

Synchronous and streaming chat model implementations for AWS Bedrock.

BedrockChatModel

Synchronous chat model using AWS Bedrock Converse API.

public class BedrockChatModel extends AbstractBedrockChatModel implements ChatModel {
    // Constructors
    public BedrockChatModel(String modelId);
    public BedrockChatModel(Builder builder);

    // Core methods
    public ChatResponse doChat(ChatRequest request);
    public BedrockChatRequestParameters defaultRequestParameters();
    public List<ChatModelListener> listeners();
    public ModelProvider provider();

    // Builder
    public static Builder builder();
}

BedrockChatModel.Builder

public static class Builder extends AbstractBuilder<Builder> {
    // Bedrock-specific
    public Builder client(BedrockRuntimeClient client);
    public Builder maxRetries(Integer maxRetries);

    // Inherited from AbstractBuilder
    public Builder region(Region region);
    public Builder modelId(String modelId);
    public Builder defaultRequestParameters(ChatRequestParameters params);
    public Builder returnThinking(Boolean returnThinking);
    public Builder sendThinking(Boolean sendThinking);
    public Builder timeout(Duration timeout);
    public Builder logRequests(Boolean logRequests);
    public Builder logResponses(Boolean logResponses);
    public Builder logger(Logger logger);
    public Builder listeners(List<ChatModelListener> listeners);

    public BedrockChatModel build();
}

BedrockStreamingChatModel

Streaming chat model using AWS Bedrock Converse API.

public class BedrockStreamingChatModel extends AbstractBedrockChatModel implements StreamingChatModel {
    // Constructors
    public BedrockStreamingChatModel(String modelId);
    public BedrockStreamingChatModel(Builder builder);

    // Core methods
    public void doChat(ChatRequest chatRequest, StreamingChatResponseHandler handler);
    public BedrockChatRequestParameters defaultRequestParameters();
    public List<ChatModelListener> listeners();
    public ModelProvider provider();

    // Builder
    public static Builder builder();
}

BedrockStreamingChatModel.Builder

public static class Builder extends AbstractBuilder<Builder> {
    // Streaming-specific
    public Builder client(BedrockRuntimeAsyncClient client);

    // Inherited from AbstractBuilder (same as BedrockChatModel.Builder)
    public Builder region(Region region);
    public Builder modelId(String modelId);
    public Builder defaultRequestParameters(ChatRequestParameters params);
    public Builder returnThinking(Boolean returnThinking);
    public Builder sendThinking(Boolean sendThinking);
    public Builder timeout(Duration timeout);
    public Builder logRequests(Boolean logRequests);
    public Builder logResponses(Boolean logResponses);
    public Builder logger(Logger logger);
    public Builder listeners(List<ChatModelListener> listeners);

    public BedrockStreamingChatModel build();
}

Key Parameters

ParameterTypeDescription
regionRegionAWS region (default: US_EAST_1)
modelIdStringBedrock model identifier
defaultRequestParametersChatRequestParametersDefault parameters for all requests
returnThinkingBooleanReturn thinking content in responses
sendThinkingBooleanSend thinking in conversation history
timeoutDurationAPI call timeout (default: 1 minute)
maxRetriesIntegerMax retry attempts (default: 2)
logRequestsBooleanLog request bodies (WARNING: may log sensitive data)
logResponsesBooleanLog response bodies
listenersListChat model listeners for observability

Model IDs

Common model identifiers:

Claude Models:

  • anthropic.claude-3-5-sonnet-20241022-v2:0 - Claude 3.5 Sonnet v2 (with thinking mode)
  • anthropic.claude-3-5-sonnet-20240620-v1:0 - Claude 3.5 Sonnet v1
  • anthropic.claude-3-opus-20240229-v1:0 - Claude 3 Opus
  • anthropic.claude-3-sonnet-20240229-v1:0 - Claude 3 Sonnet
  • anthropic.claude-3-haiku-20240307-v1:0 - Claude 3 Haiku

Amazon Nova Models:

  • amazon.nova-pro-v1:0 - Nova Pro
  • amazon.nova-lite-v1:0 - Nova Lite
  • amazon.nova-micro-v1:0 - Nova Micro

Related:

  • Parameters API for request configuration
  • Thinking Mode Guide for extended reasoning
  • Multi-modal Guide for images/documents
  • Tool Calling Guide for function calling

Install with Tessl CLI

npx tessl i tessl/maven-dev-langchain4j--langchain4j-bedrock

docs

api

chat-models.md

embedding-models.md

parameters.md

index.md

README.md

tile.json