CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/maven-dev-langchain4j--langchain4j-bedrock

AWS Bedrock integration for LangChain4j enabling Java applications to interact with various LLM providers through a unified interface

Overview
Eval results
Files

parameters.mddocs/api/

API: Request Parameters & Response Metadata

Request parameters for controlling model behavior and response metadata for accessing results.

BedrockChatRequestParameters

Bedrock-specific request parameters.

public class BedrockChatRequestParameters extends DefaultChatRequestParameters {
    public static final BedrockChatRequestParameters EMPTY;

    // Bedrock-specific accessors
    public Map<String, Object> additionalModelRequestFields();
    public BedrockCachePointPlacement cachePointPlacement();
    public BedrockGuardrailConfiguration bedrockGuardrailConfiguration();

    // Composition
    public BedrockChatRequestParameters overrideWith(ChatRequestParameters that);
    public BedrockChatRequestParameters defaultedBy(ChatRequestParameters that);

    // Builder
    public static Builder builder();
}

BedrockChatRequestParameters.Builder

public static class Builder extends DefaultChatRequestParameters.Builder<Builder> {
    // Standard parameters (inherited)
    public Builder temperature(Double temperature);
    public Builder topP(Double topP);
    public Builder topK(Integer topK);
    public Builder maxOutputTokens(Integer maxOutputTokens);
    public Builder stopSequences(List<String> stopSequences);
    public Builder frequencyPenalty(Double frequencyPenalty);
    public Builder presencePenalty(Double presencePenalty);

    // Bedrock-specific
    public Builder overrideWith(ChatRequestParameters parameters);
    public Builder additionalModelRequestFields(Map<String, Object> fields);
    public Builder additionalModelRequestField(String key, Object value);
    public Builder enableReasoning(Integer tokenBudget);
    public Builder promptCaching(BedrockCachePointPlacement placement);
    public Builder guardrailConfiguration(BedrockGuardrailConfiguration config);

    public BedrockChatRequestParameters build();
}

BedrockChatResponseMetadata

Response metadata including guardrail assessments.

public class BedrockChatResponseMetadata extends ChatResponseMetadata {
    // Bedrock-specific
    public GuardrailAssessmentSummary guardrailAssessmentSummary();

    // Inherited
    public String id();
    public FinishReason finishReason();
    public TokenUsage tokenUsage();
    public String modelName();

    // Builder
    public Builder toBuilder();
    public static Builder builder();
}

BedrockChatResponseMetadata.Builder

public static class Builder extends ChatResponseMetadata.Builder<Builder> {
    // Inherited
    public Builder id(String id);
    public Builder finishReason(FinishReason finishReason);
    public Builder tokenUsage(TokenUsage tokenUsage);
    public Builder modelName(String modelName);

    // Bedrock-specific
    public Builder guardrailAssessmentSummary(GuardrailAssessmentSummary summary);

    public BedrockChatResponseMetadata build();
}

BedrockTokenUsage

Token usage with cache metrics.

public class BedrockTokenUsage extends TokenUsage {
    public BedrockTokenUsage(Builder builder);

    // Inherited
    public Integer inputTokenCount();
    public Integer outputTokenCount();
    public Integer totalTokenCount();

    // Bedrock-specific cache metrics
    public Integer cacheWriteInputTokens();
    public Integer cacheReadInputTokens();

    // Operations
    public BedrockTokenUsage add(TokenUsage that);

    // Builder
    public static Builder builder();
}

BedrockTokenUsage.Builder

public static class Builder {
    public Builder inputTokenCount(Integer inputTokenCount);
    public Builder outputTokenCount(Integer outputTokenCount);
    public Builder cacheWriteInputTokens(Integer cacheWriteInputTokens);
    public Builder cacheReadInputTokens(Integer cacheReadInputTokens);

    public BedrockTokenUsage build();
}

Parameter Reference

Standard Parameters

ParameterTypeRangeDescription
temperatureDouble0.0-1.0Controls randomness (higher = more creative)
topPDouble0.0-1.0Nucleus sampling threshold
topKInteger> 0Limits sampling to top K tokens
maxOutputTokensIntegerModel-dependentMaximum response length
stopSequencesList<String>-Sequences that stop generation
frequencyPenaltyDouble-2.0-2.0Reduces repetition by frequency
presencePenaltyDouble-2.0-2.0Reduces repetition by presence

Bedrock-Specific Parameters

ParameterTypeDescription
promptCachingBedrockCachePointPlacementCache point placement strategy
guardrailConfigurationBedrockGuardrailConfigurationGuardrail for content filtering
additionalModelRequestFieldsMap<String, Object>Model-specific custom fields
enableReasoningIntegerToken budget for extended reasoning

Response Metadata

FieldTypeDescription
idStringUnique response identifier
finishReasonFinishReasonWhy generation stopped
tokenUsageBedrockTokenUsageToken counts and cache metrics
modelNameStringModel identifier used
guardrailAssessmentSummaryGuardrailAssessmentSummaryGuardrail violation details

Token Usage

FieldTypeDescription
inputTokenCountIntegerRegular input tokens
outputTokenCountIntegerGenerated tokens
totalTokenCountIntegerSum of input and output
cacheReadInputTokensIntegerTokens read from cache (90% cost savings)
cacheWriteInputTokensIntegerTokens written to cache

Related:

  • Chat Models Quick Start
  • Prompt Caching
  • Guardrails

Install with Tessl CLI

npx tessl i tessl/maven-dev-langchain4j--langchain4j-bedrock@1.11.0

docs

api

chat-models.md

embedding-models.md

parameters.md

index.md

README.md

tile.json