Skip to content

Releases: act-lilly/aws-bedrock-chatbot-with-anthropic-claude-models-llm-inference

Add new models, improve state management

09 Aug 01:51
@act-lilly act-lilly
v1.1.0
e5d9c37
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
Add new models, improve state management Latest
Latest

Release Notes: Neo v1.1.0

New Features

  • Custom Logging Level: Introduced a new ALWAYS_LOG level for more flexible logging control.
  • Enhanced Model Selection: Added more Claude model options, including Claude 3 Sonnet, Claude 2.1, and Claude 2.0.
  • Persistent Settings: Implemented session state to remember user preferences for model selection, temperature, and top_k values.
  • Improved System Prompt Handling: Added support for custom system prompts with better state management.
  • Print-Friendly UI: Added CSS to hide the sidebar when printing the page.

Improvements

Logging Enhancements

  • Upgraded to a CustomLogger class for more detailed logging.
  • Improved logging messages for better tracking of user actions and system changes.

UI Refinements

  • Reorganized sidebar layout for better user experience.
  • Implemented callbacks for real-time updates of settings.

Code Structure

  • Refactored code for better organization and maintainability.
  • Introduced separate callback functions for each setting change.

Error Handling

  • Improved error messages and logging for better debugging and user feedback.

Bug Fixes

  • Fixed issues with system prompt persistence and updates.
  • Resolved potential conflicts in message formatting for the Claude API.

Other Changes

  • Updated default model to Claude 3.5 Sonnet.
  • Removed unused imports and cleaned up code comments.

This release focuses on improving user experience, adding flexibility in model selection and system prompts, and enhancing the overall robustness of the application. The new logging system and persistent settings will make it easier for both users and developers to track and manage the application's behavior.

Assets 2
Loading

Neo - a streamlit app using claude models on bedrock

08 Aug 02:08
@act-lilly act-lilly
v1.0.0
765c80e
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
Neo - a streamlit app using claude models on bedrock

Initial Release of Neo: Claude Chatbot on AWS Bedrock

We're excited to announce the initial release of Neo, a Streamlit-based chatbot application that leverages Claude models on AWS Bedrock. This release provides a user-friendly interface for interacting with various Claude models, offering both streaming and non-streaming response options.

Features

  • Support for multiple Claude models:
    • Claude 3.5 Sonnet
    • Claude 3 Haiku
    • Claude Instant
  • Customizable system prompts with pre-defined options and custom input
  • Adjustable model parameters (temperature and top_k)
  • Streaming and non-streaming response modes
  • Chat history management with clear chat functionality
  • Sidebar for easy access to settings and configurations
  • Comprehensive logging for debugging and monitoring

Key Components

  • Streamlit-based user interface
  • Integration with AWS Bedrock for Claude model access
  • Dynamic chat history display
  • Error handling and informative user feedback

Getting Started

To run the application, ensure you have the required dependencies installed and proper AWS credentials configured. Then, simply run the Streamlit app using:

streamlit run main.py

Or use the provided Dockerfile or start.sh script.

Notes

This is an initial release and may contain bugs or limitations. Please report any issues you encounter.

Thank you for your interest in Neo. We hope this tool proves useful for your AI-assisted conversations and tasks!

Assets 2
Loading