November 2024

Major Platform Releases

Released webchat v1.0 with core functionality (UI creation tools to be added in future updates)
Added comprehensive feature control for better platform management
Added Canvas for visual content creation and collaboration
Added Smart Content for reusable AI-generated content blocks
Added comprehensive prompt management system for reusable AI instructions

Added ability to select different splitter types for datasets within datasources:
- Sentence Splitter: Divides content by sentences for natural language processing
- Tokenizer: Splits content into tokens for more granular analysis
- Recursive Character With Special Separators: Handles complex document structures
- Paragraph Splitter: Divides content by paragraphs for topic-based analysis
- Regex Splitter: Uses regular expressions for custom content division
Improved web page/website crawling to download and process document links as files
Added AWS S3 as a datasource option for enterprise-scale knowledge management
Added scheduled sync feature for datasources to keep information current
Added datasource sync logs for better tracking and troubleshooting
Implemented smarter (semantic) chunking for various file types including HTML, CPP, Go, Java, JS, PHP, Python, Ruby, Rust, Markdown, and more
Changed web crawling to capture content as markdown instead of plain text, allowing models to understand and use links
Changed default vector search score threshold from 0.5 to 0 for more comprehensive results
Added Search Limit feature for hybrid database searches to optimize performance
Added support for DOCX, PPTX, and text files in File datasources for broader document compatibility

Simplified application interface colors for better visual clarity
Improved Peer visualization in the chat screen for more intuitive interactions
Set up Prompt and SmartContent icons for better visual identification
Improved Back button functionality in chat screen for smoother navigation
Enabled direct conversation with Peers using Peer ID from any screen for quicker access
Added Workspace Home for centralized access to resources
Added Chat History for better conversation tracking
Enabled Smart Content integration into conversations for richer interactions
Added chat bookmarking for saving important conversations
Fixed issues with uploading multiple files simultaneously for better document handling
Removed dark theme due to contrast issues (to be reimplemented with better accessibility)
Improved message display through comprehensive refactoring
Added Code editor for displaying code-related messages with syntax highlighting

Added visibility section for controlling permissions for peers, datasources, prompts, and smart-content