Release Notes

Release v0.54

Release v0.55

Work-in-progress.

Release v0.54

New features, security, usability and UI enhancements.

Features

  • [API] add parsing and translation of HTML content to plain text content
  • [Client-Web, API] add toggle and state management(ProblemSolvingAgent)
  • [Agent] add initial implementation of Problem Solving Agent

Security

  • [Proxy] migrate JWKS to latest

Miscellaneous

  • [Tritonserver] add initial implementation of ProblemSolvingAgent

Release v0.53

New features, security, usability and UI enhancements.

Features

  • [Agent] integrate task manager with ‘dev-graph-agentic’

Security

  • [API] add nonroot user to dev.Dockerfile of “api-server-sg”
  • [API, Engine, Tritonserver] migrate image builds to custom builder
  • [MCP] migrate ‘streaming-python’ to DHI image

Bug Fixes and Other Changes

  • [API] set correct uid:gid for secrets store on local dev
  • [Client-Web] restore service worker function
  • [Agent] parsing of MCP input and output params for ’tool_websearch’

Miscellaneous

  • [Tritonserver] amend build and inference parameters
  • [Agent] amend inference parameters
  • [Tritonserver] add new build for dev-graph-agentic-tritonserver
  • [Agent, Tritonserver] integrate task manager with ‘*-tritonserver’
  • [Tritonserver] move websearch task to mcp server ‘ace-python’
  • [Agent] move task manager to MCP server ‘ace-python’
  • [Client-Web] migrate version to latest

Release v0.52

New features, security, usability and UI enhancements.

Features

  • [Agent] add MCP tool for accessing OpenAlex API
  • [Agent] support ‘get_single_entity’ service from OpenAlex API
  • [Agent] add support for DataCommons(DC) and OpenAlex(OA)
  • [MCP] add support for ‘get_content’ function and ‘content’ API
  • [MCP] add filters for OpenAlex API “get_list_of_entities” service
  • [MCP, Agent] support OpenAlex API endpoints
  • [Agent] add custom callbacks to task broker for tracking task status

Security

  • [Proxy] migrate JWKS to latest
  • [API] migrate to DHI python base image
  • [Proxy] migrate “envoy-sg” JWKS to latest

Bug Fixes and Other Changes

  • [Agent] parsing of MCP response from “read_openalex” tool
  • [Agent] openalex tool output
  • [MCP] errors in parsing input parameters for ‘read_openalex’ tool

Refactor

  • [Engine] remove redundant docker compose configuration
  • [Engine] build script for tritonserver with custom python backend

Miscellaneous

  • [Engine] update parameters for VLLM=v0.15.0
  • [MCP, Agent] remove ‘select’ and ‘sort’ fields from ‘read_openalex’
  • [Tritonserver] add OpenAlex API utilities to parent graph
  • [Client-Web] add prompt hints for OpenAlex API
  • [Agent] amend raft parameters for local dev rabbitmq server
  • [Agent] increase rabbitmq server default disk resource

Release v0.51

New features, security, usability and UI enhancements.

Features

  • Amend system prompt for symbolic expression translator
  • Add initial system prompt for generating SymPy expressions
  • [Agent] add web utilities for reading HTML pages from Common Crawl index
  • [Agent] add conditions for generation of SymPy expressions
  • [Agent] add utility for convert HTML content to markdown
  • [Agent] add HTML text content sanitization as post processing step
  • [Agent] add utitlies for parsing target urls on math subjects

Performance

  • [Agent] add options to HTTP cache backend(sqlite)
  • [Agent] add HTTP caching to “web_utils.py”
  • [Agent] add HTTP session for web requests

Security

  • [Agent] evaluate local forward proxy for web scraping

Bug Fixes and Other Changes

  • Missing field for kvcache connector
  • [Agent] undesired output for MCP tool call ‘run_xml’
  • [Agent] wrong system prompt for MCP tool calls
  • [Agent] failure to load HTML content into YAML prompt template
  • [Engine] incompatibility between “llm-streaming-sg” dependencies
  • [Engine] gibberish output when fp8 kvcache with scaling enabled

Refactor

  • Rename API server script, configurations and parameter names
  • [API] “middleware-sg” related files for GCP deployment
  • “model.py” for “dev-graph-agentic-tritonserver”
  • [Agent, Engine] pathnames in docker compose configuration
  • [Agent] remove redundant MCP stdio access from “*-tritonserver”
  • “*-tritonserver” inference scripts
  • “dev_graph_agentic.py” and “*-tritonserver.py” inference scripts

Miscellaneous

  • [Client-Web] amend contents of home page
  • [Agent] add streaming output of public node execution
  • Add public data prompt hints to web client
  • Tune safety policy for economic data
  • Add more experty identity prompts for query classification step
  • Add support for more datacommon variable entities for target country(SG)
  • [Agent] migrate from Qwen3 to Mistral3 series for “*-tritonserver”
  • [Agent] migrate dev model from Qwen3 to Mistral3 series
  • Exclude technical documentation from version control
  • Add XML C libraries to “*-tritonserver” container build
  • Add fallback when access to “index.commoncrawl.org” is denied
  • [Agent] rename dev modules
  • [MCP] add validation and assertions for SymPy expressions
  • [MCP] add logging utility to “ace-python”
  • [Agent] add environment variable “NO_PROXY” for HTTP requests
  • [Agent] reinstate system prompt prefixes for “gen_symbolic_expressions”
  • [Agent] add text wrapper for post processing of HTML content
  • [Agent] evaluate VLLM nightly builds
  • [API] rename directory
  • [Agent, Engine] restructure files and directories
  • [Engine] amend runtime id for docker compose configuration
  • [Engine] add missing prompt template to Dockerfile
  • [Agent] add additional fields to tool response payload
  • [Payments] migrate stripe version to latest
  • [Agent] increase timeout for reading CC index
  • [Agent] add trigger words to “ace-python” MCP server
  • Move automation scripts into ‘scripts’ directory

Release v0.50

New features, security, usability and UI enhancements.

Features

  • Add public data field to request body
  • Add public data option to web client ui and state
  • Add semantic search to streaming-mcp
  • Add initial implementation of StreamAgent
  • Add mcp client and parse “streaming-mcp” response in parent graph
  • Add markdown version of wiki html doc to context of “dev-graph-agentic”
  • Add html conversion and postprocessing to “streaming-python” mcp
  • Add utility functions for datacommons APIs
  • Add initial implementation of mcp for public data
  • Add initial implementation of “call_public_data_node” for parent graph
  • Add more economic related dcids and examples for country(SG)
  • [Agent] add “is_public_data” field to augmentation body
  • Add “public_data_node” to “dev-graph-agentic-tritonserver”

Security

  • Refactor *Dockerfile for “streaming-python” mcp
  • Migrate “ace-python” mcp to DHI base image
  • Migrate “public-python” mcp to DHI base image
  • Migrate “public-python” mcp to DHI base image
  • Migrate to docker volume for secrets store
  • Run as non-priviledged user for “middleware-sg”

Bug Fixes and Other Changes

  • Amend boolean field for metaprompt in middleware
  • Unassigned variable in “dev-graph-agentic-tritonserver”
  • [Agent] empty value on semantic cache in parent graph

Refactor

  • Fields in augmentation dict
  • Web client deprecations and warnings by dart analyzer
  • Dockerfile for “middleware-sg”
  • Tool field for web client state management
  • Dev http client parameters for “middleware-sg” container
  • “text_generation.dart” for web client

Miscellaneous

  • Add “live_data” toggle to web client ui and state
  • Add minimal “flutter_bootstrap.js” for web client
  • Amend “tritonserver-vllm_backend” build
  • Remote filter condition and add score threshold for qdrant client
  • Add “page_id” field/value to stream entity from wikimedia api response
  • Amend “streaming-python” container for text embedding workload
  • Amend .dockerignore for “public-python” mcp server
  • Parse datacommon client response into fields
  • Amend runtime for “firebase-emulators”

Release v0.49

New features, security, usability and UI enhancements.

Features

  • Add “pywikibot” to stream for recent changes on wikimedia projects
  • Add access to wikidata and wikimedia APIs
  • Add support for multiple search types with wikimedia API
  • Add support for multiple content types from wikimedia Feed API
  • Add daily “mostread” filter to recentchange wikimedia stream
  • Add techniques for gender neutrality in LLM responses
  • Add utility function for fetching html source from wikimedia
  • Add client retries for wikimedia APIs
  • Add text embedding to streaming data in ETL pipeline

Performance

  • Add support for HTTP/2 and additional compression algos for requests
  • Migrate redis protocol(RESP) from version 2 to 3

Security

  • Add valkey secret key to “streaming-python” mcp server

Bug Fixes and Other Changes

  • Valkey acl list and server configuration
  • Wikimedia featured list content ordering
  • Wrong kv cache size in “*-tritonserver” deployments
  • Segfault error in qdrant server

Refactor

  • Script for etl pipeline
  • “*-tritonserver” build script
  • Script for generating hybrid embeddings

Miscellaneous

  • Add support for “suffix” spec decode on older version of vllm
  • Remove “news” filter from etl pipeline
  • Add network configuration for httpx client
  • Add zstd decompression step to prefill-only task
  • Evaluate and add utility function for wikidata vector search
  • Amend python environment yaml to include essential packages
  • Add retry logic to valkey client in ETL pipeline
  • Add separate builds of “*-tritonserver” container
  • Docker compose configuration changes
  • Add support for 120k context window on local VLLM engine
  • Add HTTP transport configuration to “dev-graph-agentic-tritonserver”
  • Add unstructured implementation for doc partitioning and chunking
  • Refactor partition and chunking step in document processing pipeline
  • Migrate page content type from “source” to “html”
  • Amend configuration for auxiliary models
  • Add manual scaling to GCP Cloud Run deployments

Release v0.48

New features, security, usability and UI enhancements.

Features

  • Utilize runtime context for repeated sampling
  • Subscribe to every change event in stream processing etl pipeline
  • Add initial implementation of MCP for streaming etl pipeline
  • Add initial support for json module in valkey instance
  • Add initial lmcache yaml configuration and external controller
  • Add initial NIXL-based 1P1D instances for disagg prefill on same host
  • Add initial implementation of prefill-only module
  • Add prefill-only workload to “dev-graph-agentic” event loop

Performance

  • Amend VLLM compilation config
  • Enable torch compilation level=2 for LLM inference
  • Replace asyncio.run() with uvloop.run()
  • Enable FP8 kv cache to improve throughput
  • Enable sparse attention and layerwise cache store/load for lmcache
  • Enable “VLLM_HAS_FLASHINFER_CUBIN” flag for faster initialization

Security

  • Add “kvcache_salt” to provide cache isolation in a shared env

Bug Fixes and Other Changes

  • Initialization of engine utils during tritonserver startup

Refactor

  • Cloud function “user_delete” for web client authentication
  • Refactor “load_llm_engine” script
  • Type of “runtime.context.sampling_params”
  • Replace “llm_async_engine” with “vllm_engine_endpoint”
  • Decouple VLLM inference engine from langgraph workflow
  • “engine_utils.py” script
  • “llm-streaming-sg” image build

Miscellaneous

  • Retrieve “cache_salt” from identity token in web client
  • Add “cache_salt” metadata during new user creation
  • Add more performance parameters for valkey server
  • Disable valkey persistence for cache only use case
  • Add initial tracing and exception handling to streaming mcp
  • Use only one valkey database and follow keyspace naming convention
  • Handle list data for each data source in streaming etl pipeline
  • Add custom text connector for streaming text from third party APIs
  • Add text normalization to streaming mcp
  • Evaluate “cachegen” for store/load precomputed kv values
  • Run prefill task on separate thread
  • Add manual file handler for logging in “load_llm_engine”
  • Add process manager for LLM engine utilities
  • Start streaming etl pipeline as a daemon process
  • Manually assign prefill-only task on daemon process
  • Set params “generation_config” and “model_impl” for VLLM engine

Release v0.47

New features, security, usability and UI enhancements.

Features

  • Add initial implementation for rendering SVG image in web client
  • Add third-party inference providers for SVG image generation
  • Add interactive viewer for SVG image in web client
  • Add initial implementation of inference time scaling

Performance

  • Add “effort_level=low” for llm extended generation

Bug Fixes and Other Changes

  • Web client ui issues with stacked widgets
  • Web client ui issue with rendering XML string
  • Error in updating runtime context with newly generated XML string
  • Third party providers model outputs not writing to file
  • Response from “websearch” tool not rendering in web client
  • Progress bar not updating in web client
  • Web client slider bar for “effort_level”

Miscellaneous

  • Parse python mcp server output and render mcp response in web client
  • Parse xml string output in web client
  • Chunk xml output from “XMLAgent” node
  • Only enable “XMLAgent” data visualization for “mathematics” domain
  • Add diagram for streaming data in llm applications
  • Restore “llm” node streaming when “effort_level” is 0
  • Add initial implementation of effort slider to web client
  • Add “effort_level” parameter for streaming inference
  • Replace final generation node “llm” with “effort”
  • Amend prompts for repeated sampling in “effort” node
  • Increase diversity of responses for repeated sampling in “effort” node

Release v0.46

New features, security, usability and UI enhancements.

Features

  • Add initial system prompt for Python language translator
  • Add initial implementation of python mcp tool for xml
  • Add initial implementation of XMLAgent node for all XML features
  • Add system prompt for generating XML string from end user query

Security

  • Add data validation prior to code execution in “ace_python”

Bug Fixes and Other Changes

  • Fix structured output for “ace_python”

Refactor

  • Migrate from “config_schema” to “context_schema”
  • Amend calculus suite of statements for “exec()” operation
  • Migrate more keys from “RunnableConfig” to Context API
  • Migrate to Context API

Miscellaneous

  • Amend weekly message of web client
  • Add more test prompts for “ace-python”
  • Add dev and prod Dockerfiles for “ace-python” mcp server
  • Add prompts for ace-python mcp server testing
  • Add web client placeholder content for release v0.46.0
  • Add more math related builtin modules to user-defined global namespace
  • Amend “ace_python” tool to use “exec()” instead of “eval()”
  • Add math related modules to support algebraic operations
  • Add new build for tritonserver-vllm_backend for “dev-graph*” variants
  • Add initial handling for exceptions and edge cases for mcp clients
  • Add initial checks and constraints to “ace_python” mcp server.
  • Revert default runtime to working version of “runsc” for ai/ml workloads
  • Add validation step for generated python statement(s)
  • Migrate dev model from “Qwen3-4B-FP8” to “Qwen3-4B-Instruct-2507-FP8”
  • Add Python language translator to “dev-graph-agentic-tritonserver”
  • Remove “validate_code” code block
  • Replace default runtime for “ace_python” mcp server
  • Amend system prompt for XML generation
  • Add XML-based expression tree to context of parent graph
  • Reintroduce “XMLAgent” node back to parent graph
  • Amend system prompt for XML generation
  • Update python dependency for “ace_python” mcp server
  • Mount local model configuration to “dev-graph-agentic-tritonserver”
  • Add “XMLAgent” to generate xml from python expression
  • Add “XMLAgent” node to dev-graph-agentic-tritonserver
  • Add raw xml to llm response
  • Add warmup operation to “dev-graph” and “dev-graph-agentic”

Release v0.45

New features, security, usability and UI enhancements.

Features

  • Add initial support for rope scaling in “llm-streaming-sg”
  • Add initial integration of stdio mcp server to tritonserver-vllm_backend
  • Add initial implementation of local stdio MCP server access
  • Add initial implementation of python arbitrary code execution sandbox
  • Add support for maximal marginal relevance(MMR) to improve results

Performance

  • Add initial support for “flag_gems” custom ops in Triton

Bug Fixes and Other Changes

  • Langgraph traces not getting fed to local otelcollector instance
  • Error with parent graph module, prompt compressor error
  • Flag_gems incompatible with sentence_transformers reranker
  • Amend mcp json schema for guided decoding
  • Multimodal node not triggering when input image is provided
  • Error anyio.ClosedResourceError in “ace-python” mcp server

Refactor

  • Add comment and condition to “sanity_checks_langgraph.py”
  • Tracing implementation for “dev-graph-agentic”
  • Tracing implementation of “dev-graph”

Miscellaneous

  • Add initial implementation of MCP server and client for stdio transport
  • Add initial implementation of MCP server with streamable_http transport
  • Filter tool output and manage ui state in web client
  • Support qwen2.5 vision-language models for multimodal inputs
  • Add infographic on how to build an agent by langchain
  • Render mcp response to web client
  • Add UI toggle for mcp access in web client
  • Add “mcp” field to ‘mode_and_attributes_schema’
  • Add structured output to hybrid retrieval function call
  • Handle langgraph “GraphRecursionError”
  • Migrate Flutter SDK to latest beta version
  • Refactor docker build for firebase emulators suite
  • Integrate ace-python mcp server with agent graph
  • Amend port on ace-python sandbox
  • Remove redundant configuration
  • Amend ace-python mcp server configuration for container deployment
  • Change default container runtime from “runc” to “crun”

Release v0.44

New features, security, usability and UI enhancements.

Features

  • Add initial implementation for text generation with citations
  • Add text generation with citations for document mode
  • Add initial implementation of contextual retrieval to etl pipeline
  • Add deferred node execution to ’llm’ node of graph
  • Add cache policy and caching to intermediate nodes of graph
  • Add document search toggle in web client
  • Add initial integration with LMCache for tritonserver-vllm_backend

Performance

  • Pin “flashinfer-python” version to “v0.2.2.post1”

Security

  • Replace all existing “privileged: true” with “privileged: false”

Bug Fixes and Other Changes

  • Docker image not loading from archive and vllm-openai server not running
  • “route_mode” value overwritten in parent graph

Refactor

  • Amend ETL script for producing knowledge graph triplets
  • ETL pipeline for vectordb
  • Refactor “middleware-sg” dockerfiles
  • Utility function for call SambaNova API endpoint
  • Implement document search behind an end user provided toggle flag
  • Move JSON schemas to independent module file
  • “input_topic(s)” into “input_mode”

Miscellaneous

  • Add SG election info to system prompt
  • Amend citation instructions in system prompt
  • Amend system prompt with every instructions per line
  • Add additional post-processors, separators and filters for chunking
  • Amend parameters of traditional chunking strategy
  • Add support for quantized onnx model weights for dense text embedder
  • Migrate reranker to neobert
  • Add new parameters to query function for RAG hybrid retrieval
  • Add additional filter fields to vector rag query function
  • Add “FLEX_ATTENTION” to “VLLM_ATTENTION_BACKEND” comment
  • Add initial yaml config for dev vllm-openai server
  • Add additional constraints to contextual retrieval pipeline
  • Amend instructions in cloud-init script to load docker archive file
  • Amend scripts for attaching/mount hyperdisk during vm instance creation
  • Add initial script for persistent disk(s) provisioning

Release v0.43

New features, security, usability and UI enhancements.

Features

  • Add initial social proof segment to system message
  • Add initial implementation of SocialAgent as a subgraph
  • Add initial implementation of SocialAgent
  • Add implementation of SocialAgent to “llm-streaming-sg” docker build
  • Add initial implementation of addons for social proof node
  • Add new system prompt and logic for Lucene query translation retries

Bug Fixes and Other Changes

  • Spelling error
  • Social proof subgraph retries
  • Amend prompt template for input topics

Miscellaneous

  • Add initial design docs and template for SocialAgent
  • Update default text-only model for Cerebras API
  • Add metaprompt node system message as yaml configuration
  • Add sampling parameters from request to main model inference
  • Add ui element toggle in web client to support social proof option
  • Amend augmentation fields (2f455- Replace dev model with Qwen3-4B-AWQ
  • Replace sparse text embedder for RAG hybrid search
  • Restore “websearch” as one of topics
  • Amend prompt template for classifying input topics
  • Amend prompt templates for “safety”, “topics” and “complexity”
  • Add additional llm sampling parameters to “middleware-sg”
  • Amend logic for Lucene translation retries in “llm-streaming-sg”

Release v0.42

New features, security, usability and UI enhancements.

Features

  • Add initial support for metaprompting
  • Add initial support for metaprompt in web client
  • Add initial support for streaming of custom metaprompts
  • Add websearch response to “call_tool_use” node
  • Parse additional websearch responses and enable url links on web client

Performance

  • Replace reranker model with neobert
  • Web client migration from js to wasm build

Bug Fixes and Other Changes

  • Multi-turn metaprompt returning wrong node id
  • Dart errors
  • Tavily response failure
  • Authentication revoke session failure on backend
  • Type casts
  • Web client type cast error

Refactor

  • “human_intervention” and “meta_prompt” nodes in parent graph
  • Migrate from “hive” to “hive_ce_flutter”
  • Web worker interface on web client
  • Migrate from “package:web/web.dart” to “package:http/http.dart”

Miscellaneous

  • Initial merge “human_intervention” node into parent_graph
  • Amend parameters vllm openai compatible client and server
  • Remove deprecated models from “SNOVA_API”, replace with phi4-mm-instruct
  • Add additional text controller for metaprompt inputs on web client
  • Use cerebras api for metaprompt node
  • Summarise persona and add constraints to metaprompt system message
  • Amend system message for metaprompting, add additional examples
  • Remove redundant bottom scaffold on web client

Release v0.41

Security, usability and UI enhancements.

Bug Fixes and Other Changes

  • Text embedding models failed to load
  • Exception handling for “etl-knowledge-graph” script
  • Prevent repeated execution after conditional edges
  • Skip empty text chunks from vllm async engine output
  • Add parsing of “human_intervention” input to “model_prod.py”
  • “human_intervention” node not triggering in “model_prod.py”
  • Streaming text outputs for “model_prod.py”
  • Streaming events from “llm-streaming-sg”
  • Crashing of “llm-streaming-sg” when parsing interrupts
  • Restore web client streaming text from tritonserver-vllm_backend
  • Streaming of custom outputs from intermediate nodes

Refactor

  • Warning message from “violation” node
  • Migrate from ‘astream_events’ to “astream” api in “model_prod.py”

Miscellaneous

  • Add utility function “send_response”
  • Add events to custom mode of “llm” and “violation” nodes
  • Amend dockerfile syntax version to follow major version
  • Add initial utility function “send_response” for custom streaming mode
  • Skip llm request for tool use “websearch” and add manual toggle
  • Restore custom streaming of intermediate nodes from workflow
  • Add exception handling to “call_snova_api_post”
  • Switch python image to latest major version for “middleware-sg”

Release v0.40

New features, security, usability and UI enhancements.

Features

  • Add initial visual notification for workflow progression on web client
  • Add initial cypher statement validation with boolean response
  • Add Cypher validation and retry nodes to graphrag subgraph
  • Add initial evaluation step for Cypher response and user query
  • Add initial implementation of metaprompt node and subgraph
  • Add initial store to agentic system for persistent/long-term memory
  • Add initial support for “interrupt” step in workflow
  • Add initial support for manual human intervention during inference

Bug Fixes and Other Changes

  • Multiple triggers from parallel hybrid rag nodes in workflow
  • Failing request on “vision-text” path of parent graph
  • Amend tags and node names to enable streaming from subgraphs

Refactor

  • Remove web client deprecated package “flutter_gen”
  • Graph node in workflow
  • Implement graph rag workflow as independent subgraph
  • Split graph rag subgraph into individal nodes
  • Start initial migration from “astream_events” to “astream” api

Miscellaneous

  • Migrate tritonserver-vllm_backend from v24.12 to v25.01
  • Remove discontinued package from web client dependencies
  • Add initial schemas for generating knowledge graph triples
  • Add relation verb set list for kg triples generation
  • Move deidentification to privacy node and add conditional routing
  • Add initial render of metaprompt streaming output on web client
  • Add initial support for pause and resume functionalities
  • Migrate stripe api version from “2024-12-18.acacia” to “2025-02-24.acacia”

Release v0.39

New features, security, usability and UI enhancements.

Features

  • Parse and add hybrid rag context to dynamic prefix of prompt template

Bug Fixes and Other Changes

  • Migrate dockerfile syntax from v1.12.1 to v1.13.0

Refactor

  • Update ETL script for building knowledge graph(s)

Miscellaneous

  • Replace base llm “mistral-nemo” with “pixtral”
  • Add script for loading knowledge-graph(s)
  • Add initial layout and styling for displaying multimodal context

Release v0.38

New features, security, usability and UI enhancements.

Features

  • Add initial multimodality functionality

Refactor

  • Add “create_image_input” to support pixtral

Miscellaneous

  • Add nightly builds of vllm with tritonserver-vllm_backend
  • Add and evaluate additional chat templates for VLM inference
  • Add support for “image_input” llm request parameter to middleware
  • Increase HTTP request timeout for “middleware-sg” text-generation API
  • Add initial support for posting api client
  • Display bottom sheet for multimodal options in web client

Release v0.37

New features, security, usability and UI enhancements.

Features

  • Add initial support for VLM inference
  • Add presidio-analyzer and presidio-anonymizer as local HTTP service

Refactor

  • Add initial support for llm compressor to GPTQ quantization script
  • Deidentification utility function for “llm-streaming-sg”

Miscellaneous

  • Amend “llm_worker.js” package url
  • Add utiliy script for translating text passages to triples
  • Refactor quantization and docker scripts
  • Add vllm sanity check candidate model for Llama3.2 series
  • Refactor awq quantization and docker utility scripts
  • Silence “openinference-instrumentation-langchain” tracer warnings
  • Add quantization of “llama-3.2-1B-instruct” with w8a8 format
  • Remove all chainguard images
  • Replace phi3.5-mini-instruct with llama3_2-1B-instruct

Release v0.36

New features, security, usability and UI enhancements.

Features

  • Add Cerebras inference api http endpoint
  • Add initial implementation of knowledge graph reasoning
  • Add support for translating natural language query to Cypher statements
  • Add initial translation from natural language to Cypher
  • Add mapping of extracted entities from enduser query to knowledge graph

Performance

  • Add router for default/generic inputs in langgraph workflow
  • Add optional distillation step for sentence-transformers models

Security

  • Amend CSP directives
  • Migrate dev dependency “loki” to distroless variant
  • Migrate dev dependency “grafana” to distroless variant
  • Maintenance release for Redis Stack Server 7.4.0
  • Add initial cypher query validation

Miscellaneous

  • Add Apache AGE as graphdb for modeling relationships between entities
  • Amend cloud run services “min-instances” to “service-min-instances”
  • Adhere cypher queries to OpenCypher style guide
  • Add OpenCypher style guide reference
  • Amend prompt for cypher translation
  • Add list of common stop tokens

Release v0.35

New features, security, usability and UI enhancements.

Features

  • Add initial subgraph(s) implementation for multi-agent teams
  • Initial implementation of multi-agents reasoning
  • Add support for postgresql as langgraph checkpointer
  • Add initial system prompt for generating multiple expert identities
  • Initial implementation of multi-agents reasoning with expert prompting
  • Add multi-agents node to tritonserver-vllm_backend

Performance

  • Add uvloop for asyncio performance
  • Migrate “call_snova_api_post” from synchronous to asynchronous version
  • Add snova fastapi to “call_agent_endpoint”

Security

  • Amend “llm-streaming-sg” container runtime from “runc” to “runsc”

Bug Fixes and Other Changes

  • Container(s) unable to start due to mount error
  • Empty thought template in “call_reasoning_node”
  • Update logic for llm inference with snova fastapi endpoint

Miscellaneous

  • Migrate langgraph stream events from v1 to v2
  • Rename tritonserver vllm backend “model_main.py” to “model_prod.py”
  • Implement test and prod versions of ‘model.py’ for vllm backend
  • Migrate vllm backend “model_main.py” to v2.49.0 matching NGC v24.08
  • Add versioning to tritonserver configuration for vllm models
  • Migrate dockerfile frontend syntax from v1.9.0 to v1.10.0
  • Add “_write” filter for otel-collector langgraph config
  • Add multiagents node to “generic_graph”
  • Update sambanova api endpoint to avoid disruption
  • Move unique identifiers to “metadata” key in “RunnableConfig”
  • Restore vllm functionality of attaching unique seed per-request
  • Implement non-streaming version of “call_snova_api” function
  • Migrate “phi3-mini-instruct” to “phi3_5-mini-instruct”

Release v0.34

New features, security, usability and UI enhancements.

Features

  • Add “multihop” RAG strategy to “llm-streaming-sg”
  • Fetch pre-computed expert identity per enduser query in llm node
  • Write distilled template to object store after each task-solution cycle
  • Add instantiation of reasoning based on task and thought template
  • Add thought template distillation for task, solution and answer steps
  • Add initial reasoning node to graph
  • Write new thought templates to object store if conditions are met
  • Add reasoning after rag node for expert complexity
  • Add reasoning after rag node for intermediate complexity
  • Add reasoning after rag node for novice complexity
  • Add reasoning node after tool(s) node
  • Amend ddgs chat model from “gpt-4o-mini” to “llama-3.1-70b”
  • Add snova fastapi endpoint to reasoning node

Performance

  • Improve tritonserver_vllm_backend performance by using a separate thread for responses

Security

  • Remove user and password from grafana environment variables

Bug Fixes and Other Changes

  • Missing attributes for langchain tracer
  • Max model len for lm eval
  • Remove “static_prefix_1k_compressed” from prompt template
  • Migrate dev dependency to latest
  • Tritonserver HTTP endpoint ‘/generate_stream’ unable to return output tokens
  • Add “user: 1000” to “grafana” service level element

Miscellaneous

  • Add rag local evaluation for “mistral-nemo-instruct”
  • Add initial rag strategy responses for “mistral-nemo-instruct”
  • Add initial support for streaming inference with “mistral-nemo-instruct”
  • Add awq quantization of “mistral-nemo-instruct”
  • Add query classification for expert identity
  • Add expert identity node and router to workflow
  • Add sub disciplines of law field
  • Amend a non-exhaustive list of major academic disciplines
  • Add document on world models
  • Add system prompt for generating pseudo-expert identities
  • Reduce reranker top_k documents from 5 to 1 in ’llm-streaming-sg’
  • Add markdown notes for llm development
  • Differentiate ‘onnxruntime-gpu’ between v1.18.0 and v1.18.1
  • Add in-context exemplars to ’task_distiller’ and ’template_distillation’
  • Add task categorizer for Buffer-of-Thoughts thought templates
  • Remove custom async callback tracing handler in “llm-streaming-sg”
  • Add inital transform processor for langgraph nodes tracing
  • Add detection of resource information to otelcol configuration
  • Add additional filters to otelcol configuration
  • Add utility script for langgraph + vllm + openinference + autoawq checks
  • Add inital otel collector config for langgraph workflow
  • Amend template distillation from local model to remote api endpoint
  • Conduct sanity checks on vllm gguf support for phi3.5 mini instruct

Release v0.33

New features, security, usability and UI enhancements.

Features

  • Initial implementation of langgraph workflow
  • Add fusion step to hybrid retrieval
  • Add implementation of new text chunked response for ’llm-streaming-sg’
  • Add initial implementation of adaptive rag
  • Implement classifier for detecting query of varying complexities
  • Add initial implementation of generating atomic expressions from text
  • Add initial implementation of multi-hop retrieval with reasoning chain
  • Retrieve base passage with query and atomic expressions
  • Add initial implementation of generating reasoning traces with llm

Performance

  • Migrate json to orjson for “llm-streaming-sg”
  • Migrate json to orjson in graph implementation
  • Migrate fastembed embedders to ‘CUDAExecutionProvider’
  • Add quantized representation of dense and sparse vectors
  • Add quantization search parameters for hybrid retrieval
  • Enable speculation decoding for vLLM engines

Security

  • Restore prompt injection classifier functionality
  • Add ‘gvisor’ for container sandboxing and resource isolation

Bug Fixes and Other Changes

  • Language model copying context information verbatim
  • Llm semantic cache response not returning correct chunks
  • Amend otel-collector configuration to avoid errors with “memory_limiter”
  • Reduce false negatives for safety check of queries

Refactor

  • Prepare vllm backend ‘model.py’ for integration with langgraph
  • “lm_assessment.py” script for langgraph workflow
  • Migrate web client to “colorScheme.surfaceContainerHighest”
  • Rename “MaterialState” to “WidgetState” in web client
  • Refactor dart ‘analysis_options.yaml’
  • ‘create_hybrid_embeddings.py’ script

Miscellaneous

  • Integrate safety and llm nodes in workflow
  • Add initial safety node to workflow
  • Add initial integration of VLLM engine with langgraph
  • Quantize phi3-mini-128k-instruct to 4bit via AWQ
  • Add violation node to graph implementation
  • Migrate SLM from phi2 to phi3 for “llm-streaming-sg”
  • Migrate llm model to “mistral-7b-v03”
  • Add websearch and prompt compression to tools node of graph
  • Add topics routing to graph implementation
  • Add chat history as memory to graph implementation
  • Migrate web client and ‘index.html’ to Flutter SDK v3.22
  • Add initial implementation of baseline chunking strategy for ETL
  • Add optional step ‘generate_propositions’ to ETL pipeline for LLM
  • Generate propositions(atomic expression) from text chunks
  • Add additional field conditions for filtering RAG queries
  • Add “MAX_TOKENS” to “middleware-sg” environment files
  • Add random generator as seed for text generation
  • Add utilty function ‘create_stream_response’ for vllm text generation
  • Initial implementation of chunked text response for VLLM outputs
  • Manually pass config when streaming with “RunnableGenerator”
  • Initial integration of LangGraph workflow and tritonserver
  • Add nvidia driver env variables with default options
  • Apply baseline chunking strategy to each document in ETL pipeline
  • Add gemini api as evaluator for RAG generation
  • Add initial rag evaluation for “hybrid-retrieval-rerank-multi-step”

Release v0.32

New features, security, usability and UI enhancements.

Features

  • Amend web client text interface for multi-turn conversation

Bug Fixes and Other Changes

  • Fix web client misalignment order of chat history “HumanMessage” and “AIMessage”
  • Fix order of chat history from web client

Miscellaneous

  • Add “HumanMessage” and “AIMessage” to on-device encrypted chat history

Release v0.31

New features, security, usability and UI enhancements.

Features

  • Add initial implementation of chatbot with chat history
  • Add truncation step for context buffer from RAG, websearch and memory

Bug Fixes and Other Changes

  • Misclassification of user input topics
  • HumanMessage and AIMessage showing in text generation
  • VectorDB failure when truncating excess content
  • Unclosed backticks appearing at the end of llm output
  • Type error for session id in llm request from “middleware-sg”

Refactor

  • Pass key retrieval script

Miscellaneous

  • Amend lighthouse audit scripts for web client
  • Migrate dockerfile syntax from v1.4 to v1.7
  • Combine triplets “query-context-reference” for all files in directory
  • Add RAG evaluation for ’no-retrieval’ mode as baseline
  • Add RAG evaluation for ‘hybrid-retrieval’
  • Add RAG evaluation for ‘hybrid-retrieval-rerank’
  • Support anthropic claude3 models for RAG evaluation
  • Support openai(gpt-3.5/4-turbo) for RAG evaluation
  • Migrate local evaluator from “prometheus-13b-v1” to “prometheus-7b-v2”
  • Add ruler evaluation results for custom merge “mistral-dareties-v02”
  • Add initial length restriction to chat history for short-term memory
  • Add additional criteria when checking for length for chat history
  • Update existing session info on enduser authentication
  • Delete current enduser session info on password reset
  • Delete current enduser session info from database based on triggers
  • Write new app session on firebase authentication signed in action
  • Implement session info details(conversation_id, conversation_count)
  • Implement “write_session_info” as api endpoint background task
  • Add onnx cpu execution provider to text embeddings models

Release v0.30

New features, security, usability and UI enhancements.

Features

  • Migrate ’llm-streaming-sg’ to tritonserver-vllm v24.03
  • Add initial classifier llm(phi2-orange-v2) for classification tasks
  • Add initial multi-tenancy, search filters and retrieval optimizations
  • Add hybrid search using keywords and semantics
  • Add custom merged dense model(77 on eq_bench)
  • 2-stage hybrid retrieval with quantized text embeddings
  • Add detection for non-printable unicode characters in safety module
  • Add prompt injection detector to safety module
  • Add token limit check to input safety module of main runnable
  • Adhere safety content categories to MLCommons’ taxonomy of hazards

Performance

  • Replace base model for prompt compression
  • Run input safety functions in parallel

Security

  • Add list of dolphin-series system prompts for AI system red-teaming
  • Add initial risk assessment implementation for AI red team
  • Add ‘banwords’ component for llm output safety

Bug Fixes and Other Changes

  • DDG search utility in ’llm-streaming-sg’
  • Fix false positives from input safety classification

Miscellaneous

  • Add custom routing function for main runnable
  • Add retrieval candidates re-ranking using cross-encoders
  • Amend chunking strategy to max 512 tokens with 25% overlap
  • Migrate re-ranking model from ‘ms-marco’ to ‘mixedbreadai’ family
  • Migrate cross-encoder from ‘ms-marco’ to ‘mixedbread-ai’ family
  • Migrate from redis vector store to qdrant for hybrid retrieval
  • Migrate prompt compressor base model from ‘phi2’ to ‘bert’
  • Amend rag search terms to better reflect specific domains
  • Add zstd utility and loading of qdrant index to ’llm-streaming-sg’
  • Add initial list of ban words

Release v0.29

New features, security, usability and UI enhancements.

Features

  • Add initial implementation of RAG with redisvl library

Performance

  • Migrate prompt compression from llmlingua to longllmlingua
  • Implement local/remote semantic cache with tritonserver-vllm backend

Security

  • Implement initial langchain instrumentation using openinference
  • Initial integration of opentelemetry(fastapi,logging) for middleware
  • Add initial implementation of GCP Cloud Trace to middleware

Bug Fixes and Other Changes

  • Fix VLLM sampling params on middleware and tritonserver

Miscellaneous

  • Add structured generation pattern module
  • Implement tracing and guided generation for ‘main_runnable’
  • Override ainvoke method of LLM class for debugging and evaluation
  • Amend ’lm_assessment.py’ script to evaluate generic chain
  • Add python regex patterns for guided generation of web search terms
  • Add initial implementation of custom async callback handler
  • Add transform processor for parsing input values to trace attributes
  • Add initial resource and transform processor to otel collector
  • Migrate tritonserver to v24.02
  • Implement merging of search results in tritonserver-vllm backend
  • Add chunking operation for llm cached response and user warning
  • Add GPTQ format for phi-2
  • Add r2 as object store for pre-computed text embeddings
  • Add index creation and loading of text embeddings to ’llm-streaming-sg’
  • Initial experiment on mergekit dare-ties strategy with quantization
  • Add ‘raglegal’ to “retrieve_context” function
  • Construct multiple indexes for domains and subjects on the same db

Refactor

  • Split middleware into modules

Release v0.28

New features, security, usability and UI enhancements.

Features

  • Add static and dynamic prefixes to prompt template
  • Add in-context examples to ‘classify_input_topic_template’

Performance

  • Add URIAL prompt as static prefix for in-context learning
  • Add implementation of prompt compression for agent workflow
  • Migrate ’llm-streaming-sg’ sampling method to ‘min-p’
  • Tune LLMLingua parameters for speed

Security

  • Add initial ifeval evaluation for phi2, mistral and solar architectures
  • Add initial safety evaluation for phi2, mistral and solar architectures

Bug Fixes and Other Changes

  • Type error when assigning value to firebase-admin auth ‘check_revoked’
  • FastAPI vulnerability when using form data with a ReDos attack

Release v0.27

New features, security, usability and UI enhancements.

Features

  • Conditional branching of LCEL runnables
  • Add initial input safety checks to generic chain
  • Integrate input safety classification with de-identification of PII
  • Initial implementation of guard rails
  • Add duckduckgo search as fallback for tavily search

Security

  • Amend input and output safety prompt template
  • Implement JWT verification in envoy proxy
  • Amend envoy proxy jwt-authn configuration for different api routes

Bug Fixes and Other Changes

  • Fix security vulnerabilities for llm-tritonserver-streaming
  • Fix vLLM inference error with generating stream when doing web search

Refactor

  • Streaming response for standard and pro users
  • Pydantic data classes for llm request and response

Release v0.26

New features, security, usability and UI enhancements.

Features

  • Add initial implementation of Server Sent Events parsing on web client

Performance

  • Add initial load tests for envoy rate limiting feature
  • Add nghttp2 to support h2/h2c for hypercorn
  • Implement initial async engine for llm inference
  • Run vllm latency benchmarks on A100_40G on tp1|2|4|8 configuration

Bug Fixes and Other Changes

  • Add active health checks to envoy cluster and endpoint(s)
  • Add auto-scroll to mobile viewport on llm streaming responses
  • Add error handling for llm-proxy streaming responses
  • Add initial envoy configuration targeting tritonserver as upstream
  • Amend timestamp format for llm history viewing
  • Client authentication error with token timeout and llm history
  • Evaluate streaming responses from cloud run and compute engine
  • Merge sse client with fetch client to enable streaming responses
  • Migrate llm-tritonserver-streaming dependencies to latest
  • Migrate streaming llm-tritonserver to latest v23.11
  • Rectify the timestamp order of llm past responses on client
  • Refactor client text scale factor to text scaler
  • Revert tritonclient protocol from grpc to http

Miscellaneous

  • Add initial sanity checks, preprocessing and postprocessing for llm
  • Add microphone detection to on-device stt inference
  • Only render prompt hints on first visit to web client
  • Replace streambuilder with listenablebuilder for streaming responses

Release v0.25

New features, security, usability and UI enhancements.

Features

  • On-demand local audio generation from llm text outputs
  • Add initial implementation of on-device text-to-speech(TTS)
  • Add initial automatic-speech-recognition(ASR) inference pipeline
  • Add initial implementation of voice feature for web client

Performance

  • Run vllm latency benchmarks on distributed infrastructure
  • Migrate tritonclient protocol from http to grpc

Security

  • Migrate csp policy from allowlist to strict

Bug Fixes and Other Changes

  • Amend state management between theme mode switches
  • Absent microphone input on-device tts inference
  • Remove setstate from both on-device stt and tts inference loops
  • Adopt non-quantized tts model as workaround for audio distortion

Miscellaneous

  • Add nvtop build steps to gpu instance start up script
  • Add ui messages about on-device model processing
  • Add downloading status and message to on-device stt and tts models
  • Migrate llm-proxy and llm-tritonserver dependencies to latest
  • Add on-device model(s) download permission request and message
  • Amend ui dimensions for dome page mobile viewport
  • Add initial state management for llm extended functionalities ui
  • Migrate web client dependencies to latest

Release v0.24

New features, performance, usability and UI enhancements.

Features

  • Integrate inference engine vllm(PagedAttention) with langchain
  • Migrate llm instruct model to mistral 7b finetuned with openorca

Performance

  • Add grpc/http compression using brotli and gzip as fallback

Security

  • Add initial allow list to data anonymization
  • Add initial privacy feature for user data anonymization
  • Adopt a suitable unified objectives principle to guide llm output
  • Add initial prompt injection classifier to llm-tritonserver
  • Add client ui for accepting OSS license(s) to enable model usage

Bug Fixes and Other Changes

  • Remove duplicate whitespaces in llm output
  • vllm input prompt length exceeds limit warning
  • Sign in current user with custom token after license acceptance
  • UI not displaying generated text from llm inference
  • Add error handling to client access control

Miscellaneous

  • Increase speed of text animation for llm output for fast readers
  • Bump Flutter SDK and client dependencies to latest
  • Migrate middleware arch to python:3.11-slim-bookworm
  • Amend lighthouse configurations to latest v11.2
  • Add bloom license to client assets
  • Add license check for llm local inference on web client
  • Add license(s) agreement to user custom claims

Release v0.23

New features, performance, usability and UI enhancements.

Features

  • Add ‘bad_words_ids’ to llm output logits manipulation
  • Add storywriter prompt hints to guide responsible behavior
  • Increase storywriter text field height

Performance

  • Add initial trition inference server configuration for llm-cpu
  • Add model warmup to triton server
  • Implement local llm inference on nvidia compute capability >=8.0
  • Remove unnecessary js scripts during first load of web app
  • Revert local device generation strategy back to contrastive search

Bug Fixes and Other Changes

  • Replace adaptive scaffold from dome page with native scaffold
  • Temporarily remove fixed height container for llm-storywriter text field

Refactor

  • Amend llm server to http proxy targeting VMs

Miscellaneous

  • Add initial gpu build of llm + tritonserver
  • Add startup script for gpu enabled VMs
  • Amend api gateway endpoint from test to live
  • Amend endpoints of api gateway for testing and production
  • Amend utility script for starting VM instance with attached gpu
  • Increase sequence length of quantized llm-storywriter to 1024
  • UX enhancements when selecting or removing models on dome page

Release v0.22

New features, performance, security, usability and UI enhancements.

Features

  • Add initial custom claims json structure
  • Implement access control utility function to web client
  • Initial implementation of access control for frontend
  • Add initial access control utility to web client
  • Add initial implementation of CSP, COOP and COEP
  • Add email handler ui for large screen(laptop viewport)
  • Add email handler for medium screen(tablet viewport)
  • Add ‘recoverEmail’ ui to email handler page for desktop viewport
  • Add handler for ‘resetPassword’
  • Add initial email verification screen to mobile viewport

Performance

  • Add initial generic gpu and tensorrt optimizations

Security

  • Add cloud firewall rules for ingress traffic to vm
  • Add domains to CSP connect-src directive
  • Remove user permissions from authorization server(ory network)
  • Write permissions on firebase authentication trigger
  • Amend jwt payload on firebase authentication triggers(user-create)
  • Add initial live permisisons policies
  • Add ory network endpoint for permissions check
  • Add initial permissions checks to llm endpoint
  • Add initial access control to llm inference
  • Add initial access control to mobile appbar
  • Add initial enhanced enums to frontend permissions set
  • Add initial permissions set to access control
  • Add initial access control to account page login section

Bug Fixes and Other Changes

  • Migrate frontend dependencies to latest
  • Initialization of llm worker on widget first load
  • State management on spinning indicator of text toxicity widget
  • Add local fallback for llm inference
  • Amend read-write:api permissions for cloud function ‘user_create’
  • Move workbox navigation preload to start of workbox plugins
  • Amend iframe for status page to be credentialless

Documentation

  • Add initial design docs for implementating access control

Miscellaneous

  • Add initial changelog generator ‘git-cliff’
  • Remove changelog from revision tracking
  • Amend configuration in cliff.toml
  • Amend CSP directives with updated api gateway endpoint
  • Migrate VM deployment to gcp business account
  • Add primitive method of migrating database entries
  • Issues with building web pwa on Flutter v3.13.0, downgrade to v3.10.6
  • Add autoscaling policy based on cloud run middleware HTTP requests
  • Add health checks for autohealing and load balancing.
  • Add startup script to existing VMs
  • Add internal load balancer for regional backend VMs
  • Add utility script for configurating internal load balancer
  • Add utilty scripts for managing multiple VMs
  • Add utility scripts for cloud run and virtual machine deployment
  • Amend cloud run utility script
  • Add utility script for deploying cloud run service
  • Evaluate VM infrastructure for hosting llm inference endpoint
  • Amend env files for cloud function ‘user_create’
  • Test deployment of updated cloud function ‘user_create’
  • Add build scripts for cloud function ‘user_create’
  • Update email hash on email address change
  • Add cloudflare endpoint to robots.txt disallow field
  • Amend confirmation button text color of bottom sheet
  • Amend queue sequence of setState ‘_isInitialized’ of llm worker
  • Remove unneccesary listeners for worker events
  • Amend ui elements on account page medium screen

Refactor

  • Add web client worker initialization function to qna worker
  • Add web client async worker initialization to text toxicity widget
  • Add worker initialization to penguins worker
  • Add worker initialization function to autompg inference script
  • Amend snackbar ui in text gen widget to be adaptive
  • Remove custom profile screen from account page medium and large body
  • Replace custom profile screen with a simpler layout
  • Amend ui dimension of ‘showChangeEmailAddressDialog’

Release v0.21

New features, security, usability and UI enhancements.

Features

  • Add redesign of dome page for mobile portrait window sizes.
  • Add history feature for text generation.
  • Add local on-device onnx model for LLM text generation task.

Security

  • Add encryption(WebCryptoAPI) to web storage for data integrity.
  • Deprecate ‘X-Frame-Options’ header in favor of CSP directives ‘frame-src’ and ‘frame-ancestors’

Bug Fixes and Other Changes

Bug Fixes and Other Change

  • Migrate frontend dependencies to latest.
    • bazel_worker 1.0.3 (was 1.0.2)
    • beamer 1.5.6 (was 1.5.5)
    • build 2.4.1 (was 2.4.0)
    • build_modules 5.0.3 (was 5.0.2)
    • build_resolvers 2.2.1 (was 2.2.0)
    • build_runner 2.4.6 (was 2.4.5)
    • build_web_compilers 4.0.4 (was 4.0.3)
    • dart_jsonwebtoken 2.8.2 (was 2.8.0)
    • dart_style 2.3.2 (was 2.3.1)
    • dots_indicator 3.0.0 (was 2.1.2)
    • firebase_ui_auth 1.5.0 (was 1.4.3)
    • firebase_ui_oauth 1.4.4 (was 1.4.3)
    • firebase_ui_oauth_google 1.2.4 (was 1.2.3)
    • flutter_lints 2.0.2 (was 2.0.1)
    • font_awesome_flutter 10.5.0 (was 10.4.0)
    • introduction_screen 3.1.9 (was 3.1.8)
    • protobuf 3.0.0 (was 2.1.0)
    • shared_preferences_android 2.2.0 (was 2.1.4)
    • shared_preferences_foundation 2.3.0 (was 2.2.2)
    • shared_preferences_linux 2.3.0 (was 2.2.0)
    • shared_preferences_platform_interface 2.3.0 (was 2.2.0)
    • shared_preferences_web 2.2.0 (was 2.1.0)
    • shared_preferences_windows 2.3.0 (was 2.2.0)
    • sidebarx 0.16.0 (was 0.15.0)
    • source_gen 1.4.0 (was 1.3.2)
    • source_helper 1.3.4 (was 1.3.3)
    • url_launcher_android 6.0.36 (was 6.0.35)
    • url_launcher_platform_interface 2.1.3 (was 2.1.2)
    • win32 5.0.5 (was 4.1.4)
  • Migrate additional frontend dependencies to latest.
    • google_sign_in_android 6.1.17 (was 6.1.16)
    • json_serializable 6.7.1 (was 6.7.0)
    • shared_preferences 2.2.0 (was 2.1.2)
    • flutter_adaptive_scaffold 0.1.5 (was 0.1.4)
  • Migrate Flutter SDK to v3.10.6
  • Migrate additional frontend dependencies to latest.
    • dots_indicator 2.1.2 (was 3.0.0) (3.0.0 available)
    • flutter_adaptive_scaffold 0.1.6 (was 0.1.5)
    • freezed 2.4.1 (was 2.3.5)
    • freezed_annotation 2.4.1 (was 2.2.0)
    • google_sign_in_android 6.1.18 (was 6.1.17)
    • introduction_screen 3.1.11 (was 3.1.9)
    • path_provider_foundation 2.2.4 (was 2.2.3)
    • shared_preferences_foundation 2.3.2 (was 2.3.0)
    • url_launcher 6.1.12 (was 6.1.11)
    • url_launcher_macos 3.0.6 (was 3.0.5)
    • url_launcher_web 2.0.18 (was 2.0.17)
    • url_launcher_windows 3.0.7 (was 3.0.6)
    • xdg_directories 1.0.1 (was 1.0.0)
  • Migrate additional frontend dependencies to latest.
    • _flutterfire_internals 1.3.4 (was 1.3.3)
    • firebase_analytics 10.4.4 (was 10.4.3)
    • firebase_analytics_platform_interface 3.6.4 (was 3.6.3)
    • firebase_analytics_web 0.5.4+4 (was 0.5.4+3)
    • firebase_auth 4.7.0 (was 4.6.3)
    • firebase_auth_platform_interface 6.16.0 (was 6.15.3)
    • firebase_auth_web 5.6.0 (was 5.5.3)
    • firebase_core 2.15.0 (was 2.14.0)
    • firebase_ui_auth 1.6.0 (was 1.5.0)
    • firebase_ui_oauth 1.4.5 (was 1.4.4)
    • firebase_ui_oauth_google 1.2.5 (was 1.2.4)
  • Migrate additional frontend dependencies to latest.
    • http 1.1.0 (was 0.13.6)
    • google_fonts 5.1.0 (was 4.0.5)
  • Migrate additional frontend dependencies to latest.
    • firebase_auth 4.7.1 (was 4.7.0)
    • firebase_auth_web 5.6.1 (was 5.6.0)
    • firebase_ui_auth 1.6.1 (was 1.6.0)
    • firebase_ui_oauth 1.4.6 (was 1.4.5)
    • firebase_ui_oauth_google 1.2.6 (was 1.2.5)
    • plugin_platform_interface 2.1.5 (was 2.1.4)
    • sidebarx 0.16.1 (was 0.16.0)
    • url_launcher_android 6.0.37 (was 6.0.36)

Release v0.20

New features, security, usability and UI enhancements.

Features

  • Add initial implementation of ticketing system(Jira) and login-free service desk for paid users.
  • Add Pixel phone lineup as initial template for mobile platform.
  • Add initial usability enhancements(installation and update prompts).

Performance

  • Amend web workers WebAssembly(Wasm) configuration for ’tfjs-backend-wasm’.
  • Add assisted text generation.
  • Convert STT, LLM to onnx format and optimizations for x86 platform.

Bug Fixes and Other Changes

  • Migrate Flutter SDK to v3.10.5 latest.
  • Migrate web client middleware dependencies to latest.
  • Migrate llm dependencies to latest.
  • Migrate frontend dependencies to latest.
    • _fe_analyzer_shared 61.0.0 (was 60.0.0)
    • analyzer 5.13.0 (was 5.12.0)
    • args 2.4.2 (was 2.4.1)
    • build_runner 2.4.5 (was 2.4.4)
    • build_runner_core 7.2.10 (was 7.2.9)
    • built_value 8.6.1 (was 8.6.0)
    • csslib 1.0.0 (was 0.17.3)
    • freezed 2.3.5 (was 2.3.4)
    • google_sign_in 6.1.4 (was 6.1.3)
    • google_sign_in_android 6.1.15 (was 6.1.14)
    • google_sign_in_web 0.12.0+2 (was 0.12.0+1)
    • html 0.15.4 (was 0.15.3)
    • mockito 5.4.2 (was 5.4.1)
    • path_provider_windows 2.1.7 (was 2.1.6)
    • shared_preferences 2.1.2 (was 2.1.1)
    • win32 5.0.3 (was 4.1.4)
  • Migrate additional frontend dependencies to latest.
    • _flutterfire_internals 1.3.3 (was 1.3.2)
    • firebase_analytics 10.4.3 (was 10.4.2)
    • firebase_analytics_platform_interface 3.6.3 (was 3.6.2)
    • firebase_analytics_web 0.5.4+3 (was 0.5.4+2)
    • firebase_auth 4.6.3 (was 4.6.2)
    • firebase_auth_platform_interface 6.15.3 (was 6.15.2)
    • firebase_auth_web 5.5.3 (was 5.5.2)
    • firebase_core 2.14.0 (was 2.13.1)
    • firebase_core_web 2.6.0 (was 2.5.0)
    • firebase_dynamic_links 5.3.3 (was 5.3.2)
    • firebase_dynamic_links_platform_interface 0.2.6+3 (was 0.2.6+2)
    • firebase_ui_auth 1.4.3 (was 1.4.2)
    • firebase_ui_oauth 1.4.3 (was 1.4.2)
    • firebase_ui_oauth_google 1.2.3 (was 1.2.2)
    • flutter_svg 2.0.7 (was 2.0.6)
    • google_sign_in_android 6.1.16 (was 6.1.15)
    • sidebarx 0.16.0 (was 0.15.0)
    • vector_graphics 1.1.7 (was 1.1.6)
    • vector_graphics_codec 1.1.7 (was 1.1.6)
    • vector_graphics_compiler 1.1.7 (was 1.1.6)

Release v0.19

New features, security and UI enhancements.

Features

  • Add initial large language model(LLM) for open ended text generation.
  • Add initial adaptive scaffold to web client pages targeting mobile and tablet window sizes.

Security

  • Add authentication utility for token management in web client.

Breaking Changes

  • Migrate Dart to v3 and Flutter SDK to v3.10 latest.

Bug Fixes and Other Changes

  • Migrate frontend dependencies to latest.
    • firebase_analytics to v10.3.0
    • firebase_auth to v4.5.0
    • firebase_auth_web to v5.4.0
    • firebase_core to v2.11.0
    • firebase_core_platform_interface to v4.7.0
    • firebase_ui_auth to v1.3.0
    • firebase_ui_localizations to v1.4.0
    • firebase_ui_oauth to v1.3.0
    • firebase_ui_oauth_google to v1.1.5
    • html to v0.15.3
    • http to v0.13.6
    • json_annotation to v4.8.1
    • logging to v1.1.1
    • package_info_plus to v4.0.0
    • pointer_interceptor to v0.9.3+4
    • shared_preferences to v2.1.1
    • url_launcher to v6.1.11
    • url_launcher_web to v2.0.16
  • Migrate additional frontend dependencies to latest.
    • beamer 1.5.5 (was 1.5.4)
    • built_value 8.6.0 (was 8.5.0)
    • csslib 0.17.3 (was 0.17.2)
    • google_sign_in 6.1.1 (was 6.1.0)
    • mockito 5.4.1 (was 5.4.0)
    • path_provider_linux 2.1.11 (was 2.1.10)
    • url_launcher_web 2.0.17 (was 2.0.16)
  • Migrate additional frontend dependencies to latest.
    • Flutter SDK 3.10.2 (was 3.10.1)
    • build_runner_core 7.2.9 (was 7.2.8)
    • google_sign_in 6.1.2 (was 6.1.1)
    • google_sign_in_web 0.12.0+1 (was 0.12.0)
    • graphs 2.3.1 (was 2.3.0)
    • logging 1.2.0 (was 1.1.1)
  • Migrate additional frontend dependencies to latest.
    • _fe_analyzer_shared 61.0.0 (was 60.0.0)
    • _flutterfire_internals 1.3.2 (was 1.3.1)
    • analyzer 5.13.0 (was 5.12.0)
    • firebase_analytics 10.4.2 (was 10.4.1)
    • firebase_analytics_platform_interface 3.6.2 (was 3.6.1)
    • firebase_analytics_web 0.5.4+2 (was 0.5.4+1)
    • firebase_auth 4.6.2 (was 4.6.1)
    • firebase_auth_platform_interface 6.15.2 (was 6.15.1)
    • firebase_auth_web 5.5.2 (was 5.5.1)
    • firebase_core 2.13.1 (was 2.13.0)
    • firebase_dynamic_links 5.3.2 (was 5.3.1)
    • firebase_dynamic_links_platform_interface 0.2.6+2 (was 0.2.6+1)
    • firebase_ui_auth 1.4.2 (was 1.4.1)
    • firebase_ui_oauth 1.4.2 (was 1.4.1)
    • firebase_ui_oauth_google 1.2.2 (was 1.2.1)
    • google_sign_in 6.1.3 (was 6.1.2)
    • google_sign_in_platform_interface 2.4.1 (was 2.4.0)
    • package_info_plus 4.0.2 (was 4.0.1)
    • url_launcher_android 6.0.35 (was 6.0.34)
  • Migrate additional frontend dependencies to latest.
    • Flutter SDK 3.10.3 (was 3.10.2)
    • build_modules 5.0.2 (was 4.0.7)
    • build_web_compilers 4.0.3 (was 3.2.7)
    • code_builder 4.5.0 (was 4.4.0)
    • lints 2.1.1 (was 2.1.0)

Release v0.18

New features, security and UI enhancements.

Features

  • Add initial text animations on web client inference output states(success, error).
  • Migrate STT to HuggingFace transformers and diffusers library.
  • Migrate TTS to HuggingFace transformers and diffusers library.

Security

  • Add email hashing with salt randomization and personalization values to database operation ‘set-profile’ and authentication trigger ‘user-create’

Bug Fixes and Other Changes

  • Migrate Flutter SDK to v3.7.12 latest.
  • Migrate frontend dependencies to latest.
    • _fe_analyzer_shared 59.0.0 (was 58.0.0)
    • _flutterfire_internals 1.1.1 (was 1.1.0)
    • analyzer 5.11.1 (was 5.10.0)
    • firebase_analytics 10.2.1 (was 10.2.0)
    • firebase_analytics_platform_interface 3.4.1 (was 3.4.0)
    • firebase_analytics_web 0.5.2+1 (was 0.5.2)
    • firebase_auth 4.4.2 (was 4.4.1)
    • firebase_auth_platform_interface 6.13.1 (was 6.13.0)
    • firebase_auth_web 5.3.2 (was 5.3.1)
    • firebase_core 2.10.0 (was 2.9.0)
    • firebase_core_platform_interface 4.6.0 (was 4.5.3)
    • firebase_core_web 2.3.0 (was 2.2.2)
    • firebase_database 10.1.1 (was 10.1.0)
    • firebase_database_platform_interface 0.2.3+1 (was 0.2.3)
    • firebase_database_web 0.2.2+1 (was 0.2.2)
    • firebase_dynamic_links 5.1.1 (was 5.1.0)
    • firebase_dynamic_links_platform_interface 0.2.4+1 (was 0.2.4)
    • firebase_ui_auth 1.2.3 (was 1.2.1)
    • firebase_ui_localizations 1.3.0 (was 1.2.0)
    • firebase_ui_oauth 1.2.3 (was 1.2.1)
    • firebase_ui_oauth_google 1.1.3 (was 1.1.1)
    • firebase_ui_shared 1.2.0 (was 1.1.0)
    • flutter_keyboard_visibility 5.4.1 (was 5.4.0)
    • google_fonts 4.0.4 (was 4.0.3)
    • google_identity_services_web 0.2.1 (was 0.2.0)
    • google_sign_in 6.1.0 (was 6.0.2)
    • google_sign_in_android 6.1.14 (was 6.1.9)
    • google_sign_in_platform_interface 2.4.0 (was 2.3.1)
    • google_sign_in_web 0.12.0 (was 0.11.0+2)
    • introduction_screen 3.1.8 (was 3.1.7)
    • mockito 5.4.0 (was 5.3.2)
    • package_info_plus 3.1.2 (was 3.1.0)
    • path_provider 2.0.14 (was 2.0.13)
    • path_provider_android 2.0.27 (was 2.0.24)
    • path_provider_foundation 2.2.2 (was 2.2.1)
    • path_provider_windows 2.1.6 (was 2.1.5)
    • shared_preferences 2.1.0 (was 2.0.18)
    • shared_preferences_android 2.1.4 (was 2.1.1)
    • shared_preferences_foundation 2.2.1 (was 2.2.0)
    • shared_preferences_linux 2.2.0 (was 2.1.5)
    • shared_preferences_platform_interface 2.2.0 (was 2.1.1)
    • shared_preferences_web 2.1.0 (was 2.0.6)
    • shared_preferences_windows 2.2.0 (was 2.1.5)
    • url_launcher_android 6.0.31 (was 6.0.27)
    • url_launcher_ios 6.1.4 (was 6.1.3)
    • url_launcher_linux 3.0.5 (was 3.0.4)
    • url_launcher_macos 3.0.5 (was 3.0.4)
    • url_launcher_windows 3.0.6 (was 3.0.5)
    • web_socket_channel 2.4.0 (was 2.3.0)
    • win32 4.1.3 (was 3.1.4)
  • Migrate web client middleware dependencies to latest.
    • aiohttp v3.8.3 to v3.8.4
    • APScheduler v3.10.0 to v3.10.1
    • attrs v22.2.0 to v23.1.0
    • charset-normalizer v2.1.1 to v3.1.0
    • email-validator v1.3.1 to v2.0.0.post2
    • fastapi v0.95.0 to v0.95.1
    • firebase-admin v6.0.1 to v6.1.0
    • google-api-python-client v2.75.0 to v2.86.0
    • google-auth v2.16.0 to v2.17.3
    • google-cloud-firestore v2.9.1 to v2.11.1
    • google-resumable-media v2.4.1 to v2.5.0
    • googleapis-common-protos v1.58.0 to v1.59.0
    • grpcio v1.51.1 to v1.54.0
    • grpcio-status v1.51.1 to v1.54.0
    • httpcore v0.16.3 to v0.17.0
    • httplib2 v0.21.0 to v0.22.0
    • httpx v0.23.3 to v0.24.0
    • loguru v0.6.0 to v0.7.0
    • msgpack v1.0.4 to v1.0.5
    • openai v0.26.4 to v0.27.4
    • orjson v3.8.5 to v3.8.10
    • packaging v23.0 to v23.1
    • pip v23.1.1 to v23.1.2
    • protobuf v4.21.12 to v4.22.3
    • pyasn1 v0.4.8 to v0.5.0
    • pyasn1-modules v0.2.8 to v0.3.0
    • pydantic v1.10.4 to v1.10.7
    • python-dotenv v0.21.1 to v1.0.0
    • pytz v2022.7.1 to v2023.3
    • requests v2.28.2 to v2.29.0
    • rfc3986 v1.5.0 to v2.0.0
    • setuptools v67.1.0 to v67.7.2
    • stripe v5.0.0 to v5.4.0
    • typing_extensions v4.4.0 to v4.5.0
    • yarl v1.8.2 to v1.9.2

Release v0.17.1

Security fixes for backend application middleware and microservices.

Bug Fixes and Other Changes

  • Fix penguins inference by scaling inputs between the range of 0~1.

Release v0.17

Migrate remaining models to D.O.M.E, various performance and UI enhancements.

Performance

  • Add TensorFlow.js WebAssembly(Wasm) runtime backend to remaining web workers of web client.

Bug Fixes and Other Changes

  • Migrate frontend dependencies to latest.
  • Migrate additional frontend dependencies to latest.
  • Migrate Flutter SDK to v3.7.8 latest.
  • Add delay to tooltip display.
  • Refactor home page for responsive layout.
  • Add initial focus node to single text field ‘onSubmitted’ action for regression housing
  • Migrate text toxicity widget to dome page.
  • Migrate Speech-to-Text(STT) widget to dome page.
  • Migrate Text-to-Speech(TTS) widget to dome page.
  • Migrate Questions-and-Answers(QNA) widget to dome page.
  • Migrate regression autompg widget to dome page.
  • Migrate classification penguins widget to dome page.
  • Refactor account page change email dialog UI.
  • Refactor account page sections of login, forgot-password and registration.

Release v0.16

New features, D.O.M.E(data-driven optimization for model engineering), various security and UI enhancements.

Features

  • Conceptualize, design, prototype and preview D.O.M.E UI.
  • Migrate web client widgets to Material 3 guidelines.
  • Merge account side bar into home page side menu bar.

Security

  • Add initial build attestations software-bill-of-materials(SBOM) and provenance for software supply chain security.

Bug Fixes and Other Changes

  • Migrate frontend dependencies to latest.
    • Flutter SDK to v3.7.0
    • google_fonts to v4.0.1
    • json_annotation to v4.8.0
    • build_web_compilers to v3.2.7
    • freezed to v2.3.2
    • hive_generator to v2.0.0
    • json_serializable to v6.6.0
    • TensorFlow.js to v4.2.0
    • coverage to v1.6.3
    • firebase_analytics to v10.1.1
    • firebase_auth to v4.2.6
    • firebase_core to v2.5.0
    • firebase_database to v10.0.10
    • firebase_dynamic_links to v5.0.12
    • firebase_ui_auth to v1.1.10
    • firebase_ui_localizations to v1.1.1
    • firebase_ui_oauth to v1.1.10
    • firebase_ui_oauth_google to v1.0.17
    • font_awesome_flutter to v10.4.0
    • google_fonts to v4.0.3
    • json_serializable to v6.6.1
    • package_info_plus to v3.0.3
    • pointer_interceptor to v0.9.3+4
    • url_launcher to v6.1.9
    • xdg_directories to v1.0.0
  • Migrate backend app middleware dependencies to latest.
    • debian to v11.6-slim
    • aiohttp to v3.8.3
    • apscheduler to v3.10.0
    • beautifulsoup4 to v4.11.2
    • cachecontrol to v0.12.11
    • cachetools to v5.3.0
    • email-validator to v1.3.1
    • fastapi to v0.89.1
    • google-api-python-client to v2.75.0
    • google-auth to v2.16.0
    • google-cloud-firestore to v2.9.1
    • google-cloud-logging to v3.5.0
    • google-resumable-media to v2.4.1
    • googleapis-common-protos to v1.58.0
    • httpx to v0.23.3
    • openai to v0.26.4
    • orjson to v3.8.5
    • packaging to v23.0
    • proto-plus to v1.22.2
    • python-dotenv to v0.21.1
    • pytz to v2022.7.1
    • requests to v2.28.2
    • rfc3986 to v1.5.0
    • setuptools to v67.1.0
    • urllib3 to v1.26.14
  • Migrate backend STT dependencies to latest and amend tests.
    • cachetools to v5.3.0
    • editdistance to v0.6.2
    • fastapi to v0.89.1
    • h2 to v4.1.0
    • hydra-core to v1.3.1
    • hypercorn to v0.14.3
    • ipywidgets to v8.0.4
    • marshmallow to v3.19.0
    • matplotlib to v3.6.3
    • orjson to v3.8.5
    • pandas to v1.5.3
    • protobuf to >=v3.20.1
    • pynini to v2.1.5
    • pytorch-lightning to >=v1.6.5
    • unidecode to v1.3.6
    • youtokentome to v1.0.5
  • Migrate backend TTS dependencies to latest and amend tests.
    • fastapi to v0.89.1
    • boto3 to v1.26.62
    • cachetools to v5.3.0
    • editdistance to v0.6.2
    • fastapi to v0.89.1
    • frozendict to v2.3.4
    • h5py to v3.8.0
    • inflect to v6.0.2
    • ipython to v8.9.0
    • matplotlib to v3.6.3
    • nltk to v3.8.1
    • numba to v0.56.4
    • orjson to v3.8.5
    • pandas to v1.5.3
    • rapidfuzz to v2.13.7
    • regex to v2022.10.31
    • sacrebleu to v2.3.1
    • sentencepiece to v0.1.97
    • torchmetrics to v0.6.2
    • unidecode to v1.3.6
    • wandb to v0.13.9
    • webdataset to v0.2.31
  • Migrate cloud functions dependencies to latest and amend tests.
    • user_create
    • user_delete
  • Switch off failing tests for frontend web client after migrating to Flutter SDK v3.7 branch.
    • add stack_trace library for improved debugging experience
    • update test coverage statistics
  • Fix container background flicker of news widget on home page.
  • Fix jitter of left side menu icons by removing deferred locations.

Release v0.15

New features, search engine optimization(SEO), performance, security and UI enhancements.

Features

  • Add initial implementation of moderation endpoint from OpenAI.
  • Add initial localizations(us, ja, ko, zh) for user interface(UI).
  • Add initial SEO.

Performance

  • Add web resource hints for critical and subsequent needs.
  • Add initial cache eviction policies for service worker caches.

Security

  • Refactor logging infrastructure and functionality.
  • Add initial structured logging and customized events to core services.
  • Add initial suspicious and malicious events logging to core services.
  • Add initial structured logging and customized events to sensitive operations.
  • Refactor implementation of Firebase Analytics and create custom events.
  • Refactor token authentication for client and backend admin SDK.

Bug Fixes and Other Changes

  • Migrate Flutter dependencies to latest.
    • firebase_analytics to v10.1.0
    • firebase_auth to v4.2.4
    • firebase_core to v2.4.1
    • firebase_database to v10.0.9
    • firebase_ui_auth to v1.1.6
    • firebase_ui_localizations to v1.0.2
    • firebase_ui_oauth to v1.1.6
    • firebase_ui_oauth_google to v1.0.13
    • font_awesome_flutter to v10.3.0
    • introduction_screen to v3.1.2
    • provider to v6.0.5
  • Migrate application middleware dependencies to latest.
    • asgiref to v3.6.0
    • attrs to v22.2.0
    • certifi to v2022.12.7
    • fastapi to v0.88.0
    • google-api-core to v2.11.0
    • google-api-python-client to v2.70.0
    • google-auth to v2.15.0
    • google-cloud-firestore to v2.7.3
    • google-cloud-logging to v3.4.0
    • grpcio-status to v1.51.1
    • grpcio to v1.51.1
    • httpx to v0.23.2
    • lxml to v4.9.2
    • multidict to v6.0.4
    • orjson to v3.8.3
    • packaging to v22.0
    • protobuf to v4.21.12
    • pydantic to v1.10.4
    • pytz to v2022.7
    • stackprinter to v0.2.10
    • starlette to v0.22.0
    • starlette_context to v0.3.5
  • Amend UI layout on service pages targeting tablet(1366x768) and laptop(1920x1080) screen resolutions.

Release v0.14

Performance enhancements, various UI fixes and reduced overall build size to 13Mb(~60% reduction).

Features

  • Add initial browser feature detection for web APIs and capabilities.

Performance

  • Implement initial automated JSON de/serialization for client request and response.
  • Implement deferred loading of libraries to reduce initial startup time from average 7.18 to 5.35 seconds(26% reduction).
  • Migrate large icons file type to WebP format.
  • Add initial lab/field performance budget for mobile profile.
  • Migrate XHR to Fetch API, using separate threads for HTTP requests.
  • Add initial custom configuration of service worker using workbox with navigation preload.
  • Add additional workbox modules and plugins to enhance user experience.
  • Migrate non-UI work to dedicated web workers for data processing.
  • Migrate to HTTP/2 server for application middleware and microservices.
  • Migrate static media(images, icons) and fonts to Cloudflare R2 object store.

Security

  • Migrate to Manifest V3 syntax and add content security policy(CSP) as secondary level of XSS and framing attacks mitigation.
  • Add basic content security policy to application middleware and core API services.

Bug Fixes and Other Changes

  • Migrate Flutter dependencies to latest.

    • firebase_analytics to v10.0.6
    • firebase_auth to v4.1.4
    • firebase_core to v2.3.0
    • firebase_core_platform_interface to v4.5.2
    • firebase_database to v10.0.6
    • flutterfire_ui to v0.4.3+20
    • html to v0.15.1
    • package_info_plus to v3.0.2
    • url_launcher to v6.1.7

    — development dependencies —

    • json_serializable to v6.5.4
  • Migrate web and TensorFlow.js dependencies to latest.

    • tensorflow/tfjs to v4.1.0
  • Migrate application server dependencies to latest.

    • anyio to v3.6.2
    • apscheduler to v3.9.1.post1
    • charset-normalizer to v2.1.1
    • firebase-admin to v6.0.1
    • frozenlist to v1.3.3
    • google-api-python-client to v2.66.0
    • google-auth to v2.14.1
    • googleapis-common-protos to v1.57.0
    • grpcio-status to v1.50.0
    • grpcio to v1.50.0
    • httplib2 to v0.21.0
    • orjson to v3.8.2
    • protobuf to v4.21.9
    • pytz to v2022.6
    • setuptools to v65.6.3
    • starlette to v0.21.0
    • stripe to v5.0.0
    • urllib3 to v1.26.13

Release v0.13.1

Security update and bug fixes.

Security

  • Security update of backend dependencies.
    • mistune to >=v2.0.3
    • nltk to v3.6.6
    • protobuf to >=3.20.1
    • setuptools to v65.5.1
    • wheel to >=0.38.0

Bug Fixes and Other Changes

  • Migrate Flutter SDK to latest v3.3.9.
    • Fix error when using private variable setters in mixins on dart web link.
    • Type parameter nullability performs incorrectly in factory constructors link.

Release v0.13

Various UI and stability enhancements.

Features

  • Migrate Stripe API version to latest 2022-11-15.

Security

  • Add integration testing for backend dependencies.

Bug Fixes and Other Changes

  • Migrate to latest dependencies for Firebase authentication cloud functions.
  • Migrate to latest dependencies for Text-to-Speech service.
  • Migrate to latest dependencies for Speech-to-Text service.

Release v0.12

UI and security enhancements.

Features

  • Migrate Stripe API version to 2022-08-01.

Performance

  • Add custom JSON deserialization for improved performance over Python standard library json module.

Security

  • Add server side input sanitization and validation.
  • Add request body validation for consumption by service APIs.

Bug Fixes and Other Changes

  • Refactor core service pages.

    • regression
    • classification
    • generative
  • Refactor app bar.

  • Migrate Flutter dependencies to latest.

    • async to v2.9.0
    • beamer to v1.5.3
    • fake_async to v1.3.1
    • firebase_analytics to v9.3.8
    • firebase_auth to v3.11.2
    • firebase_core to v1.24.0
    • firebase_database to v9.1.7
    • flutterfire_ui to v0.4.3+14
    • font_awesome_flutter to v10.2.1
    • json_annotation to v4.7.0
    • logging to v1.1.0
    • package_info_plus to v2.0.0
    • provider to v6.0.4
    • sidebarx to v0.14.0
    • url_launcher to v6.1.6

    — development dependencies —

    • build_runner to v2.3.0
    • mockito to v5.3.2
  • Migrate server dependencies to latest.

    • aiohttp to v3.8.3
    • certifi to v2022.9.24
    • fastapi to v0.85.0
    • firebase-admin to v6.0.0
    • frozenlist to v1.3.1
    • google-api-core to v2.10.2
    • google-api-python-client to v2.64.0
    • google-auth to v2.12.0
    • google-cloud-firestore to v2.7.2
    • google-cloud-logging to v3.2.5
    • google-crc32c to v1.5.0
    • google-resumable-media to v2.4.0
    • grpcio to v1.49.1
    • grpcio-status to v1.49.1
    • h11 to v0.14.0
    • httptools to v0.5.0
    • idna to v3.4
    • orjson to v3.8.0
    • proto-plus to v1.22.1
    • protobuf to v4.21.7
    • pydantic to v1.10.2
    • python-dotenv to v0.21.0
    • pytz to v2022.4
    • sniffio to v1.3.0
    • stripe to v4.2.0
    • typing_extensions to v4.4.0
    • uvicorn to v0.18.3
    • uvloop to v0.17.0

Release v0.11.1

Bug fixes and other changes.

  • Migrate Flutter to latest(v3.3.3).
    • Security vulnerability in dart:uri core library link.
    • Avoid CFE crashes when input contains invalid super parameters usage link.
  • Fix error handling for listening to FirebaseAuth streams.
  • Fix app bar null state.
  • Fix various sections on email handler page.
    • verifyEmail
    • resetPassword
    • recoverEmail
  • Fix pointer events being swallowed by HtmlElementView on status page.
  • Fix undismissable intro screen dialog when rendering over HTMLElementView.
  • Add spinning indicator for status page.

Release v0.11

UI and stability enhancements.

Features

  • Add global text selection to core pages.
  • Add version number to menu shortcut popup.

Bug Fixes and Other Changes

  • UI improvements for menu shortcuts.
  • Add initial Flutter run scripts with configurations.
  • Refactor autocomplete search field in web client.
  • Refactor error handling in web client.
  • Refactor home menu side bar in web client.
  • Refactor web application manifest.

Release v0.10.1

Bug fixes and other changes.

  • Amend client-side verification of user input in text fields.

Release v0.10

Update dependencies to latest and security enhancements.

Performance

  • Refactor index.html to customize initialization and utilize script flutter.js.

Security

  • Add package:logging for client structured logging.
  • Add initial data and field validation for asgi server and utility modules.

Bug Fixes and Other Changes

  • Update Flutter dependencies to latest:

    • beamer to v1.5.2
    • firebase_analytics to v9.3.2
    • firebase_database to v9.1.2
    • firebase_auth to v3.6.4
    • firebase_core to v1.21.0
    • flutterfire_ui to v0.4.3+6
    • json_annotation to v4.6.0
    • mockito to v5.3.0
    • url_launcher to v6.1.5
    • url_launcher_web to v2.0.13

    — development dependencies —

    • build_runner to v2.2.0
    • json_serializable to v6.3.1
  • Update Web and TensorFlow.js dependencies to latest:

    • eslint to v8.22.0
    • typescript-eslint/eslint-plugin to v5.33.1
    • typescript-eslint/parser to v5.33.1
    • flow-bin to v0.181.2
    • flow-remove-types to v2.185.1
    • tensorflow/tfjs to v3.19.0
  • Update ASGI server dependencies to latest:

    • attrs to v22.1.0
    • cachetools to v5.2.0
    • certifi to v2022.6.15
    • charset-normalizer to v2.1.1
    • click to v8.1.3
    • fastapi to v0.80.0
    • google-api-python-client to v2.58.0
    • google-auth to v2.11.0
    • google-cloud-core to v2.3.2
    • google-cloud-firestore to v2.6.1
    • google-cloud-logging to v3.2.2
    • grpcio-status to v1.47.0
    • grpcio to v1.47.0
    • lxml to v4.9.1
    • orjson to v3.7.12
    • proto-plus to v1.22.0
    • protobuf to v4.21.5
    • pydantic to v1.9.2
    • python-dotenv to v0.20.0
    • pytz to v2022.2.1
    • rsa to v4.9
    • stripe to v4.1.0
    • typing_extensions to v4.3.0
    • urllib3 to v1.26.12
    • uvicorn to v0.18.2
    • yarl to v1.8.1
  • Refactor GCP cloud functions user_create and user_delete.

Release v0.9.1

Bug fixes and other changes.

  • Fix audio element rebuild on input changes.
  • Amend structured logging on client.

Release v0.9

UI and security enhancements.

Security

  • Add optional social provider - Google.
  • Add optional user activity logs.

Bug Fixes and Other Changes

  • Refactor Firebase auth mock file.

  • Update Flutter dependencies:

    • animations to v2.0.3
    • beamer to v1.4.1
    • expandable_text to v2.3.0
    • fake_async to v1.3.0
    • firebase_auth to v3.4.1
    • firebase_core to v1.13.1
    • flutterfire_ui to v0.4.2+2
    • google_sign_in to v5.3.3
    • js to v0.6.4
    • mockito to v5.2.0
    • provider to v6.0.2
    • shared_preferences to v2.0.15
    • shared_preferences_web to v2.0.4
    • url_launcher to v6.1.4
    • url_launcher_web to v2.0.12
    • firebase_analytics to v9.1.12
  • Update dev dependencies:

    • json_serializable to v6.2.0
    • test to v1.21.1
  • Update web dependencies:

    • tensorflow/tfjs to v3.18.0
    • flow-remove-types to v2.181.2
    • idb to v7.0.2
    • npm to v8.13.2
    • util to v0.12.4
  • Update backend dependencies:

    • Python to v3.9.x
  • Remove navigation rail due to unexpected bug.

Release v0.8

Integration with external tooling and various enhancements.

Features

  • Integration with landing page conversion using Carrd.
  • Persistent state management across page reloads.

Security

  • Criteria checks on core endpoints.
  • Dedicated application server behind API Gateway.
  • Amend service endpoints to be private requiring authenticated access.
  • Add request body validation in API gateway.

Bug Fixes and Other Changes

  • Add initial CI/CD nightly builds.
  • Add Firestore as database.
  • Standardize service tiers and endpoints to Basic, Standard and Pro.
  • Various security fixes.
  • Various stability fixes.
  • Various UI/UX improvements.
  • Refactor Flutter client.
  • Upgrade various dependencies.

Release v0.7.1

Bug fixes and other changes.

  • Add workaround on canvaskit’s issue with loading fonts and icons from CDNs.

Release v0.7.0

Utilize GPU as default option for running TensorFlowJS models.

Features

  • Right navigation rail - RSS text feed.

Performance

  • Set WebGL/2 default backend for TensorFlowJS models.

Security

  • Implement API rate limits on web client and API Gateway.

Bug Fixes and Other Changes

  • Add HTTP request retries and time-out periods on failure modes(301, 408, 503, etc) with back-offs.
  • Migrate to Beamer v1.3.0.
  • Migrate to canvaskit-wasm v0.31.0 and fix UI render with window resizing.
  • Migrate to tensorflow-js v3.12.0.

Release v0.6.1

Bug fixes and other changes.

  • Bump dependencies and migrate text-to-speech service under API-Gateway.
  • Bump dependencies and migrate speech-to-text service under API-Gateway.
  • Bump dependencies and migrate video frame interpolation service under API-Gateway.
  • Bump dependencies and migrate image reconstruction service under API-Gateway.
  • Bump dependencies and migrate image translation service under API-Gateway.
  • Fix UI elements on latest models page between 300-600px width.

Release v0.6.0

Baseline model for video frame interpolation(removed temporarily).

Features

  • Baseline model for video frame interpolation.
  • Add initial support for Firefox browser.

Release v0.5.2

Quick fix.

  • Update blog links and release build to Flutter v2.8.0.

Release v0.5.2

Bug fixes and other changes.

  • Add guards against unauthenticated access from search field.
  • Fix accidental account deactivation from empty item on settings menu.
  • Amend search field to be expandable with input focus.

Release v0.5.1

Bug fixes and other changes.

  • Amend request-response flow for REST endpoints.
  • Separate UI elements from asynchronous long running requests(>3 seconds).
  • Amend error handling and tests for asynchronous endpoints.
  • Amend texts to be selectable with copy-paste functionality.
  • Add workaround for noisy artifacts using canvaskit with kTransparentImage.

Release v0.5.0

Features

  • Baseline image translation model.

Security

  • Implement operational logging as database.

Bug Fixes and Other Changes

  • Fix mouse horizontal scrolling after changes in ScrollBehavior.

Release v0.4.1

Bug fixes and other changes.

  • Add sign-in flows with email/password, passwordless and social identity providers.
  • Add token-based authentication for restricted API access.
  • Add URL route guarding against unauthenticated users.
  • Fix hindered view of VQVAE digits selection with dropdown list.

Release v0.4.0

Features

  • Baseline vector-quantized variational autoencoder(vqvae) service for image reconstruction.

Release v0.3.1

Bug fixes and other changes.

  • Change implementation and deployment of text-to-speech service from App Engine to Cloud Run.

Release v0.3.0

Features

  • Baseline speech-to-text model with remote and local inference.

Bug Fixes and Other Changes

  • Fixes playback of audio files from host file system.
  • Fixes controller of bytes transfer for speech-to-text service.

Release v0.2.1

Bug fixes and other changes.

  • CVE-2021-29512 Bump TensorFlow version to patched v2.3.3.
  • Check for mounted property before calling setState() in asynchronous functions.

Release v0.2.0

Features

  • Baseline audio model(text-to-speech).
  • Include basic information with About page.

Performance

  • Warm up model requests and pre-cache assets with service worker.

Security

  • Secure microservices with firewall rules to prevent exploitation from malicious actors.
  • Represent text data in transmit with Base64 encoding schemes.

Release v0.1.2

UI enhancements.

Features

  • Add skeleton loader for improvements in perceived performance.

Release v0.1.1

Bug fixes and other changes.

  • Convert image assets to WebP format.
  • Improve application loading time.
  • Add paste shortcut icon to QnA model.
  • QnA model accept inputs from system clipboard.
  • UI improvements: Collapsible overview.

Release v0.1.0

Features

  • Progressive web app paradigm.

    • Installable for offline usage, though internet connection is required when some models are fetched from CDNs to keep app bundle small.
  • Flutter Navigator 2.0 API for web navigation using URLs.

  • Dark and light theme, default is system theme.

  • Support and tested for desktop web only(linux chromium).

  • Baseline regression, classification and generative models.

Performance

  • Likely to work on other modern W3C-compliant browsers, but UI/UX experience not optimal.