v0.7.0 LayoutGPT, Embeddings and 3D-FUTURE support

Change Log

• Add LayoutGPT
• Change embeddings source from solr to FAISS
• Add additional parameters to customize retrieval options (filtering by category and wnsynset)
• Add ability to generate scenes using original 3D-FUTURE controls (i.e. map 3D-FUTURE assets to the classes used by ATISS, DiffuScene, etc.)
• Fixes to Holodeck scene conversion

v0.6.0: Holodeck, Evaluation Metrics

Change Log

• Extend module for architecture generation to use Holodeck
• Ported initial implementation for Holodeck into pipeline, including conversion from ai2thor to STK format
• Add evaluation metrics for scene graph evaluation and walkable metric
• Update config during flask run to load overridden parameters through overrides.json
• Add LLMSession module as an interface to handle LLM execution across different platforms
• Add options for disabling fixing of z coordinate for all objects
• Add compatibility documentation of different parameters
• Other miscellaneous bug fixes

v0.5.1: Updates to Parameter Defaults

Change Log

• The prior parameter defaults were functional but could lead to unusual scenes per the specified combination, or at least didn't quite match the default behavior prior to their addition. While they can of course be configured, if your SSTK is not up-to-date, you may not be able to readily change them in the UI. Thus some minor changes were made to improve the default parameter behavior.

v0.5.0: Expanded Evaluation Code, Architecture Generation Framework

Change Log

• Add further infrastructure for at-scale inference and evaluation, including STK caching and 2D renders
• New metrics include
  • in-bounds rate
  • collision rate
  • navigability
  • generation distribution
  • performance (memory usage, runtime)
• Add infrastructure for future methods for architecture generation, including a simple base method for generating a square floorplan (no walls or ceiling)

v0.4.3: documentation improvements

Change Log

• Minor improvements to the configuration files and documentation for libsg setup

v0.4.2: Scene Parser Bug Fix

Change Log

• Bug fix regarding part of the LLM scene parser prompt that was accidentally removed during some changes

v0.4.1: Scene Parser Improvements and Starter Evaluation Code

Change Log

• Added improvements to LLM-based scene graph parser to handle implicit objects/relationships and add reflexive relationships between objects
• Added starter evaluation code to compute metrics for generated scenes

v0.4.0: Embedding Search and Bug Fixes

Change Log

• Implementation for full embedding search using solr database
• Implementation of API for querying shapes based on text, incl. retrieving the text embedding directly or applying the text embedding to search through the solr database in the backend
• Fix to architecture loading from Structured3D; originally, the door and window openings were not being processed properly, causing them to be dropped in the final rendered scene
• Minor performance optimizations to shap-e and InstructScene to properly use GPU when running models
• Fixes to environment configuration

v0.3.0: scene graph parsing and InstructScene

Change Log

• Add architecture retrieval
• Add scene graph parsing by InstructScene (diffusion), LLM, or keyword search for room type
• Add InstructScene implementation
• Add object shape generation
• Add object retrieval for 3D-FUTURE assets
• Fix issues with DiffuScene layout outputs

v0.2.1: Asset Link Fixes

This version pushes some minor fixes to the asset link references in the repository.

Change Log

• Change object mesh directories (for collision detection in object placement) to public hssd-hab repository
• Disable vanilla scene retrieval. This API was mainly left in the original implementation to allow users to use libsg to retrieve the HSSD scenes as-is, but we are not using it in any part of the main scene generation code.
• Change structured3d metadata resource link to the sstk-metadata repository for public access.